|
2017-08-03
§
|
| 13:28 |
<elukey> |
drop CookieBlock backup tables for T171883 |
[production] |
| 13:26 |
<marostegui> |
Starting the actual s4 codfw failover db2019 -> db2051 - T170351 |
[production] |
| 13:22 |
<gehel> |
banning elastic1032 - T168816 |
[production] |
| 13:19 |
<chasemp> |
disabling puppet acros wmcs things for testing |
[production] |
| 13:14 |
<marostegui> |
Start topology change for s4 in codfw, slaves will be moved under db2051 - T170351 |
[production] |
| 13:10 |
<aude@tin> |
Synchronized php-1.30.0-wmf.12/extensions/Wikidata: Fix bug in InjectRCRecordsJob (duration: 02m 12s) |
[production] |
| 13:01 |
<marostegui> |
Disable gtid on s4 codfw slaves to get ready for the topology change - T170351 |
[production] |
| 12:15 |
<marostegui> |
Restart MySQL on db2051 - T170351 |
[production] |
| 10:21 |
<elukey> |
removed /run/pacct_shadow.d on stat1005 to allow atopacct.service restart |
[production] |
| 10:01 |
<moritzm> |
installing poppler security updates on trusty |
[production] |
| 09:57 |
<_joe_> |
systemctl reset-failed puppetmaster.service on labpuppetmaster1002 |
[production] |
| 09:52 |
<moritzm> |
installing mysql 5.5 security updates (package as shipped by Debian jessie, not our internal wmf-mariadb package) |
[production] |
| 09:32 |
<gehel> |
banning elastic103[01] - T168816 |
[production] |
| 08:56 |
<ema> |
upgrading cache_upload to varnish 4.1.8-1wm1 |
[production] |
| 08:36 |
<gehel> |
banning elastic102[89] - T168816 |
[production] |
| 08:35 |
<marostegui> |
Stop MySQL on db2045 to copy its data to db2075 - T170662 |
[production] |
| 08:34 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2045 - T170662 (duration: 00m 47s) |
[production] |
| 08:33 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db2045 - T170662 (duration: 00m 47s) |
[production] |
| 07:58 |
<marostegui> |
Add db2073 and db2074 to tendril - T170662 |
[production] |
| 06:19 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add db2074 to s3 - T170662 (duration: 00m 46s) |
[production] |
| 06:18 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Add db2074 to s3 - T170662 (duration: 00m 46s) |
[production] |
| 06:01 |
<marostegui> |
Compress s7 on db1102 - T172169 |
[production] |
| 05:57 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2051 - T170351 (duration: 00m 54s) |
[production] |
| 05:27 |
<marostegui> |
Deploy alter table on enwiki - labsdb1010 - T166204 |
[production] |
| 05:17 |
<marostegui> |
Stop replication on labsdb1011 for maintenance - T153743 |
[production] |
| 03:09 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Aug 3 03:09:22 UTC 2017 (duration 7m 18s) |
[production] |
| 03:02 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.12) (duration: 05m 47s) |
[production] |
| 02:33 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.11) (duration: 07m 53s) |
[production] |
| 01:40 |
<twentyafterfour> |
repositories synced for phabricator migration. |
[production] |
| 00:28 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: Simply ores (duration: 00m 47s) |
[production] |
| 00:26 |
<twentyafterfour> |
scheduled downtime for phabricator migration |
[production] |
| 00:12 |
<mutante> |
phab1001 starting ferm service |
[production] |
| 00:11 |
<mutante> |
iridium restarted ferm - rsync fragment was in config but not applied, breaking data rsync to phab1001 |
[production] |
| 00:05 |
<mutante> |
rsyncing /srv/repos from iridium to phab1001 (T163938) |
[production] |
|
2017-08-02
§
|
| 23:53 |
<ebernhardson@tin> |
Finished scap: dblists/rtl.dblist T172305: Adding RTL database list for project with default RTL languages (duration: 36m 21s) |
[production] |
| 23:17 |
<ebernhardson@tin> |
Started scap: dblists/rtl.dblist T172305: Adding RTL database list for project with default RTL languages |
[production] |
| 21:48 |
<ejegg> |
updated SmashPig from f4ca53ca303a7c9cbc4f0fd15d62116f0689b81d to c501f53aa0394a8f99f4b9fd87b3c8b8294511e0 |
[production] |
| 20:24 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@3b61ced]: Update mobileapps to 2d8e8f6 (T170325) (duration: 05m 38s) |
[production] |
| 20:19 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@3b61ced]: Update mobileapps to 2d8e8f6 (T170325) |
[production] |
| 19:50 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.11 refs T168053 - rollback due to T172320 |
[production] |
| 19:24 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.12 refs refs T168053 |
[production] |
| 19:23 |
<twentyafterfour> |
group1 wikis to 1.30.0-wmf.12 refs T168053 |
[production] |
| 18:41 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.12/includes/specials/SpecialRecentchanges.php: SWAT: [[gerrit:369574|Follow-up 31be7d0: send tags list if experimental mode is disabled]] (duration: 00m 47s) |
[production] |
| 18:21 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: beta-only change [[gerrit:369701|Enable HTML5 sections in betalabs]] (duration: 00m 46s) |
[production] |
| 18:20 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic10(24|25|26|27).eqiad.wmnet |
[production] |
| 18:18 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.12/includes/specials/SpecialUndelete.php: SWAT: [[gerrit:369696|Fix Special:Undelete search - use variable and not request param]] (duration: 00m 46s) |
[production] |
| 18:18 |
<gehel> |
un-banning and repooling elastic102[4567] - T168816 |
[production] |
| 18:13 |
<thcipriani@tin> |
Synchronized wmf-config/jobqueue.php: SWAT: [[gerrit:368258|JobQueueEventBus: Enable job events in group0 wikis]] T163380 Part II (duration: 00m 47s) |
[production] |
| 18:11 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:368258|JobQueueEventBus: Enable job events in group0 wikis]] T163380 Part I (duration: 00m 47s) |
[production] |
| 17:56 |
<ottomata> |
restart kafka1012 broker with listeners=PLAINTEXT://:9092 to verify https://gerrit.wikimedia.org/r/#/c/356232/ before merge. This should be a functional no-op |
[production] |