1551-1600 of 10000 results (66ms)
2020-02-19 §
09:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2089:3315, db2089:3316 for new package testing', diff saved to https://phabricator.wikimedia.org/P10455 and previous config saved to /var/cache/conftool/dbconfig/20200219-095139-marostegui.json [production]
09:51 <marostegui> Depool db2089:3315, db2089:3316 for new package testing [production]
09:49 <akosiaris> T245516. Deploy mathoid chart version 0.0.27, removing logstash gelf configuration [production]
09:46 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'mathoid' for release 'production' . [production]
09:43 <vgutierrez> test trafficserver 8.0.6-rc1 in cp40[26,32] [production]
09:34 <_joe_> cleared opcache on mw1313 [production]
09:34 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'mathoid' for release 'canary' . [production]
09:34 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'mathoid' for release 'production' . [production]
09:33 <akosiaris@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'mathoid' for release 'staging' . [production]
08:54 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
08:53 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:50 <marostegui> Remove dbproxy1007 grants from m2 - T231280 [production]
08:41 <marostegui> Remove wikiadmin2 user from s7 - T243512 [production]
08:23 <Urbanecm> run mwscript deleteEqualMessages.php cswiki --delete [production]
08:14 <godog> roll restart swift proxies - T244776 [production]
07:02 <marostegui> Remove wikiadmin2 user from es2 - T243512 [production]
06:57 <marostegui@cumin1001> dbctl commit (dc=all): 'Increase API weight for db1107 50 -> 100 for 10.4 testing - T242702', diff saved to https://phabricator.wikimedia.org/P10454 and previous config saved to /var/cache/conftool/dbconfig/20200219-065726-marostegui.json [production]
06:35 <marostegui> Compress watchlist_expiry table on s3 (this will take hours as I have left a 60 seconds sleep between tables) - T245358 [production]
06:17 <marostegui> Compress new and empty watchlist_expiry table - T245358 [production]
01:34 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
01:32 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
01:28 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1353.eqiad.wmnet [production]
01:27 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
01:24 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
01:23 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1354.eqiad.wmnet [production]
01:22 <mutante> mw1353 - restarted apache (some race condition on new installs, 5 other servers did not have the issue) [production]
01:17 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1355.eqiad.wmnet [production]
01:16 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1350.eqiad.wmnet [production]
01:16 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1351.eqiad.wmnet [production]
01:15 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1352.eqiad.wmnet [production]
01:14 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw1355.eqiad.wmnet [production]
01:14 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw1354.eqiad.wmnet [production]
01:14 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw1350.eqiad.wmnet [production]
01:14 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw1353.eqiad.wmnet [production]
01:14 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw1351.eqiad.wmnet [production]
01:14 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw1352.eqiad.wmnet [production]
01:03 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
01:01 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T240728 Fix Latin Wikipedia (VICIPÆDIA) wordmark and set size correctly (duration: 01m 06s) [production]
01:01 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
00:49 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
00:45 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
00:43 <James_F> Manually purged https://en.wikipedia.org/images/mobile/copyright/wikipedia-wordmark-la.svg and .png from Varnish for T240728 [production]
00:41 <jforrester@deploy1001> Synchronized static/images/mobile/copyright/: T240728 Sync logo images (duration: 01m 04s) [production]
00:40 <mutante> mw1351 through mw1355 - initial puppet runs - new appservers [production]
00:36 <niharika29@deploy1001> Synchronized static/images/mobile/copyright/: Remove unnecessary id from wordmark (duration: 01m 03s) [production]
00:34 <niharika29@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Adjust MT Threshold for Assamese to 70% - T245509 (duration: 01m 04s) [production]
00:24 <niharika29@deploy1001> Synchronized php-1.35.0-wmf.19/extensions/WikimediaEvents/: Follow up on authevents statsd changes in I7612b68fe (duration: 01m 03s) [production]
00:21 <niharika29@deploy1001> Synchronized wmf-config/logging.php: Update authmanager-statsd channel name (duration: 01m 03s) [production]
00:16 <eileen> civicrm revision changed from 8c77e9e915 to 52c68911c6, config revision is 561ae21f77 [production]
00:10 <niharika29@deploy1001> Synchronized wmf-config/logging.php: Make the logstash and authmanager-statsd Monolog handlers compatible (duration: 01m 04s) [production]