651-700 of 10000 results (56ms)
2020-02-19 ยง
23:09 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
23:09 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:57 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@c16c63a]: articletopic thresholding for ores scores and eventgate port update (duration: 00m 57s) [production]
22:56 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@c16c63a]: articletopic thresholding for ores scores and eventgate port update [production]
22:54 <robh> cp3050 & cp3051 returned to service via T243167 [production]
22:49 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:49 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:42 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set wgServer to protocol-relative for Wikitech and Test Wikitech (duration: 01m 05s) [production]
22:37 <robh> taking cp3050 & cp3051 offline for firmware update via T243167 [production]
22:23 <mutante> phabricator - upgrading PHP packages [production]
22:14 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw231([0-6]).codfw.wmnet [production]
22:12 <dzahn@cumin1001> conftool action : set/weight=15; selector: name=mw231([0-6]).codfw.wmnet [production]
22:11 <rzl@cumin1001> conftool action : set/pooled=yes; selector: name=mw13(6[4-9]|7[0-3]|84).eqiad.wmnet [production]
22:10 <rzl@cumin1001> conftool action : set/weight=30; selector: name=mw13(6[4-9]|7[0-3]|84).eqiad.wmnet [production]
22:08 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw2314.codfw.wmnet [production]
21:58 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:58 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:54 <rzl@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:52 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:48 <bblack> all authdns servers - upgrade to gdnsd-3.2.2 [production]
21:39 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:39 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:36 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:36 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:35 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:35 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:35 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:35 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:32 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:32 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:31 <rzl@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:29 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:23 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:23 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:55 <eileen> civicrm revision changed from 52c68911c6 to a6b222c19f, config revision is 561ae21f77 [production]
20:15 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.20/extensions/Wikibase/lib: Fix stastd metric for StatsdMissRecordingSimpleCache (wb_terms work) (duration: 01m 06s) [production]
20:13 <rzl@cumin1001> conftool action : set/weight=30; selector: name=mw13(5[6-9]|6[0-2]).eqiad.wmnet [production]
20:12 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.19/extensions/Wikibase/lib: Fix stastd metric for StatsdMissRecordingSimpleCache (wb_terms work) (duration: 01m 06s) [production]
20:10 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.19/extensions/Wikibase/lib: Fix stastd metric for StatsdMissRecordingSimpleCache (wb_terms work) (duration: 01m 05s) [production]
20:05 <jforrester@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.20 (duration: 01m 03s) [production]
20:04 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.20 [production]
20:02 <rzl@cumin1001> conftool action : set/pooled=yes; selector: name=mw13(5[6-9]|6[0-2]).eqiad.wmnet [production]
20:02 <rzl@cumin1001> conftool action : set/weight=10; selector: name=mw13(5[6-9]|6[0-2]).eqiad.wmnet [production]
19:54 <rlazarus> scap pull on new api servers mw13[56-62] [production]
19:50 <mutante> generating mcrouter certs for new codfw mw appservers [production]
19:39 <mutante> initial puppet run on new hosts mw231* [production]
19:31 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.19/skins/MinervaNeue/includes/MinervaHooks.php: T245162 Check title value before proceeding to check if user page (duration: 01m 04s) [production]
19:27 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.20/skins/MinervaNeue/includes/MinervaHooks.php: T245162 Check title value before proceeding to check if user page (duration: 01m 04s) [production]
19:21 <jforrester@deploy1001> Synchronized dblists/mobilemainpagelegacy.dblist: T244577 [metawiki] Disable MobileFrontend mainpage special casing (duration: 01m 04s) [production]
19:18 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T244369 [trwiki] Enable the WikidataPageBanner extension (duration: 01m 05s) [production]