6401-6450 of 10000 results (79ms)
2020-03-05 ยง
23:26 <rlazarus> mw1413 test-reimage completed successfully, pooling [production]
23:03 <rzl@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
23:01 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:50 <mutante> added 8 new appservers to pool in eqiad [production]
22:50 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw139[0-2].eqiad.wmnet [production]
22:47 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw138[5-9].eqiad.wmnet [production]
22:47 <dzahn@cumin1001> conftool action : set/weight=30; selector: name=mw138[5-9].eqiad.wmnet [production]
22:46 <dzahn@cumin1001> conftool action : set/weight=30; selector: name=mw139[0-2].eqiad.wmnet [production]
22:46 <dzahn@cumin1001> conftool action : set/weight=20; selector: name=mw139[0-2].eqiad.wmnet [production]
22:44 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw138[5-9]eqiad.wmnet [production]
22:42 <dzahn@cumin1001> conftool action : set/weight=20; selector: name=mw139[0-2]eqiad.wmnet [production]
22:41 <dzahn@cumin1001> conftool action : set/weight=20; selector: name=mw138[5-9]eqiad.wmnet [production]
22:41 <rlazarus> reimaging mw1413 (new appserver, not pooled) to test https://gerrit.wikimedia.org/r/c/576464 [production]
22:40 <mutante> [cumin1001:~] $ sudo -i cumin -b 15 'mw13[85-92].eqiad.wmnet' 'sudo -u dzahn scap pull' [production]
22:40 <rzl@cumin1001> conftool action : set/pooled=yes; selector: name=mw14(0[5-9]|1[0-2]).eqiad.wmnet [production]
22:40 <rzl@cumin1001> conftool action : set/weight=30; selector: name=mw14(0[5-9]|1[0-2]).eqiad.wmnet [production]
22:40 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:40 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:38 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 58s) [production]
22:36 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [ukwikinews] Add HD logos (duration: 00m 59s) [production]
22:35 <eileen> civicrm revision changed from 62e62e107c to 10506a9644, config revision is 734a7bfadd [production]
22:34 <jforrester@deploy1001> Synchronized static/images/project-logos/: [ukwikinews] Provide HD logos (duration: 00m 59s) [production]
22:27 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 56s) [production]
22:25 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [fawikivoyage] Add custom logos (duration: 00m 58s) [production]
22:22 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 59s) [production]
22:21 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Use HD logos at arwikibooks, cawikibooks, and plwikivoyage (duration: 00m 59s) [production]
22:17 <jforrester@deploy1001> Synchronized static/images/project-logos/: Provide HD logos for arwikibooks, cawikibooks, and plwikivoyage (duration: 01m 00s) [production]
22:14 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 59s) [production]
22:12 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Use HD logos at bnwikibooks, bnwikisource, and ukwikivoyage (duration: 00m 59s) [production]
22:10 <rzl@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:09 <jforrester@deploy1001> Synchronized static/images/project-logos/: Provide HD logos for bnwikibooks, bnwikisource, and ukwikivoyage (duration: 01m 00s) [production]
22:07 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:05 <rzl@cumin1001> END (ERROR) - Cookbook sre.hosts.downtime (exit_code=97) [production]
22:05 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:01 <jforrester@deploy1001> Synchronized multiversion/MWConfigCacheGenerator.php: Stop loading four old logo dblists (duration: 00m 59s) [production]
21:40 <rzl@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:40 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:39 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: MachineVision: Update label blacklist (once more for good measure) (duration: 00m 57s) [production]
20:37 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: MachineVision: Update label blacklist (duration: 00m 59s) [production]
20:20 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:18 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:18 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:17 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:46 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: re-sync for bug 236104 (duration: 00m 56s) [production]
19:45 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:577325|Switch GrowthExperiments topic search to ORES (T240517)]] (duration: 00m 58s) [production]
19:40 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:39 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:10 <ebernhardson@deploy1001> Synchronized wmf-config/SearchSettingsForWikibase.php: (no justification provided) (duration: 00m 57s) [production]
18:33 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . [production]
18:32 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventstreams' for release 'production' . [production]