301-350 of 10000 results (40ms)
2021-02-08 ยง
21:28 <legoktm@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on mw1271.eqiad.wmnet with reason: reimaging [production]
21:28 <legoktm@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1274.eqiad.wmnet with reason: REIMAGE [production]
21:26 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1388.eqiad.wmnet with reason: REIMAGE [production]
21:25 <legoktm@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1272.eqiad.wmnet with reason: REIMAGE [production]
21:25 <legoktm@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1274.eqiad.wmnet with reason: REIMAGE [production]
21:24 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1304.eqiad.wmnet [production]
21:24 <legoktm@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1271.eqiad.wmnet with reason: REIMAGE [production]
21:24 <legoktm@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1273.eqiad.wmnet with reason: REIMAGE [production]
21:24 <legoktm@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1271.eqiad.wmnet with reason: REIMAGE [production]
21:24 <legoktm@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1273.eqiad.wmnet with reason: REIMAGE [production]
21:23 <legoktm@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1272.eqiad.wmnet with reason: REIMAGE [production]
21:20 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1305.eqiad.wmnet [production]
21:18 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1304.eqiad.wmnet [production]
21:18 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1305.eqiad.wmnet [production]
21:10 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1389.eqiad.wmnet [production]
21:09 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1389.eqiad.wmnet [production]
21:08 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1390.eqiad.wmnet [production]
21:07 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1390.eqiad.wmnet [production]
20:31 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1304.eqiad.wmnet with reason: REIMAGE [production]
20:28 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1304.eqiad.wmnet with reason: REIMAGE [production]
20:25 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1305.eqiad.wmnet with reason: REIMAGE [production]
20:23 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1305.eqiad.wmnet with reason: REIMAGE [production]
20:20 <jgiannelos@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'push-notifications' for release 'main' . [production]
20:19 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1389.eqiad.wmnet with reason: REIMAGE [production]
20:17 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Undo migration of SpecialMuteSubmit on all wikis except testwiki - T268517 (duration: 01m 06s) [production]
20:17 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1389.eqiad.wmnet with reason: REIMAGE [production]
20:16 <jgiannelos@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'push-notifications' for release 'main' . [production]
20:14 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1390.eqiad.wmnet with reason: REIMAGE [production]
20:12 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1390.eqiad.wmnet with reason: REIMAGE [production]
20:11 <jgiannelos@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'push-notifications' for release 'main' . [production]
19:59 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1391.eqiad.wmnet [production]
19:55 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp2003.codfw.wmnet [production]
19:50 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp2003.codfw.wmnet [production]
19:50 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp2002.codfw.wmnet [production]
19:49 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1391.eqiad.wmnet [production]
19:48 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@ca9bba1]: cirrus_namespace_map: only overwrite on success (duration: 01m 19s) [production]
19:46 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@ca9bba1]: cirrus_namespace_map: only overwrite on success [production]
19:44 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp2002.codfw.wmnet [production]
19:44 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp2001.codfw.wmnet [production]
19:38 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp2001.codfw.wmnet [production]
19:20 <urbanecm@deploy1001> Synchronized wmf-config/config/dawiki.yaml: 3f39eefaa4c0dabfbc5b03fdc1b12e48913089bd: Enable GrowthExperiments at dawiki (T256126; 3/3) (duration: 01m 04s) [production]
19:18 <urbanecm@deploy1001> Synchronized dblists/growthexperiments.dblist: 3f39eefaa4c0dabfbc5b03fdc1b12e48913089bd: Enable GrowthExperiments at dawiki (T256126; 2/3) (duration: 01m 03s) [production]
19:17 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 3f39eefaa4c0dabfbc5b03fdc1b12e48913089bd: Enable GrowthExperiments at dawiki (T256126) (duration: 01m 05s) [production]
19:13 <dduvall@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
19:11 <dduvall@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
19:11 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1391.eqiad.wmnet with reason: REIMAGE [production]
19:09 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1391.eqiad.wmnet with reason: REIMAGE [production]
19:08 <dduvall@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . [production]
19:07 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 3e94e2177b7f31bea1c6bc21b272a4529a38b4b3: Make DiscussionTools newtopictool available on testwiki (duration: 01m 07s) [production]
18:52 <mutante> mw1391 - reimaging [production]