|
2021-02-08
ยง
|
| 21:25 |
<legoktm@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1274.eqiad.wmnet with reason: REIMAGE |
[production] |
| 21:24 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1304.eqiad.wmnet |
[production] |
| 21:24 |
<legoktm@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1271.eqiad.wmnet with reason: REIMAGE |
[production] |
| 21:24 |
<legoktm@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1273.eqiad.wmnet with reason: REIMAGE |
[production] |
| 21:24 |
<legoktm@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1271.eqiad.wmnet with reason: REIMAGE |
[production] |
| 21:24 |
<legoktm@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1273.eqiad.wmnet with reason: REIMAGE |
[production] |
| 21:23 |
<legoktm@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1272.eqiad.wmnet with reason: REIMAGE |
[production] |
| 21:20 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1305.eqiad.wmnet |
[production] |
| 21:18 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1304.eqiad.wmnet |
[production] |
| 21:18 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1305.eqiad.wmnet |
[production] |
| 21:10 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1389.eqiad.wmnet |
[production] |
| 21:09 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1389.eqiad.wmnet |
[production] |
| 21:08 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1390.eqiad.wmnet |
[production] |
| 21:07 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1390.eqiad.wmnet |
[production] |
| 20:31 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1304.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:28 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1304.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:25 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1305.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:23 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1305.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:20 |
<jgiannelos@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'push-notifications' for release 'main' . |
[production] |
| 20:19 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1389.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:17 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Undo migration of SpecialMuteSubmit on all wikis except testwiki - T268517 (duration: 01m 06s) |
[production] |
| 20:17 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1389.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:16 |
<jgiannelos@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'push-notifications' for release 'main' . |
[production] |
| 20:14 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1390.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:12 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1390.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:11 |
<jgiannelos@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'push-notifications' for release 'main' . |
[production] |
| 19:59 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1391.eqiad.wmnet |
[production] |
| 19:55 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp2003.codfw.wmnet |
[production] |
| 19:50 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host mc-gp2003.codfw.wmnet |
[production] |
| 19:50 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp2002.codfw.wmnet |
[production] |
| 19:49 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1391.eqiad.wmnet |
[production] |
| 19:48 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@ca9bba1]: cirrus_namespace_map: only overwrite on success (duration: 01m 19s) |
[production] |
| 19:46 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@ca9bba1]: cirrus_namespace_map: only overwrite on success |
[production] |
| 19:44 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host mc-gp2002.codfw.wmnet |
[production] |
| 19:44 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp2001.codfw.wmnet |
[production] |
| 19:38 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host mc-gp2001.codfw.wmnet |
[production] |
| 19:20 |
<urbanecm@deploy1001> |
Synchronized wmf-config/config/dawiki.yaml: 3f39eefaa4c0dabfbc5b03fdc1b12e48913089bd: Enable GrowthExperiments at dawiki (T256126; 3/3) (duration: 01m 04s) |
[production] |
| 19:18 |
<urbanecm@deploy1001> |
Synchronized dblists/growthexperiments.dblist: 3f39eefaa4c0dabfbc5b03fdc1b12e48913089bd: Enable GrowthExperiments at dawiki (T256126; 2/3) (duration: 01m 03s) |
[production] |
| 19:17 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 3f39eefaa4c0dabfbc5b03fdc1b12e48913089bd: Enable GrowthExperiments at dawiki (T256126) (duration: 01m 05s) |
[production] |
| 19:13 |
<dduvall@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'blubberoid' for release 'production' . |
[production] |
| 19:11 |
<dduvall@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'blubberoid' for release 'production' . |
[production] |
| 19:11 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1391.eqiad.wmnet with reason: REIMAGE |
[production] |
| 19:09 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1391.eqiad.wmnet with reason: REIMAGE |
[production] |
| 19:08 |
<dduvall@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . |
[production] |
| 19:07 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 3e94e2177b7f31bea1c6bc21b272a4529a38b4b3: Make DiscussionTools newtopictool available on testwiki (duration: 01m 07s) |
[production] |
| 18:52 |
<mutante> |
mw1391 - reimaging |
[production] |
| 18:34 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2037.codfw.wmnet |
[production] |
| 18:29 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@a458845]: Add trwikivoyage T271262 and restore restbase2009 (duration: 17m 13s) |
[production] |
| 18:27 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host mc2037.codfw.wmnet |
[production] |
| 18:27 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2036.codfw.wmnet |
[production] |