|
2022-06-14
ยง
|
| 20:33 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1016.eqiad.wmnet with OS buster |
[production] |
| 20:32 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS buster |
[production] |
| 20:31 |
<urbanecm@deploy1002> |
Synchronized wmf-config/: phpcs cleanups (T171115; no-op for production) (duration: 03m 38s) |
[production] |
| 20:29 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:06 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1021.eqiad.wmnet with OS buster |
[production] |
| 20:06 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1020.eqiad.wmnet with OS buster |
[production] |
| 20:04 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1018.eqiad.wmnet with OS buster |
[production] |
| 20:01 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1017.eqiad.wmnet with OS buster |
[production] |
| 19:52 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1016.eqiad.wmnet with OS buster |
[production] |
| 19:40 |
<jhathaway@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mirror1001.wikimedia.org with reason: New Kernel |
[production] |
| 19:40 |
<jhathaway@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on mirror1001.wikimedia.org with reason: New Kernel |
[production] |
| 19:36 |
<jhathaway@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx1001.wikimedia.org with reason: New Kernel |
[production] |
| 19:36 |
<jhathaway@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on mx1001.wikimedia.org with reason: New Kernel |
[production] |
| 19:32 |
<jhathaway@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx2001.wikimedia.org with reason: New Kernel |
[production] |
| 19:32 |
<jhathaway@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on mx2001.wikimedia.org with reason: New Kernel |
[production] |
| 19:16 |
<aokoth@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1054.eqiad.wmnet |
[production] |
| 19:10 |
<aokoth@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host mc1054.eqiad.wmnet |
[production] |
| 18:53 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host aqs1021.eqiad.wmnet with OS buster |
[production] |
| 18:52 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host aqs1020.eqiad.wmnet with OS buster |
[production] |
| 18:52 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1019.eqiad.wmnet with OS buster |
[production] |
| 18:52 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host aqs1019.eqiad.wmnet with OS buster |
[production] |
| 18:51 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host aqs1018.eqiad.wmnet with OS buster |
[production] |
| 18:47 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host aqs1017.eqiad.wmnet with OS buster |
[production] |
| 18:39 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS buster |
[production] |
| 18:30 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host backup1009.eqiad.wmnet with OS bullseye |
[production] |
| 18:30 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host backup1009.eqiad.wmnet with OS bullseye |
[production] |
| 18:27 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:21 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:21 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:15 |
<ayounsi@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=imagescaler-ro,name=codfw |
[production] |
| 18:14 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:09 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:03 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:03 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:00 |
<aokoth@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1053.eqiad.wmnet |
[production] |
| 17:57 |
<brennen@deploy1002> |
Pruned MediaWiki: 1.39.0-wmf.14 (duration: 01m 53s) |
[production] |
| 17:56 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 17:55 |
<brennen@deploy1002> |
Finished scap: testwikis wikis to 1.39.0-wmf.16 (duration: 32m 52s) |
[production] |
| 17:31 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 17:30 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 17:30 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 17:29 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 17:25 |
<aokoth@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host mc1053.eqiad.wmnet |
[production] |
| 17:24 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 17:23 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 17:23 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 17:22 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 17:22 |
<brennen@deploy1002> |
Started scap: testwikis wikis to 1.39.0-wmf.16 |
[production] |
| 17:12 |
<brennen> |
train 1.39.0-wmf.16 (T308069): train is blocked - will sync to testwikis and hold there for resolution of T310532 |
[production] |
| 16:23 |
<bking@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host elastic2053.codfw.wmnet with OS bullseye |
[production] |