951-1000 of 10000 results (71ms)
2022-06-14 ยง
20:37 <urbanecm@deploy1002> Synchronized w/: phpcs cleanups (T171115; no-op for production) (duration: 03m 15s) [production]
20:36 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:34 <urbanecm@deploy1002> Synchronized multiversion/: phpcs cleanups (T171115; no-op for production) (duration: 03m 28s) [production]
20:33 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:33 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:33 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1016.eqiad.wmnet with OS buster [production]
20:32 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS buster [production]
20:31 <urbanecm@deploy1002> Synchronized wmf-config/: phpcs cleanups (T171115; no-op for production) (duration: 03m 38s) [production]
20:29 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:06 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1021.eqiad.wmnet with OS buster [production]
20:06 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1020.eqiad.wmnet with OS buster [production]
20:04 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1018.eqiad.wmnet with OS buster [production]
20:01 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1017.eqiad.wmnet with OS buster [production]
19:52 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1016.eqiad.wmnet with OS buster [production]
19:40 <jhathaway@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mirror1001.wikimedia.org with reason: New Kernel [production]
19:40 <jhathaway@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on mirror1001.wikimedia.org with reason: New Kernel [production]
19:36 <jhathaway@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx1001.wikimedia.org with reason: New Kernel [production]
19:36 <jhathaway@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on mx1001.wikimedia.org with reason: New Kernel [production]
19:32 <jhathaway@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx2001.wikimedia.org with reason: New Kernel [production]
19:32 <jhathaway@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on mx2001.wikimedia.org with reason: New Kernel [production]
19:16 <aokoth@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1054.eqiad.wmnet [production]
19:10 <aokoth@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc1054.eqiad.wmnet [production]
18:53 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host aqs1021.eqiad.wmnet with OS buster [production]
18:52 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host aqs1020.eqiad.wmnet with OS buster [production]
18:52 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs1019.eqiad.wmnet with OS buster [production]
18:52 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host aqs1019.eqiad.wmnet with OS buster [production]
18:51 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host aqs1018.eqiad.wmnet with OS buster [production]
18:47 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host aqs1017.eqiad.wmnet with OS buster [production]
18:39 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS buster [production]
18:30 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host backup1009.eqiad.wmnet with OS bullseye [production]
18:30 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host backup1009.eqiad.wmnet with OS bullseye [production]
18:27 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
18:21 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
18:21 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
18:15 <ayounsi@cumin1001> conftool action : set/pooled=false; selector: dnsdisc=imagescaler-ro,name=codfw [production]
18:14 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
18:09 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
18:03 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
18:03 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
18:00 <aokoth@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1053.eqiad.wmnet [production]
17:57 <brennen@deploy1002> Pruned MediaWiki: 1.39.0-wmf.14 (duration: 01m 53s) [production]
17:56 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
17:55 <brennen@deploy1002> Finished scap: testwikis wikis to 1.39.0-wmf.16 (duration: 32m 52s) [production]
17:31 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
17:30 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
17:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
17:29 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
17:25 <aokoth@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc1053.eqiad.wmnet [production]
17:24 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
17:23 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]