2301-2350 of 10000 results (87ms)
2024-01-03 ยง
19:36 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1380.eqiad.wmnet with reason: host reimage [production]
19:36 <kamila@cumin1002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2440.codfw.wmnet with reason: host reimage [production]
19:36 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2436.codfw.wmnet with reason: host reimage [production]
19:35 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1383.eqiad.wmnet with OS bullseye [production]
19:35 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2440.codfw.wmnet with reason: host reimage [production]
19:35 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1379.eqiad.wmnet with reason: host reimage [production]
19:35 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1382.eqiad.wmnet with OS bullseye [production]
19:34 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1381.eqiad.wmnet with OS bullseye [production]
19:33 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2451.codfw.wmnet with OS bullseye [production]
19:33 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2437.codfw.wmnet with reason: host reimage [production]
19:33 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2450.codfw.wmnet with OS bullseye [production]
19:32 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2443.codfw.wmnet with OS bullseye [production]
19:31 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1378.eqiad.wmnet with reason: host reimage [production]
19:28 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2437.codfw.wmnet with reason: host reimage [production]
19:28 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1377.eqiad.wmnet with reason: host reimage [production]
19:26 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2436.codfw.wmnet with reason: host reimage [production]
19:26 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1378.eqiad.wmnet with reason: host reimage [production]
19:25 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1377.eqiad.wmnet with reason: host reimage [production]
19:22 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1380.eqiad.wmnet with OS bullseye [production]
19:21 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1379.eqiad.wmnet with OS bullseye [production]
19:19 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2442.codfw.wmnet with OS bullseye [production]
19:18 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2440.codfw.wmnet with OS bullseye [production]
19:11 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1378.eqiad.wmnet with OS bullseye [production]
19:11 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1377.eqiad.wmnet with OS bullseye [production]
19:10 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2437.codfw.wmnet with OS bullseye [production]
19:08 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2436.codfw.wmnet with OS bullseye [production]
18:27 <brennen@deploy2002> Finished deploy [phabricator/deployment@369e797]: deploy to phab2002 for T334519 (duration: 00m 27s) [production]
18:27 <brennen@deploy2002> Started deploy [phabricator/deployment@369e797]: deploy to phab2002 for T334519 [production]
18:27 <brennen> running an essentially no-op phab2002 deploy [production]
18:11 <dduvall@deploy2002> Finished scap: testwikis wikis to 1.42.0-wmf.12 refs T350088 (duration: 07m 23s) [production]
18:03 <dduvall@deploy2002> Started scap: testwikis wikis to 1.42.0-wmf.12 refs T350088 [production]
17:06 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-text_ulsfo and not P{cp4044.ulsfo.wmnet} and A:cp [production]
16:45 <vgutierrez@cumin1002> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-text_ulsfo and not P{cp4044.ulsfo.wmnet} and A:cp [production]
16:33 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-upload_ulsfo and not P{cp4050.ulsfo.wmnet,cp4051.ulsfo.wmnet} and A:cp [production]
16:27 <stevemunene@deploy2002> helmfile [eqiad] DONE helmfile.d/services/editor-analytics: apply [production]
16:27 <stevemunene@deploy2002> helmfile [eqiad] START helmfile.d/services/editor-analytics: apply [production]
16:27 <stevemunene@deploy2002> helmfile [codfw] DONE helmfile.d/services/editor-analytics: apply [production]
16:26 <stevemunene@deploy2002> helmfile [codfw] START helmfile.d/services/editor-analytics: apply [production]
16:26 <stevemunene@deploy2002> helmfile [staging] DONE helmfile.d/services/editor-analytics: apply [production]
16:26 <stevemunene@deploy2002> helmfile [staging] START helmfile.d/services/editor-analytics: apply [production]
16:25 <stevemunene@deploy2002> helmfile [eqiad] DONE helmfile.d/services/edit-analytics: apply [production]
16:25 <stevemunene@deploy2002> helmfile [eqiad] START helmfile.d/services/edit-analytics: apply [production]
16:24 <stevemunene@deploy2002> helmfile [codfw] DONE helmfile.d/services/edit-analytics: apply [production]
16:24 <stevemunene@deploy2002> helmfile [codfw] START helmfile.d/services/edit-analytics: apply [production]
16:23 <stevemunene@deploy2002> helmfile [staging] DONE helmfile.d/services/edit-analytics: apply [production]
16:22 <stevemunene@deploy2002> helmfile [staging] START helmfile.d/services/edit-analytics: apply [production]
16:16 <vgutierrez@cumin1002> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-upload_ulsfo and not P{cp4050.ulsfo.wmnet,cp4051.ulsfo.wmnet} and A:cp [production]
16:11 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on P{cp3066.esams.wmnet} and A:cp [production]
16:10 <vgutierrez@cumin1002> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on P{cp3066.esams.wmnet} and A:cp [production]
15:39 <moritzm> rebuild md RAIDs after disk swap T353324 [production]