2051-2100 of 10000 results (95ms)
2024-03-04 ยง
12:13 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 6 hosts [production]
12:13 <cgoubert@cumin2002> START - Cookbook sre.hosts.remove-downtime for 6 hosts [production]
12:13 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2321.codfw.wmnet with OS bullseye [production]
12:11 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2315.codfw.wmnet with OS bullseye [production]
12:08 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2314.codfw.wmnet with OS bullseye [production]
12:05 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2322.codfw.wmnet with OS bullseye [production]
12:03 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2316.codfw.wmnet with OS bullseye [production]
12:01 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2320.codfw.wmnet with OS bullseye [production]
11:50 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2315.codfw.wmnet with reason: host reimage [production]
11:49 <btullis@cumin1002> END (PASS) - Cookbook sre.kafka.roll-restart-mirror-maker (exit_code=0) restart MirrorMaker for Kafka A:kafka-mirror-maker-test-eqiad cluster: Roll restart of jvm daemons. [production]
11:48 <claime> Disregard previous puppet disable message, waiting a bit T354855 [production]
11:47 <claime> Disabling puppet on C:profile::firewall::log::ferm to deploy 1005978 - T354855 [production]
11:47 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2321.codfw.wmnet with reason: host reimage [production]
11:44 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2314.codfw.wmnet with reason: host reimage [production]
11:43 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudnet2007-dev.codfw.wmnet with OS bookworm [production]
11:42 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudnet2008-dev.codfw.wmnet with OS bookworm [production]
11:42 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2322.codfw.wmnet with reason: host reimage [production]
11:41 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply [production]
11:40 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply [production]
11:40 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
11:40 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
11:40 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply [production]
11:39 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox-media: apply [production]
11:39 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply [production]
11:39 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2316.codfw.wmnet with reason: host reimage [production]
11:39 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply [production]
11:39 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox: apply [production]
11:39 <btullis@cumin1002> START - Cookbook sre.kafka.roll-restart-mirror-maker restart MirrorMaker for Kafka A:kafka-mirror-maker-test-eqiad cluster: Roll restart of jvm daemons. [production]
11:38 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox: apply [production]
11:37 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2320.codfw.wmnet with reason: host reimage [production]
11:35 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply [production]
11:35 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2314.codfw.wmnet with reason: host reimage [production]
11:35 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2316.codfw.wmnet with reason: host reimage [production]
11:35 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2315.codfw.wmnet with reason: host reimage [production]
11:34 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2321.codfw.wmnet with reason: host reimage [production]
11:34 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2322.codfw.wmnet with reason: host reimage [production]
11:34 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply [production]
11:34 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2320.codfw.wmnet with reason: host reimage [production]
11:34 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
11:33 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
11:33 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply [production]
11:33 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-media: apply [production]
11:33 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
11:32 <Dreamy_Jazz> Re-starting MediaModeration scanning script - https://wikitech.wikimedia.org/wiki/MediaModeration [production]
11:31 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
11:30 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
11:30 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
11:25 <taavi@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) 'private.codfw.wikimedia.cloud$' on all recursors [production]
11:25 <taavi@cumin1002> START - Cookbook sre.dns.wipe-cache 'private.codfw.wikimedia.cloud$' on all recursors [production]
11:25 <kamila@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply [production]