851-900 of 10000 results (43ms)
2025-01-22 ยง
22:06 <dmartin@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
22:03 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1139.eqiad.wmnet with OS bookworm [production]
21:59 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1138.eqiad.wmnet with OS bookworm [production]
21:55 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1137.eqiad.wmnet with OS bookworm [production]
21:52 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1140.eqiad.wmnet with OS bookworm [production]
21:49 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1135.eqiad.wmnet with OS bookworm [production]
21:45 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1141.eqiad.wmnet with OS bookworm [production]
21:44 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1139.eqiad.wmnet with reason: host reimage [production]
21:42 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1136.eqiad.wmnet with OS bookworm [production]
21:40 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1138.eqiad.wmnet with reason: host reimage [production]
21:37 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1137.eqiad.wmnet with reason: host reimage [production]
21:36 <dzahn@dns1004> END - running authdns-update [production]
21:34 <cjming> end of UTC late backport window [production]
21:34 <dzahn@dns1004> START - running authdns-update [production]
21:34 <cjming@deploy2002> Finished scap sync-world: Backport for [[gerrit:1113512|Add a few more contextual attributes to web base (T373715)]] (duration: 11m 41s) [production]
21:33 <cmooney@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on netflow7001.magru.wmnet with reason: disabling alerts as I'm running gnmic manually rather than with systemd [production]
21:33 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1140.eqiad.wmnet with reason: host reimage [production]
21:29 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1135.eqiad.wmnet with reason: host reimage [production]
21:27 <cjming@deploy2002> cjming: Continuing with sync [production]
21:27 <cjming@deploy2002> cjming: Backport for [[gerrit:1113512|Add a few more contextual attributes to web base (T373715)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:26 <andrew@cumin1002> START - Cookbook sre.hosts.reimage for host cloudcephosd1012.eqiad.wmnet with OS bullseye [production]
21:26 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1141.eqiad.wmnet with reason: host reimage [production]
21:22 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1136.eqiad.wmnet with reason: host reimage [production]
21:22 <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1113512|Add a few more contextual attributes to web base (T373715)]] [production]
21:20 <cjming@deploy2002> Finished scap sync-world: Backport for [[gerrit:1113511|Enable ExLab test 1 experiment to wikitech (T373715)]] (duration: 13m 22s) [production]
21:20 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1135.eqiad.wmnet with reason: host reimage [production]
21:20 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1141.eqiad.wmnet with reason: host reimage [production]
21:20 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1139.eqiad.wmnet with reason: host reimage [production]
21:19 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1140.eqiad.wmnet with reason: host reimage [production]
21:19 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1138.eqiad.wmnet with reason: host reimage [production]
21:19 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1137.eqiad.wmnet with reason: host reimage [production]
21:19 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1136.eqiad.wmnet with reason: host reimage [production]
21:14 <cjming@deploy2002> cjming: Continuing with sync [production]
21:13 <cjming@deploy2002> cjming: Backport for [[gerrit:1113511|Enable ExLab test 1 experiment to wikitech (T373715)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:12 <andrew@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcephosd1012.eqiad.wmnet with OS bullseye [production]
21:07 <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1113511|Enable ExLab test 1 experiment to wikitech (T373715)]] [production]
21:04 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1135 [production]
21:04 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1135 [production]
21:04 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1135.eqiad.wmnet with OS bookworm [production]
21:04 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1141 [production]
21:04 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1141 [production]
21:04 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1141.eqiad.wmnet with OS bookworm [production]
21:04 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1139 [production]
21:04 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1139 [production]
21:04 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1139.eqiad.wmnet with OS bookworm [production]
21:04 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1140 [production]
21:03 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1140 [production]
21:03 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1140.eqiad.wmnet with OS bookworm [production]
21:03 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1138 [production]
21:03 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1138 [production]