801-850 of 10000 results (22ms)
2025-11-12 ยง
17:30 <sukhe@cumin1003> START - Cookbook sre.dns.netbox [production]
17:30 <sukhe@cumin1003> START - Cookbook sre.ganeti.makevm for new host hcaptcha-proxy5001.wikimedia.org [production]
17:29 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on sessionstore1006.eqiad.wmnet with reason: C/D Migration [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) hcaptcha-proxy4001.wikimedia.org on all recursors [production]
17:29 <sukhe@cumin1003> START - Cookbook sre.dns.wipe-cache hcaptcha-proxy4001.wikimedia.org on all recursors [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM hcaptcha-proxy4001.wikimedia.org - sukhe@cumin1003" [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host hcaptcha-proxy2001.wikimedia.org [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy2001.wikimedia.org with OS trixie [production]
17:27 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1225.eqiad.wmnet with reason: C/D Migration [production]
17:27 <sukhe@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM hcaptcha-proxy4001.wikimedia.org - sukhe@cumin1003" [production]
17:26 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1224.eqiad.wmnet with reason: C/D Migration [production]
17:26 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-cron: apply [production]
17:25 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/mw-cron: apply [production]
17:25 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on dbproxy1025.eqiad.wmnet with reason: C/D Migration [production]
17:24 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1174.eqiad.wmnet with reason: C/D Migration [production]
17:22 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on aqs1022.eqiad.wmnet with reason: C/D Migration [production]
17:22 <sukhe@cumin1003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host hcaptcha-proxy1002.wikimedia.org [production]
17:22 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy1002.wikimedia.org with OS trixie [production]
17:21 <sukhe@cumin1003> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host hcaptcha-proxy4002.wikimedia.org [production]
17:21 <sukhe@cumin1003> START - Cookbook sre.ganeti.makevm for new host hcaptcha-proxy4002.wikimedia.org [production]
17:21 <sukhe@cumin1003> START - Cookbook sre.dns.netbox [production]
17:21 <sukhe@cumin1003> START - Cookbook sre.ganeti.makevm for new host hcaptcha-proxy4001.wikimedia.org [production]
17:20 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on aqs1022.eqiad.wmnet with reason: C/D Migration [production]
17:19 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1258.eqiad.wmnet with reason: C/D Migration [production]
17:18 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on restbase1045.eqiad.wmnet with reason: C/D Migration [production]
17:18 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy2002.wikimedia.org with reason: host reimage [production]
17:17 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1259.eqiad.wmnet with reason: C/D Migration [production]
17:15 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on es1053.eqiad.wmnet with reason: C/D Migration [production]
17:13 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy2002.wikimedia.org with reason: host reimage [production]
17:12 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1233.eqiad.wmnet with reason: C/D Migration [production]
17:11 <sukhe@cumin1003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host hcaptcha-proxy1001.wikimedia.org [production]
17:11 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy1001.wikimedia.org with OS trixie [production]
17:11 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy2001.wikimedia.org with reason: host reimage [production]
17:10 <robh> eqiad c/d migration work in D6 [production]
17:10 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on es1046.eqiad.wmnet with reason: C/D Migration [production]
17:08 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy1002.wikimedia.org with reason: host reimage [production]
17:04 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on ganeti1033.eqiad.wmnet with reason: C/D Migration [production]
17:03 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy2001.wikimedia.org with reason: host reimage [production]
17:02 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy1002.wikimedia.org with reason: host reimage [production]
17:02 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on ganeti1024.eqiad.wmnet with reason: C/D Migration [production]
16:58 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy1001.wikimedia.org with reason: host reimage [production]
16:57 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1202164|Enable the MEX / wbui2025 beta feature on testwikidata (v2) (T407737)]] (duration: 12m 40s) [production]
16:55 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy2002.wikimedia.org with OS trixie [production]
16:55 <sukhe@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM hcaptcha-proxy2002.wikimedia.org - sukhe@cumin1003" [production]
16:55 <sukhe@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM hcaptcha-proxy2002.wikimedia.org - sukhe@cumin1003" [production]
16:54 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) hcaptcha-proxy2002.wikimedia.org on all recursors [production]
16:54 <sukhe@cumin1003> START - Cookbook sre.dns.wipe-cache hcaptcha-proxy2002.wikimedia.org on all recursors [production]
16:54 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:54 <sukhe@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM hcaptcha-proxy2002.wikimedia.org - sukhe@cumin1003" [production]