551-600 of 10000 results (117ms)
2025-11-12 ยง
17:47 <sukhe@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM hcaptcha-proxy4001.wikimedia.org - sukhe@cumin1003" [production]
17:46 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1232.eqiad.wmnet with reason: C/D Migration [production]
17:44 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1175.eqiad.wmnet with reason: C/D Migration [production]
17:43 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on es1052.eqiad.wmnet with reason: C/D Migration [production]
17:41 <sukhe@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM hcaptcha-proxy5001.wikimedia.org - sukhe@cumin1003" [production]
17:41 <sukhe@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM hcaptcha-proxy5001.wikimedia.org - sukhe@cumin1003" [production]
17:41 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) hcaptcha-proxy5001.wikimedia.org on all recursors [production]
17:41 <sukhe@cumin1003> START - Cookbook sre.dns.wipe-cache hcaptcha-proxy5001.wikimedia.org on all recursors [production]
17:41 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:41 <sukhe@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM hcaptcha-proxy5001.wikimedia.org - sukhe@cumin1003" [production]
17:41 <sukhe@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM hcaptcha-proxy5001.wikimedia.org - sukhe@cumin1003" [production]
17:40 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1247.eqiad.wmnet with reason: C/D Migration [production]
17:39 <robh> eqiad c/d migration d6 rack complete for today, onto d3 [production]
17:34 <sukhe@cumin1003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host hcaptcha-proxy2002.wikimedia.org [production]
17:34 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy2002.wikimedia.org with OS trixie [production]
17:30 <sukhe@cumin1003> START - Cookbook sre.dns.netbox [production]
17:30 <sukhe@cumin1003> START - Cookbook sre.ganeti.makevm for new host hcaptcha-proxy5001.wikimedia.org [production]
17:29 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on sessionstore1006.eqiad.wmnet with reason: C/D Migration [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) hcaptcha-proxy4001.wikimedia.org on all recursors [production]
17:29 <sukhe@cumin1003> START - Cookbook sre.dns.wipe-cache hcaptcha-proxy4001.wikimedia.org on all recursors [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM hcaptcha-proxy4001.wikimedia.org - sukhe@cumin1003" [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host hcaptcha-proxy2001.wikimedia.org [production]
17:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy2001.wikimedia.org with OS trixie [production]
17:27 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1225.eqiad.wmnet with reason: C/D Migration [production]
17:27 <sukhe@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM hcaptcha-proxy4001.wikimedia.org - sukhe@cumin1003" [production]
17:26 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1224.eqiad.wmnet with reason: C/D Migration [production]
17:26 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-cron: apply [production]
17:25 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/mw-cron: apply [production]
17:25 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on dbproxy1025.eqiad.wmnet with reason: C/D Migration [production]
17:24 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1174.eqiad.wmnet with reason: C/D Migration [production]
17:22 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on aqs1022.eqiad.wmnet with reason: C/D Migration [production]
17:22 <sukhe@cumin1003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host hcaptcha-proxy1002.wikimedia.org [production]
17:22 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy1002.wikimedia.org with OS trixie [production]
17:21 <sukhe@cumin1003> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host hcaptcha-proxy4002.wikimedia.org [production]
17:21 <sukhe@cumin1003> START - Cookbook sre.ganeti.makevm for new host hcaptcha-proxy4002.wikimedia.org [production]
17:21 <sukhe@cumin1003> START - Cookbook sre.dns.netbox [production]
17:21 <sukhe@cumin1003> START - Cookbook sre.ganeti.makevm for new host hcaptcha-proxy4001.wikimedia.org [production]
17:20 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on aqs1022.eqiad.wmnet with reason: C/D Migration [production]
17:19 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1258.eqiad.wmnet with reason: C/D Migration [production]
17:18 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on restbase1045.eqiad.wmnet with reason: C/D Migration [production]
17:18 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy2002.wikimedia.org with reason: host reimage [production]
17:17 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1259.eqiad.wmnet with reason: C/D Migration [production]
17:15 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on es1053.eqiad.wmnet with reason: C/D Migration [production]
17:13 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy2002.wikimedia.org with reason: host reimage [production]
17:12 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on db1233.eqiad.wmnet with reason: C/D Migration [production]
17:11 <sukhe@cumin1003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host hcaptcha-proxy1001.wikimedia.org [production]
17:11 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy1001.wikimedia.org with OS trixie [production]
17:11 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy2001.wikimedia.org with reason: host reimage [production]
17:10 <robh> eqiad c/d migration work in D6 [production]