1-50 of 10000 results (96ms)
2025-05-20 ยง
22:47 <dzahn@cumin1002> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host zuul1003.eqiad.wmnet [production]
22:47 <dzahn@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host zuul1003.eqiad.wmnet with OS bookworm [production]
22:32 <dzahn@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on zuul1003.eqiad.wmnet with reason: host reimage [production]
22:27 <dzahn@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on zuul1003.eqiad.wmnet with reason: host reimage [production]
22:15 <dzahn@cumin1002> START - Cookbook sre.hosts.reimage for host zuul1003.eqiad.wmnet with OS bookworm [production]
22:08 <dzahn@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM zuul1003.eqiad.wmnet - dzahn@cumin1002" [production]
22:08 <dzahn@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM zuul1003.eqiad.wmnet - dzahn@cumin1002" [production]
22:07 <dzahn@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) zuul1003.eqiad.wmnet on all recursors [production]
22:07 <dzahn@cumin1002> START - Cookbook sre.dns.wipe-cache zuul1003.eqiad.wmnet on all recursors [production]
22:07 <dzahn@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:07 <dzahn@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM zuul1003.eqiad.wmnet - dzahn@cumin1002" [production]
22:06 <bking@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cirrussearch1057.eqiad.wmnet with OS bullseye [production]
22:05 <dzahn@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM zuul1003.eqiad.wmnet - dzahn@cumin1002" [production]
22:00 <dzahn@cumin1002> START - Cookbook sre.dns.netbox [production]
22:00 <dzahn@cumin1002> START - Cookbook sre.ganeti.makevm for new host zuul1003.eqiad.wmnet [production]
21:58 <dzahn@cumin1002> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host zuul2003.codfw.wmnet [production]
21:58 <dzahn@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host zuul2003.codfw.wmnet with OS bookworm [production]
21:41 <dzahn@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on zuul2003.codfw.wmnet with reason: host reimage [production]
21:38 <dzahn@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on zuul2003.codfw.wmnet with reason: host reimage [production]
21:21 <dzahn@cumin1002> START - Cookbook sre.hosts.reimage for host zuul2003.codfw.wmnet with OS bookworm [production]
21:20 <dzahn@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM zuul2003.codfw.wmnet - dzahn@cumin1002" [production]
21:20 <dzahn@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM zuul2003.codfw.wmnet - dzahn@cumin1002" [production]
21:19 <dzahn@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) zuul2003.codfw.wmnet on all recursors [production]
21:19 <dzahn@cumin1002> START - Cookbook sre.dns.wipe-cache zuul2003.codfw.wmnet on all recursors [production]
21:19 <dzahn@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:19 <dzahn@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM zuul2003.codfw.wmnet - dzahn@cumin1002" [production]
21:19 <dzahn@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM zuul2003.codfw.wmnet - dzahn@cumin1002" [production]
21:16 <dzahn@cumin1002> START - Cookbook sre.dns.netbox [production]
21:16 <dzahn@cumin1002> START - Cookbook sre.ganeti.makevm for new host zuul2003.codfw.wmnet [production]
21:06 <jforrester@deploy1003> Finished scap sync-world: Backport for [[gerrit:1145867|TransformHandler: Return 400 for invalid titles (T394270)]], [[gerrit:1146631|Merge remote-tracking branch 'origin/master' into wmf_deploy (T341775 T373017 T393122 T394404)]], [[gerrit:1146654|Xml::input, label: Replace usage with Html::input, label (T394025)]] (duration: 11m 28s) [production]
21:05 <andrew@cumin1002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts cloudvirt1031.eqiad.wmnet [production]
21:05 <andrew@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:05 <andrew@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudvirt1031.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]
21:05 <andrew@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudvirt1031.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]
21:00 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cirrussearch1057 [production]
21:00 <bking@cumin2002> START - Cookbook sre.hosts.move-vlan for host cirrussearch1057 [production]
21:00 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host cirrussearch1057.eqiad.wmnet with OS bullseye [production]
21:00 <bking@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cirrussearch1057.eqiad.wmnet with OS bullseye [production]
20:59 <jforrester@deploy1003> mszabo, jforrester: Continuing with sync [production]
20:57 <jforrester@deploy1003> mszabo, jforrester: Backport for [[gerrit:1145867|TransformHandler: Return 400 for invalid titles (T394270)]], [[gerrit:1146631|Merge remote-tracking branch 'origin/master' into wmf_deploy (T341775 T373017 T393122 T394404)]], [[gerrit:1146654|Xml::input, label: Replace usage with Html::input, label (T394025)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes c [production]
20:55 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1145867|TransformHandler: Return 400 for invalid titles (T394270)]], [[gerrit:1146631|Merge remote-tracking branch 'origin/master' into wmf_deploy (T341775 T373017 T393122 T394404)]], [[gerrit:1146654|Xml::input, label: Replace usage with Html::input, label (T394025)]] [production]
20:45 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cirrussearch1057 [production]
20:45 <bking@cumin2002> START - Cookbook sre.hosts.move-vlan for host cirrussearch1057 [production]
20:45 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host cirrussearch1057.eqiad.wmnet with OS bullseye [production]
20:45 <andrew@cumin1002> START - Cookbook sre.dns.netbox [production]
20:40 <andrew@cumin1002> START - Cookbook sre.hosts.decommission for hosts cloudvirt1031.eqiad.wmnet [production]
20:40 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudvirt1032.eqiad.wmnet [production]
20:40 <andrew@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:40 <andrew@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudvirt1032.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]
20:40 <andrew@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudvirt1032.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]