101-150 of 10000 results (112ms)
2025-08-07 ยง
15:07 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['deploy2003'] [production]
15:06 <jhancock@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['deploy2003'] [production]
15:05 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2019.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
15:05 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1261.eqiad.wmnet with OS bookworm [production]
15:05 <jclark@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
15:04 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
15:02 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host ms-fe2019.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
15:02 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1260.eqiad.wmnet with OS bookworm [production]
15:02 <jclark@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
15:01 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
14:59 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-fe2019.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:59 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2020.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:58 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2018.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:58 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2017.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:58 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host deploy2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:55 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host ms-fe2020.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:55 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host ms-fe2019.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:55 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1263.eqiad.wmnet with reason: host reimage [production]
14:55 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host ms-fe2018.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:55 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host ms-fe2017.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:54 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host deploy2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:53 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ms-fe2020 [production]
14:53 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ms-fe2019 [production]
14:53 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ms-fe2018 [production]
14:53 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ms-fe2017 [production]
14:53 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host deploy2003 [production]
14:53 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host ms-fe2020 [production]
14:53 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host ms-fe2019 [production]
14:53 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host ms-fe2018 [production]
14:53 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host ms-fe2017 [production]
14:53 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host deploy2003 [production]
14:52 <jhancock@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:52 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ms-fe2020 to codfw - jhancock@cumin1003" [production]
14:52 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ms-fe2020 to codfw - jhancock@cumin1003" [production]
14:52 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1262.eqiad.wmnet with reason: host reimage [production]
14:49 <jhancock@cumin1003> START - Cookbook sre.dns.netbox [production]
14:48 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1261.eqiad.wmnet with reason: host reimage [production]
14:44 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1260.eqiad.wmnet with reason: host reimage [production]
14:41 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1263.eqiad.wmnet with reason: host reimage [production]
14:41 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1262.eqiad.wmnet with reason: host reimage [production]
14:41 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1261.eqiad.wmnet with reason: host reimage [production]
14:41 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1260.eqiad.wmnet with reason: host reimage [production]
14:25 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host db1263.eqiad.wmnet with OS bookworm [production]
14:25 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host db1262.eqiad.wmnet with OS bookworm [production]
14:25 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host db1261.eqiad.wmnet with OS bookworm [production]
14:24 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host db1260.eqiad.wmnet with OS bookworm [production]
14:24 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1176251|Do not create a database table when a different provider is used (T397348)]], [[gerrit:1176250|Do not create a database table when a different provider is used (T397348)]] (duration: 07m 54s) [production]
14:18 <zabe@deploy1003> zabe: Continuing with sync [production]
14:18 <zabe@deploy1003> zabe: Backport for [[gerrit:1176251|Do not create a database table when a different provider is used (T397348)]], [[gerrit:1176250|Do not create a database table when a different provider is used (T397348)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:16 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1176251|Do not create a database table when a different provider is used (T397348)]], [[gerrit:1176250|Do not create a database table when a different provider is used (T397348)]] [production]