3001-3050 of 10000 results (133ms)
2024-04-29 ยง
20:28 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns7001'] [production]
20:28 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ganeti7003'] [production]
20:28 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ganeti7002'] [production]
20:27 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ganeti7001'] [production]
20:27 <topranks> re-announcing magru prefixes to from EdgeUno [production]
20:27 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['dns7002'] [production]
20:26 <cjming@deploy1002> cjming and esanders: Continuing with sync [production]
20:26 <robh@cumin2002> START - Cookbook sre.hosts.provision for host lvs7002.mgmt.magru.wmnet with reboot policy FORCED [production]
20:25 <cjming@deploy1002> cjming and esanders: Backport for [[gerrit:954920|Turn off DiscussionTools A/B test, and enable features on those wikis (T341491)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:24 <robh@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['lvs7002'] [production]
20:24 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['lvs7002'] [production]
20:23 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['lvs7001'] [production]
20:23 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti7004'] [production]
20:23 <cjming@deploy1002> Started scap: Backport for [[gerrit:954920|Turn off DiscussionTools A/B test, and enable features on those wikis (T341491)]] [production]
20:23 <fabfur@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - fabfur@cumin1002" [production]
20:22 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti7003'] [production]
20:22 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti7002'] [production]
20:22 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti7001'] [production]
20:22 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:22 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs7003.mgmt.magru.wmnet with reboot policy FORCED [production]
20:21 <cjming@deploy1002> Finished scap: Backport for [[gerrit:1024411|Shift writes to SUP, 1st batch (T363475)]] (duration: 16m 17s) [production]
20:20 <robh@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns7001'] [production]
20:20 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns7001'] [production]
20:19 <robh@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns7001'] [production]
20:19 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns7001'] [production]
20:19 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns7002'] [production]
20:19 <robh@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns7001'] [production]
20:19 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns7001'] [production]
20:17 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti7004.mgmt.magru.wmnet with reboot policy FORCED [production]
20:16 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:16 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti7003.mgmt.magru.wmnet with reboot policy FORCED [production]
20:15 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti7002.mgmt.magru.wmnet with reboot policy FORCED [production]
20:15 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dns7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:14 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dns7002.mgmt.magru.wmnet with reboot policy FORCED [production]
20:09 <cjming@deploy1002> cjming and pfischer: Continuing with sync [production]
20:09 <cjming@deploy1002> cjming and pfischer: Backport for [[gerrit:1024411|Shift writes to SUP, 1st batch (T363475)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:09 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp7002.magru.wmnet with OS bullseye [production]
20:09 <sukhe@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin1002" [production]
20:07 <topranks> withdrawing prefixes from EdgeUno transit in magru to test paths via second transit [production]
20:06 <robh@cumin2002> START - Cookbook sre.hosts.provision for host lvs7003.mgmt.magru.wmnet with reboot policy FORCED [production]
20:05 <cjming@deploy1002> Started scap: Backport for [[gerrit:1024411|Shift writes to SUP, 1st batch (T363475)]] [production]
20:05 <robh@cumin2002> START - Cookbook sre.hosts.provision for host lvs7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:05 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti7004.mgmt.magru.wmnet with reboot policy FORCED [production]
20:04 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti7003.mgmt.magru.wmnet with reboot policy FORCED [production]
20:04 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti7002.mgmt.magru.wmnet with reboot policy FORCED [production]
20:03 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:03 <robh@cumin2002> START - Cookbook sre.hosts.provision for host dns7002.mgmt.magru.wmnet with reboot policy FORCED [production]
20:03 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7003.magru.wmnet with reason: host reimage [production]
20:02 <robh@cumin2002> START - Cookbook sre.hosts.provision for host dns7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:00 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp7003.magru.wmnet with reason: host reimage [production]