3351-3400 of 10000 results (92ms)
2024-04-29 ยง
20:24 <robh@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['lvs7002'] [production]
20:24 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['lvs7002'] [production]
20:23 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['lvs7001'] [production]
20:23 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti7004'] [production]
20:23 <cjming@deploy1002> Started scap: Backport for [[gerrit:954920|Turn off DiscussionTools A/B test, and enable features on those wikis (T341491)]] [production]
20:23 <fabfur@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - fabfur@cumin1002" [production]
20:22 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti7003'] [production]
20:22 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti7002'] [production]
20:22 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti7001'] [production]
20:22 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:22 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs7003.mgmt.magru.wmnet with reboot policy FORCED [production]
20:21 <cjming@deploy1002> Finished scap: Backport for [[gerrit:1024411|Shift writes to SUP, 1st batch (T363475)]] (duration: 16m 17s) [production]
20:20 <robh@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns7001'] [production]
20:20 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns7001'] [production]
20:19 <robh@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns7001'] [production]
20:19 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns7001'] [production]
20:19 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns7002'] [production]
20:19 <robh@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns7001'] [production]
20:19 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns7001'] [production]
20:17 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti7004.mgmt.magru.wmnet with reboot policy FORCED [production]
20:16 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:16 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti7003.mgmt.magru.wmnet with reboot policy FORCED [production]
20:15 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti7002.mgmt.magru.wmnet with reboot policy FORCED [production]
20:15 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dns7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:14 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dns7002.mgmt.magru.wmnet with reboot policy FORCED [production]
20:09 <cjming@deploy1002> cjming and pfischer: Continuing with sync [production]
20:09 <cjming@deploy1002> cjming and pfischer: Backport for [[gerrit:1024411|Shift writes to SUP, 1st batch (T363475)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:09 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp7002.magru.wmnet with OS bullseye [production]
20:09 <sukhe@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin1002" [production]
20:07 <topranks> withdrawing prefixes from EdgeUno transit in magru to test paths via second transit [production]
20:06 <robh@cumin2002> START - Cookbook sre.hosts.provision for host lvs7003.mgmt.magru.wmnet with reboot policy FORCED [production]
20:05 <cjming@deploy1002> Started scap: Backport for [[gerrit:1024411|Shift writes to SUP, 1st batch (T363475)]] [production]
20:05 <robh@cumin2002> START - Cookbook sre.hosts.provision for host lvs7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:05 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti7004.mgmt.magru.wmnet with reboot policy FORCED [production]
20:04 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti7003.mgmt.magru.wmnet with reboot policy FORCED [production]
20:04 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti7002.mgmt.magru.wmnet with reboot policy FORCED [production]
20:03 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:03 <robh@cumin2002> START - Cookbook sre.hosts.provision for host dns7002.mgmt.magru.wmnet with reboot policy FORCED [production]
20:03 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7003.magru.wmnet with reason: host reimage [production]
20:02 <robh@cumin2002> START - Cookbook sre.hosts.provision for host dns7001.mgmt.magru.wmnet with reboot policy FORCED [production]
20:00 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp7003.magru.wmnet with reason: host reimage [production]
19:51 <sukhe@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin1002" [production]
19:46 <robh@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:46 <robh@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: magru misc hosts - robh@cumin2002" [production]
19:45 <robh@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: magru misc hosts - robh@cumin2002" [production]
19:41 <robh@cumin2002> START - Cookbook sre.dns.netbox [production]
19:33 <mforns@deploy1002> Finished deploy [analytics/refinery@1693892] (hadoop-test): Fixes queries for Commons Impact MEtrics dumps TEST [analytics/refinery@1693892a] (duration: 03m 22s) [production]
19:31 <fabfur@cumin1002> START - Cookbook sre.hosts.reimage for host cp7003.magru.wmnet with OS bullseye [production]
19:31 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7002.magru.wmnet with reason: host reimage [production]
19:30 <mforns@deploy1002> Started deploy [analytics/refinery@1693892] (hadoop-test): Fixes queries for Commons Impact MEtrics dumps TEST [analytics/refinery@1693892a] [production]