4901-4950 of 10000 results (89ms)
2023-08-15 ยง
18:16 <sukhe@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
18:16 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3066.esams.wmnet with OS bullseye [production]
18:16 <sukhe@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
18:11 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
18:10 <fabfur@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - fabfur@cumin1001" [production]
18:09 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
18:08 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3076.esams.wmnet with reason: host reimage [production]
18:05 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3068.esams.wmnet with reason: host reimage [production]
18:05 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3076.esams.wmnet with reason: host reimage [production]
18:01 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3068.esams.wmnet with reason: host reimage [production]
17:54 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
17:53 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
17:48 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3074.esams.wmnet with reason: host reimage [production]
17:45 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3066.esams.wmnet with reason: host reimage [production]
17:44 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3074.esams.wmnet with reason: host reimage [production]
17:42 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3066.esams.wmnet with reason: host reimage [production]
17:42 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns3003.wikimedia.org with reason: host reimage [production]
17:42 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp3076.esams.wmnet with OS bullseye [production]
17:40 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp3068.esams.wmnet with OS bullseye [production]
17:39 <fabfur@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on dns3003.wikimedia.org with reason: host reimage [production]
17:22 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp3074.esams.wmnet with OS bullseye [production]
17:21 <brett> Upload libvmod-netmapper 1.9-4 (bookworm) to archive - T342154 [production]
17:20 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp3066.esams.wmnet with OS bullseye [production]
17:15 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host dns3003.wikimedia.org with OS bullseye [production]
17:02 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3070'] [production]
17:01 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3066'] [production]
17:01 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3068'] [production]
17:00 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3072'] [production]
16:57 <bking@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host flink-zk2001.codfw.wmnet [production]
16:57 <bking@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host flink-zk2001.codfw.wmnet with OS bookworm [production]
16:56 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3074'] [production]
16:55 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3066'] [production]
16:55 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3068'] [production]
16:55 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3070'] [production]
16:54 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3072'] [production]
16:54 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3076'] [production]
16:53 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['lvs3010'] [production]
16:52 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3078'] [production]
16:51 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3080'] [production]
16:50 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3074'] [production]
16:49 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cp3066.mgmt.esams.wmnet with reboot policy FORCED [production]
16:49 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1098.eqiad.wmnet with OS bullseye [production]
16:48 <robh@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cp3074'] [production]
16:48 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3074'] [production]
16:47 <bking@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host flink-zk2002.codfw.wmnet [production]
16:47 <bking@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
16:46 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3076'] [production]
16:46 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3078'] [production]
16:45 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3080'] [production]
16:45 <bking@cumin1001> START - Cookbook sre.dns.netbox [production]