2401-2450 of 10000 results (90ms)
2023-08-15 ยง
18:36 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dns3004.wikimedia.org with OS bullseye [production]
18:36 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp3078.esams.wmnet with OS bullseye [production]
18:36 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp3070.esams.wmnet with OS bullseye [production]
18:32 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3076.esams.wmnet with OS bullseye [production]
18:32 <brett@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - brett@cumin2002" [production]
18:30 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3068.esams.wmnet with OS bullseye [production]
18:30 <brett@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - brett@cumin2002" [production]
18:30 <brett@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - brett@cumin2002" [production]
18:28 <brett@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - brett@cumin2002" [production]
18:26 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host dns3004.wikimedia.org with OS bullseye [production]
18:17 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dns3003.wikimedia.org with OS bullseye [production]
18:17 <fabfur@cumin1001> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - fabfur@cumin1001" [production]
18:16 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3074.esams.wmnet with OS bullseye [production]
18:16 <sukhe@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
18:16 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3066.esams.wmnet with OS bullseye [production]
18:16 <sukhe@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
18:11 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
18:10 <fabfur@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - fabfur@cumin1001" [production]
18:09 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
18:08 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3076.esams.wmnet with reason: host reimage [production]
18:05 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3068.esams.wmnet with reason: host reimage [production]
18:05 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3076.esams.wmnet with reason: host reimage [production]
18:01 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3068.esams.wmnet with reason: host reimage [production]
17:54 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
17:53 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
17:48 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3074.esams.wmnet with reason: host reimage [production]
17:45 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3066.esams.wmnet with reason: host reimage [production]
17:44 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3074.esams.wmnet with reason: host reimage [production]
17:42 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3066.esams.wmnet with reason: host reimage [production]
17:42 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns3003.wikimedia.org with reason: host reimage [production]
17:42 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp3076.esams.wmnet with OS bullseye [production]
17:40 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp3068.esams.wmnet with OS bullseye [production]
17:39 <fabfur@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on dns3003.wikimedia.org with reason: host reimage [production]
17:22 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp3074.esams.wmnet with OS bullseye [production]
17:21 <brett> Upload libvmod-netmapper 1.9-4 (bookworm) to archive - T342154 [production]
17:20 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp3066.esams.wmnet with OS bullseye [production]
17:15 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host dns3003.wikimedia.org with OS bullseye [production]
17:02 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3070'] [production]
17:01 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3066'] [production]
17:01 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3068'] [production]
17:00 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3072'] [production]
16:57 <bking@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host flink-zk2001.codfw.wmnet [production]
16:57 <bking@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host flink-zk2001.codfw.wmnet with OS bookworm [production]
16:56 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3074'] [production]
16:55 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3066'] [production]
16:55 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3068'] [production]
16:55 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3070'] [production]
16:54 <robh@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp3072'] [production]
16:54 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp3076'] [production]
16:53 <robh@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['lvs3010'] [production]