101-150 of 10000 results (25ms)
2026-11-09 ยง
12:11 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker2012.codfw.wmnet with OS bookworm [production]
12:08 <Emperor> stop swift on thanos-be2006 to VACUUM 27G container DB T443888 [production]
12:00 <root@deploy2003> helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync [production]
12:00 <root@deploy2003> helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync [production]
12:00 <root@deploy2003> helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync [production]
12:00 <root@deploy2003> helmfile [staging] START helmfile.d/services/shellbox-timeline: sync [production]
12:00 <root@deploy2003> helmfile [staging] DONE helmfile.d/services/shellbox: sync [production]
12:00 <root@deploy2003> helmfile [staging] START helmfile.d/services/shellbox: sync [production]
11:59 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker1049.eqiad.wmnet with reason: host reimage [production]
11:55 <btullis@cumin1004> START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker1049.eqiad.wmnet with reason: host reimage [production]
11:54 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker2012.codfw.wmnet with reason: host reimage [production]
11:52 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dse-k8s-worker1049.eqiad.wmnet (remove config only) [production]
11:52 <btullis@cumin1004> START - Cookbook sre.hosts.dhcp for host dse-k8s-worker1049.eqiad.wmnet (remove config only) [production]
11:48 <btullis@cumin1004> START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker2012.codfw.wmnet with reason: host reimage [production]
11:46 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dse-k8s-worker2012.codfw.wmnet (remove config only) [production]
11:45 <btullis@cumin1004> START - Cookbook sre.hosts.dhcp for host dse-k8s-worker2012.codfw.wmnet (remove config only) [production]
11:34 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dse-k8s-worker1049.eqiad.wmnet (push config only) [production]
11:34 <btullis@cumin1004> START - Cookbook sre.hosts.dhcp for host dse-k8s-worker1049.eqiad.wmnet (push config only) [production]
11:34 <btullis@cumin1004> START - Cookbook sre.hosts.reimage for host dse-k8s-worker1049.eqiad.wmnet with OS bookworm [production]
11:33 <btullis@cumin1004> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['dse-k8s-worker1049.eqiad.wmnet'] [production]
11:31 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dse-k8s-worker2012.codfw.wmnet (push config only) [production]
11:31 <btullis@cumin1004> START - Cookbook sre.hosts.dhcp for host dse-k8s-worker2012.codfw.wmnet (push config only) [production]
11:30 <btullis@cumin1004> START - Cookbook sre.hosts.reimage for host dse-k8s-worker2012.codfw.wmnet with OS bookworm [production]
11:27 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from dse-k8s-wdqs-test2001 to dse-k8s-worker2012 [production]
11:26 <btullis@cumin1004> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dse-k8s-worker1049.eqiad.wmnet'] [production]
11:26 <btullis@cumin1004> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2012 [production]
11:25 <btullis@cumin1004> START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2012 [production]
11:25 <btullis@cumin1004> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker2012 on all recursors [production]
11:25 <btullis@cumin1004> START - Cookbook sre.dns.wipe-cache dse-k8s-worker2012 on all recursors [production]
11:25 <btullis@cumin1004> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:25 <btullis@cumin1004> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming dse-k8s-wdqs-test2001 to dse-k8s-worker2012 - btullis@cumin1004" [production]
11:25 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from dse-k8s-wdqs-test1001 to dse-k8s-worker1049 [production]
11:25 <btullis@cumin1004> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming dse-k8s-wdqs-test2001 to dse-k8s-worker2012 - btullis@cumin1004" [production]
11:24 <btullis@cumin1004> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker1049 [production]
11:24 <btullis@cumin1004> START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker1049 [production]
11:24 <btullis@cumin1004> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker1049 on all recursors [production]
11:24 <btullis@cumin1004> START - Cookbook sre.dns.wipe-cache dse-k8s-worker1049 on all recursors [production]
11:24 <btullis@cumin1004> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:24 <btullis@cumin1004> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming dse-k8s-wdqs-test1001 to dse-k8s-worker1049 - btullis@cumin1004" [production]
11:22 <btullis@cumin1004> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming dse-k8s-wdqs-test1001 to dse-k8s-worker1049 - btullis@cumin1004" [production]
11:21 <btullis@cumin1004> START - Cookbook sre.dns.netbox [production]
11:21 <btullis@cumin1004> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
11:16 <btullis@cumin1004> START - Cookbook sre.dns.netbox [production]
11:10 <btullis@cumin1004> START - Cookbook sre.dns.netbox [production]
11:10 <btullis@cumin1004> START - Cookbook sre.hosts.rename from dse-k8s-wdqs-test2001 to dse-k8s-worker2012 [production]
11:10 <btullis@cumin1004> START - Cookbook sre.hosts.rename from dse-k8s-wdqs-test1001 to dse-k8s-worker1049 [production]
10:59 <urbanecm@deploy2003> Finished scap sync-world: Backport for [[gerrit:1363328|GrowthExperiments: Remove settings that nothing reads (T443648)]] (duration: 12m 54s) [production]
10:58 <btullis@cumin1004> conftool action : set/pooled=inactive; selector: name=dse-k8s-wdqs-test2001.codfw.wmnet [production]
10:58 <btullis@cumin1004> conftool action : set/pooled=inactive; selector: name=dse-k8s-wdqs-test1001.eqiad.wmnet [production]
10:53 <urbanecm@deploy2003> urbanecm: Continuing with deployment [production]