101-150 of 10000 results (0ms)
2026-09-29 ยง
19:24 <kemayo@deploy1003> helmfile [staging] DONE helmfile.d/services/editcheck-headless: apply [production]
19:23 <kemayo@deploy1003> helmfile [staging] START helmfile.d/services/editcheck-headless: apply [production]
19:22 <btullis@cumin1004> START - Cookbook sre.hosts.reimage for host ml-cache1001.eqiad.wmnet with OS bookworm [production]
19:19 <btullis@cumin1004> START - Cookbook sre.hosts.reimage for host ml-cache1003.eqiad.wmnet with OS bookworm [production]
19:17 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-cache1003.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:15 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-cache1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:15 <btullis@cumin1004> START - Cookbook sre.hosts.provision for host ml-cache1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:10 <btullis@cumin1004> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ml-cache1001.eqiad.wmnet with OS bookworm [production]
19:10 <btullis@cumin1004> START - Cookbook sre.hosts.reimage for host ml-cache1001.eqiad.wmnet with OS bookworm [production]
19:09 <btullis@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-cache1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:09 <bking@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/matomo-next: apply [production]
19:09 <bking@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/matomo-next: apply [production]
19:08 <btullis@cumin1004> START - Cookbook sre.hosts.provision for host ml-cache1003.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:08 <btullis@cumin1004> START - Cookbook sre.hosts.provision for host ml-cache1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:08 <btullis@cumin1004> START - Cookbook sre.hosts.provision for host ml-cache1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:08 <btullis@cumin1004> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ml-cache1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:07 <btullis@cumin1004> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ml-cache1003.eqiad.wmnet with OS bookworm [production]
19:06 <btullis@cumin1004> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ml-cache1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:06 <btullis@cumin1004> START - Cookbook sre.hosts.provision for host ml-cache1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:05 <btullis@cumin1004> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ml-cache1002.eqiad.wmnet with OS bookworm [production]
19:05 <btullis@cumin1004> START - Cookbook sre.hosts.provision for host ml-cache1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:04 <btullis@cumin1004> START - Cookbook sre.hosts.reimage for host ml-cache1003.eqiad.wmnet with OS bookworm [production]
19:03 <btullis@cumin1004> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ml-cache1001.eqiad.wmnet with OS bookworm [production]
19:03 <btullis@cumin1004> START - Cookbook sre.hosts.reimage for host ml-cache1001.eqiad.wmnet with OS bookworm [production]
19:02 <btullis@cumin1004> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) ml-cache1001.eqiad.wmnet ml-cache1003.eqiad.wmnet on all recursors [production]
19:02 <btullis@cumin1004> START - Cookbook sre.dns.wipe-cache ml-cache1001.eqiad.wmnet ml-cache1003.eqiad.wmnet on all recursors [production]
18:57 <cdobbins@cumin1004> conftool action : set/pooled=yes; selector: name=ncredir5004.* [production]
18:56 <btullis@cumin1004> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:56 <btullis@cumin1004> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache servers - btullis@cumin1004" [production]
18:56 <btullis@cumin1004> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache servers - btullis@cumin1004" [production]
18:56 <btullis@cumin1004> START - Cookbook sre.hosts.reimage for host ml-cache1002.eqiad.wmnet with OS bookworm [production]
18:55 <James_F> Zuul: [fresh] Make shellcheck voting and required before tests, for T439219 [releng]
18:51 <wmbot~lucaswerkmeister@tools-bastion-15> deployed 1f97dafd49 (Toolforge Components Service, push-to-deploy) [tools.translate-link]
18:50 <btullis@cumin1004> START - Cookbook sre.dns.netbox [production]
18:49 <btullis@cumin1004> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:49 <btullis@cumin1004> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache1001 network - btullis@cumin1004" [production]
18:49 <btullis@cumin1004> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache1001 network - btullis@cumin1004" [production]
18:45 <btullis@cumin1004> START - Cookbook sre.dns.netbox [production]
18:41 <btullis@cumin1004> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:41 <btullis@cumin1004> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache1001 network - btullis@cumin1004" [production]
18:40 <wmbot~lucaswerkmeister@tools-bastion-15> deployed 2bbb24b895 (Python 3.14) [tools.translate-link]
18:39 <btullis@cumin1004> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache1001 network - btullis@cumin1004" [production]
18:39 <wmbot~lucaswerkmeister@tools-bastion-15> deployed 3d16b7ab07 (upgrade dependencies) [tools.translate-link]
18:35 <btullis@cumin1004> START - Cookbook sre.dns.netbox [production]
18:34 <btullis@cumin1004> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:34 <btullis@cumin1004> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache1002 and ml-cache1003 - btullis@cumin1004" [production]
18:31 <btullis@cumin1004> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache1002 and ml-cache1003 - btullis@cumin1004" [production]
18:30 <atsuko@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
18:30 <atsuko@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
18:27 <btullis@cumin1004> START - Cookbook sre.dns.netbox [production]