51-100 of 10000 results (115ms)
2026-04-24 ยง
19:35 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:33 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:32 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:27 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host druid-internal1004.eqiad.wmnet with OS trixie [production]
19:27 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host druid-internal1003.eqiad.wmnet with OS trixie [production]
19:27 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host druid-internal1002.eqiad.wmnet with OS trixie [production]
19:27 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host druid-internal1001.eqiad.wmnet with OS trixie [production]
19:25 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:24 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:24 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:22 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host druid-internal1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:21 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host druid-internal1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:20 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:20 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host druid-internal1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:20 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host druid-internal1003.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:20 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host druid-internal1004.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:18 <eevans@deploy1003> helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply [production]
19:17 <eevans@deploy1003> helmfile [staging] START helmfile.d/services/linked-artifacts: apply [production]
19:16 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:16 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:16 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:15 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:15 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:14 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host druid-internal1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:13 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:12 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:12 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1003.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:12 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:12 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:12 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1004.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:11 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host druid-internal1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:10 <jclark@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:10 <jclark@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding druid-internal1001 to eqiad - jclark@cumin1003" [production]
19:10 <jclark@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding druid-internal1001 to eqiad - jclark@cumin1003" [production]
19:06 <jclark@cumin1003> START - Cookbook sre.dns.netbox [production]
18:50 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-ctrl1006.eqiad.wmnet with OS trixie [production]
18:50 <jclark@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" [production]
18:49 <jclark@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" [production]
18:48 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-ctrl1005.eqiad.wmnet with OS trixie [production]
18:48 <jclark@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" [production]
18:45 <jclark@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" [production]
18:34 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-ctrl1006.eqiad.wmnet with reason: host reimage [production]
18:29 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-ctrl1005.eqiad.wmnet with reason: host reimage [production]
18:23 <jclark@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-ctrl1006.eqiad.wmnet with reason: host reimage [production]
18:23 <jclark@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-ctrl1005.eqiad.wmnet with reason: host reimage [production]
18:17 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance [production]
18:17 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1251 (T419635)', diff saved to https://phabricator.wikimedia.org/P91517 and previous config saved to /var/cache/conftool/dbconfig/20260424-181705-fceratto.json [production]
18:11 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host wikikube-ctrl1006.eqiad.wmnet with OS trixie [production]
18:11 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host wikikube-ctrl1005.eqiad.wmnet with OS trixie [production]
18:09 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-ctrl1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]