651-700 of 10000 results (94ms)
2024-05-21 ยง
11:57 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-ctrl2002.codfw.wmnet on all recursors [production]
11:57 <cmooney@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-ctrl2002.codfw.wmnet on all recursors [production]
11:57 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl2002 [production]
11:55 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1244.eqiad.wmnet [production]
11:55 <hnowlan@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-ctrl2003.mgmt.codfw.wmnet with reboot policy FORCED [production]
11:52 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1243.eqiad.wmnet [production]
11:52 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host wikikube-ctrl2002 [production]
11:51 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl2002 [production]
11:51 <hnowlan@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-ctrl2003 [production]
11:51 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl2003 [production]
11:49 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudnet1006.eqiad.wmnet with reason: host reimage [production]
11:49 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-ctrl2002.mgmt.codfw.wmnet with reboot policy FORCED [production]
11:47 <hnowlan@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-ctrl2002.mgmt.codfw.wmnet with reboot policy FORCED [production]
11:46 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host wikikube-ctrl2002 [production]
11:46 <taavi@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudnet1006.eqiad.wmnet with reason: host reimage [production]
11:46 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl2002 [production]
11:46 <hnowlan@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-ctrl2003 [production]
11:43 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host wikikube-ctrl2002 [production]
11:43 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl2003 [production]
11:43 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl2002 [production]
11:42 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-ctrl2003.mgmt.codfw.wmnet with reboot policy FORCED [production]
11:42 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-ctrl2002.mgmt.codfw.wmnet with reboot policy FORCED [production]
11:41 <hnowlan@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-ctrl2003.mgmt.codfw.wmnet with reboot policy FORCED [production]
11:41 <hnowlan@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-ctrl2002.mgmt.codfw.wmnet with reboot policy FORCED [production]
11:41 <hnowlan@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-ctrl2001.mgmt.codfw.wmnet with reboot policy FORCED [production]
11:40 <hnowlan@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-ctrl1003.mgmt.eqiad.wmnet with reboot policy FORCED [production]
11:39 <hnowlan@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-ctrl1002.mgmt.eqiad.wmnet with reboot policy FORCED [production]
11:36 <hnowlan@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-ctrl1001.mgmt.eqiad.wmnet with reboot policy FORCED [production]
11:36 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1243.eqiad.wmnet [production]
11:33 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1242.eqiad.wmnet [production]
11:32 <taavi@cumin1002> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bookworm [production]
11:10 <taavi@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudnet1005 [production]
11:10 <taavi@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host cloudnet1005 [production]
11:02 <hnowlan@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-ctrl1003 [production]
11:00 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl1003 [production]
11:00 <hnowlan@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-ctrl1002 [production]
10:59 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl1002 [production]
10:58 <hnowlan@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-ctrl1001 [production]
10:57 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl1001 [production]
10:57 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host wikikube-ctrl2002 [production]
10:57 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl2002 [production]
10:55 <jmm@cumin2002> END (PASS) - Cookbook sre.maps.roll-restart-reboot (exit_code=0) rolling restart_daemons on A:maps-replica-eqiad [production]
10:51 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host wikikube-ctrl2001 [production]
10:51 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-ctrl2001 [production]
10:50 <hnowlan@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:50 <hnowlan@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add renamed k8s ctrl nodes - hnowlan@cumin1002" [production]
10:50 <jmm@cumin2002> START - Cookbook sre.maps.roll-restart-reboot rolling restart_daemons on A:maps-replica-eqiad [production]
10:49 <hnowlan@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add renamed k8s ctrl nodes - hnowlan@cumin1002" [production]
10:49 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1238.eqiad.wmnet [production]
10:46 <hnowlan@cumin1002> START - Cookbook sre.dns.netbox [production]