751-800 of 10000 results (102ms)
2025-01-07 ยง
11:26 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2032.codfw.wmnet with reason: host reimage [production]
11:25 <moritzm> refreshed Ganeti internal cert for ulsfo (after adding a manual temp cert to unblock itself) T382873 [production]
11:22 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2033.codfw.wmnet with reason: host reimage [production]
11:18 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2033.codfw.wmnet with reason: host reimage [production]
11:13 <hashar@deploy2002> Finished deploy [integration/docroot@5d32766]: Remove Flow from being listed on doc.wikimedia.org frontpage - T379671 (duration: 00m 11s) [production]
11:13 <hashar@deploy2002> Started deploy [integration/docroot@5d32766]: Remove Flow from being listed on doc.wikimedia.org frontpage - T379671 [production]
11:08 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2032 [production]
11:08 <jelto@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2032 [production]
11:08 <jelto@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2032 [production]
11:08 <jelto@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2032.codfw.wmnet 215.32.192.10.in-addr.arpa 5.1.2.0.2.3.0.0.2.9.1.0.0.1.0.0.3.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
11:08 <jelto@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker2032.codfw.wmnet 215.32.192.10.in-addr.arpa 5.1.2.0.2.3.0.0.2.9.1.0.0.1.0.0.3.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
11:08 <jelto@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:07 <jelto@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2032 - jelto@cumin1002" [production]
11:07 <jelto@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2032 - jelto@cumin1002" [production]
11:03 <jelto@cumin1002> START - Cookbook sre.dns.netbox [production]
11:02 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2032 [production]
11:01 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2032.codfw.wmnet with OS bookworm [production]
11:01 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2033 [production]
11:01 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2033 [production]
11:01 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2033.codfw.wmnet with OS bookworm [production]
10:56 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2032-2033].codfw.wmnet [production]
10:53 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2032-2033].codfw.wmnet [production]
10:52 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2034.codfw.wmnet [production]
10:52 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2034.codfw.wmnet [production]
10:52 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2035.codfw.wmnet [production]
10:51 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2035.codfw.wmnet [production]
10:51 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on ganeti[4005-4008].ulsfo.wmnet with reason: renew certs [production]
10:50 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2035.codfw.wmnet with OS bookworm [production]
10:50 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 3:00:00 on ganeti[4005-4008].ulsfo.wmnet with reason: renew certs [production]
10:50 <cmooney@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 269180 [production]
10:49 <cmooney@cumin1002> START - Cookbook sre.network.peering with action 'configure' for AS: 269180 [production]
10:46 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2034.codfw.wmnet with OS bookworm [production]
10:30 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2035.codfw.wmnet with reason: host reimage [production]
10:26 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2034.codfw.wmnet with reason: host reimage [production]
10:25 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2035.codfw.wmnet with reason: host reimage [production]
10:23 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2034.codfw.wmnet with reason: host reimage [production]
10:05 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2035 [production]
10:05 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2035 [production]
10:05 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2034 [production]
10:05 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2034 [production]
10:05 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2034.codfw.wmnet with OS bookworm [production]
10:05 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2035.codfw.wmnet with OS bookworm [production]
10:05 <cmooney@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rpki2003.codfw.wmnet [production]
10:03 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2034-2035].codfw.wmnet [production]
10:02 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2034-2035].codfw.wmnet [production]
10:01 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2036.codfw.wmnet [production]
10:01 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2036.codfw.wmnet [production]
10:01 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2037.codfw.wmnet [production]
10:01 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2037.codfw.wmnet [production]
10:01 <cmooney@cumin1002> START - Cookbook sre.hosts.reboot-single for host rpki2003.codfw.wmnet [production]