3351-3400 of 10000 results (126ms)
2024-09-06 ยง
12:17 <cgoubert@cumin1002> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker2029.codfw.wmnet [production]
12:16 <hnowlan@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2097.codfw.wmnet with reason: host reimage [production]
12:16 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=99) Renumbering for host wikikube-worker2029.codfw.wmnet [production]
12:16 <cgoubert@cumin1002> END (ERROR) - Cookbook sre.k8s.pool-depool-node (exit_code=97) depool for host wikikube-worker2029.codfw.wmnet [production]
12:16 <hnowlan@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2098 [production]
12:16 <hnowlan@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2098 [production]
12:16 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2029.codfw.wmnet [production]
12:16 <cgoubert@cumin1002> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker2029.codfw.wmnet [production]
12:16 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2098 [production]
12:16 <hnowlan@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2098.codfw.wmnet 176.16.192.10.in-addr.arpa 6.7.1.0.6.1.0.0.2.9.1.0.0.1.0.0.2.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
12:16 <hnowlan@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker2098.codfw.wmnet 176.16.192.10.in-addr.arpa 6.7.1.0.6.1.0.0.2.9.1.0.0.1.0.0.2.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
12:16 <hnowlan@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:16 <hnowlan@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2098 - hnowlan@cumin1002" [production]
12:15 <hnowlan@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2098 - hnowlan@cumin1002" [production]
12:15 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=99) Renumbering for host wikikube-worker2099.codfw.wmnet [production]
12:15 <cgoubert@cumin1002> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker2099.codfw.wmnet [production]
12:15 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host gerrit1003.wikimedia.org [production]
12:14 <cgoubert@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2099.codfw.wmnet wikikube-worker2100.codfw.wmnet wikikube-worker2101.codfw.wmnet on all recursors [production]
12:14 <cgoubert@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker2099.codfw.wmnet wikikube-worker2100.codfw.wmnet wikikube-worker2101.codfw.wmnet on all recursors [production]
12:13 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw2334 to wikikube-worker2101 [production]
12:12 <hnowlan@cumin1002> START - Cookbook sre.dns.netbox [production]
12:12 <cgoubert@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2101 [production]
12:12 <cgoubert@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2101 [production]
12:12 <hnowlan@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2098 [production]
12:12 <cgoubert@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:10 <hnowlan@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2096 [production]
12:10 <hnowlan@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2096 [production]
12:10 <cgoubert@cumin1002> START - Cookbook sre.dns.netbox [production]
12:09 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2096 [production]
12:09 <hnowlan@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2096.codfw.wmnet 173.16.192.10.in-addr.arpa 3.7.1.0.6.1.0.0.2.9.1.0.0.1.0.0.2.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
12:09 <hnowlan@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker2096.codfw.wmnet 173.16.192.10.in-addr.arpa 3.7.1.0.6.1.0.0.2.9.1.0.0.1.0.0.2.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
12:09 <hnowlan@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:09 <hnowlan@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2096 - hnowlan@cumin1002" [production]
12:09 <hnowlan@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2096 - hnowlan@cumin1002" [production]
12:08 <jelto@cumin1002> START - Cookbook sre.hosts.reboot-single for host gerrit1003.wikimedia.org [production]
12:08 <hnowlan@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2095 [production]
12:08 <hnowlan@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2095 [production]
12:08 <moritzm> upgrade ganeti-test2003 to bookworm for some bullseye->bookworm VM migration tests [production]
12:08 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2095 [production]
12:08 <hnowlan@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2095.codfw.wmnet 222.16.192.10.in-addr.arpa 2.2.2.0.6.1.0.0.2.9.1.0.0.1.0.0.2.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
12:08 <hnowlan@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker2095.codfw.wmnet 222.16.192.10.in-addr.arpa 2.2.2.0.6.1.0.0.2.9.1.0.0.1.0.0.2.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
12:08 <hnowlan@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:08 <hnowlan@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2095 - hnowlan@cumin1002" [production]
12:06 <hnowlan@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2095 - hnowlan@cumin1002" [production]
12:05 <hnowlan@cumin1002> START - Cookbook sre.dns.netbox [production]
12:04 <cgoubert@cumin1002> START - Cookbook sre.hosts.rename from mw2334 to wikikube-worker2101 [production]
12:04 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gerrit1003.wikimedia.org with reason: Gerrit reboot [production]
12:03 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 0:15:00 on gerrit1003.wikimedia.org with reason: Gerrit reboot [production]
12:03 <jelto@cumin1002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:15:00 on gerrit.wikimedia.org with reason: Gerrit reboot [production]
12:03 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 0:15:00 on gerrit.wikimedia.org with reason: Gerrit reboot [production]