51-100 of 10000 results (87ms)
2024-09-06 ยง
15:39 <kamila@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:39 <kamila@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2103 - kamila@cumin1002" [production]
15:39 <kamila@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2103 - kamila@cumin1002" [production]
15:34 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:34 <kamila@cumin1002> START - Cookbook sre.dns.netbox [production]
15:32 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2103 [production]
15:32 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2103.codfw.wmnet with OS bullseye [production]
15:31 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:29 <kamila@cumin1002> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker2103.codfw.wmnet [production]
15:28 <kamila@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2103.codfw.wmnet on all recursors [production]
15:28 <kamila@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker2103.codfw.wmnet on all recursors [production]
15:27 <mutante> rolling restarts on durum machines [production]
15:27 <elukey@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=93) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:27 <dzahn@cumin2002> START - Cookbook sre.dns.roll-restart-reboot-durum rolling reboot on A:durum and A:durum [production]
15:24 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw2430 to wikikube-worker2103 [production]
15:23 <kamila@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2103 [production]
15:23 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:22 <kamila@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2103 [production]
15:22 <kamila@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:22 <kamila@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2430 to wikikube-worker2103 - kamila@cumin1002" [production]
15:19 <kamila@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2430 to wikikube-worker2103 - kamila@cumin1002" [production]
15:16 <kamila@cumin1002> START - Cookbook sre.dns.netbox [production]
15:15 <kamila@cumin1002> START - Cookbook sre.hosts.rename from mw2430 to wikikube-worker2103 [production]
15:14 <topranks> disabling PyBal on lvs1017 to shift traffic to lvs1020 and allow work to fix faulty fibre link T374247 [production]
15:13 <cmooney@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs1017.eqiad.wmnet with reason: Move traffic off lvs1017 to lvs1020 to troubleshooot faulty link [production]
15:13 <cmooney@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on lvs1017.eqiad.wmnet with reason: Move traffic off lvs1017 to lvs1020 to troubleshooot faulty link [production]
15:07 <kamila@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2430.codfw.wmnet [production]
15:07 <kamila@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2430.codfw.wmnet [production]
15:02 <hnowlan@cumin1002> END (PASS) - Cookbook sre.k8s.renumber-node (exit_code=0) Renumbering for host wikikube-worker2098.codfw.wmnet [production]
15:02 <hnowlan@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2098.codfw.wmnet [production]
15:02 <hnowlan@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2098.codfw.wmnet [production]
14:52 <hnowlan@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2098.codfw.wmnet with OS bullseye [production]
14:51 <btullis@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database bdrwiki (T371759) [production]
14:44 <hnowlan@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2095.codfw.wmnet with OS bullseye [production]
14:42 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=99) Renumbering for host wikikube-worker2095.codfw.wmnet [production]
14:42 <hnowlan@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2095.codfw.wmnet with OS bullseye [production]
14:42 <hnowlan@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2095.codfw.wmnet with OS bullseye [production]
14:42 <hnowlan@cumin1002> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker2095.codfw.wmnet [production]
14:41 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubestage2001.codfw.wmnet with OS bookworm [production]
14:28 <akosiaris> repool kubernetes1059 T365993 [production]
14:28 <akosiaris@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubernetes1059.eqiad.wmnet [production]
14:27 <akosiaris@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host kubernetes1059.eqiad.wmnet [production]
14:25 <btullis@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database bdrwiki (T371759) [production]
14:23 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubestage2001.codfw.wmnet with reason: host reimage [production]
14:20 <jayme@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on kubestage2001.codfw.wmnet with reason: host reimage [production]
14:17 <jayme@cumin1002> END (PASS) - Cookbook sre.k8s.renumber-node (exit_code=0) Renumbering for host wikikube-worker2102.codfw.wmnet [production]
14:17 <jayme@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2102.codfw.wmnet [production]
14:17 <jayme@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2102.codfw.wmnet [production]
14:13 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2102.codfw.wmnet with OS bullseye [production]
14:10 <akosiaris> restart pybal on lvs1019 [production]