5951-6000 of 10000 results (112ms)
2024-06-05 ยง
12:29 <mvernon@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1066.eqiad.wmnet [production]
12:29 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2065.codfw.wmnet [production]
12:27 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti6004.drmrs.wmnet [production]
12:26 <fabfur> disabling magru DC to apply IPIP encapsulation patches (T366466) [production]
12:21 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2065.codfw.wmnet [production]
12:20 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on dbstore1007.eqiad.wmnet with reason: Long schema change [production]
12:20 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 10:00:00 on dbstore1007.eqiad.wmnet with reason: Long schema change [production]
12:20 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2064.codfw.wmnet [production]
12:19 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6004.drmrs.wmnet [production]
12:17 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6003.drmrs.wmnet [production]
12:17 <mvernon@cumin1002> START - Cookbook sre.hosts.reboot-single for host ms-be1066.eqiad.wmnet [production]
12:16 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti6003.drmrs.wmnet [production]
12:16 <mvernon@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1065.eqiad.wmnet [production]
12:15 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host ping2004.codfw.wmnet with OS bookworm [production]
12:15 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM ping2004.codfw.wmnet - jmm@cumin2002" [production]
12:14 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2064.codfw.wmnet [production]
12:14 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM ping2004.codfw.wmnet - jmm@cumin2002" [production]
12:13 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) ping2004.codfw.wmnet on all recursors [production]
12:13 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache ping2004.codfw.wmnet on all recursors [production]
12:13 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:13 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM ping2004.codfw.wmnet - jmm@cumin2002" [production]
12:13 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2063.codfw.wmnet [production]
12:12 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM ping2004.codfw.wmnet - jmm@cumin2002" [production]
12:10 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti6003.drmrs.wmnet [production]
12:09 <mvernon@cumin1002> START - Cookbook sre.hosts.reboot-single for host ms-be1065.eqiad.wmnet [production]
12:08 <mvernon@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1064.eqiad.wmnet [production]
12:05 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
12:05 <jmm@cumin2002> START - Cookbook sre.ganeti.makevm for new host ping2004.codfw.wmnet [production]
12:04 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.resource-report (exit_code=0) [production]
12:04 <jmm@cumin2002> START - Cookbook sre.ganeti.resource-report [production]
12:03 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6003.drmrs.wmnet [production]
12:00 <mvernon@cumin1002> START - Cookbook sre.hosts.reboot-single for host ms-be1064.eqiad.wmnet [production]
12:00 <mvernon@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1063.eqiad.wmnet [production]
11:58 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2063.codfw.wmnet [production]
11:57 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2062.codfw.wmnet [production]
11:52 <mvernon@cumin1002> START - Cookbook sre.hosts.reboot-single for host ms-be1063.eqiad.wmnet [production]
11:50 <mvernon@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1062.eqiad.wmnet [production]
11:49 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2062.codfw.wmnet [production]
11:48 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2061.codfw.wmnet [production]
11:44 <jmm@cumin2002> END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling reboot on A:ldap-replicas-eqiad [production]
11:41 <mvernon@cumin1002> START - Cookbook sre.hosts.reboot-single for host ms-be1062.eqiad.wmnet [production]
11:41 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2061.codfw.wmnet [production]
11:39 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netbox-dev2002.codfw.wmnet [production]
11:39 <hnowlan@cumin1002> conftool action : set/weight=10:pooled=yes; selector: name=(wikikube-worker1008.eqiad.wmnet|wikikube-worker1009.eqiad.wmnet|wikikube-worker1010.eqiad.wmnet|wikikube-worker1011.eqiad.wmnet|wikikube-worker1012.eqiad.wmnet),cluster=kubernetes,service=kubesvc [production]
11:38 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host netbox-dev2002.codfw.wmnet [production]
11:38 <mvernon@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1061.eqiad.wmnet [production]
11:38 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2060.codfw.wmnet [production]
11:37 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1031.eqiad.wmnet with OS bullseye [production]
11:36 <jmm@cumin2002> START - Cookbook sre.ldap.roll-restart-reboot-replica rolling reboot on A:ldap-replicas-eqiad [production]
11:31 <hnowlan> running homer to configure bgp on 5 new k8s workers [production]