101-150 of 10000 results (108ms)
2026-03-18 ยง
09:26 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1076.eqiad.wmnet [production]
09:26 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1075.eqiad.wmnet [production]
09:24 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1025.eqiad.wmnet [production]
09:24 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1025.eqiad.wmnet [production]
09:23 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2075.codfw.wmnet [production]
09:23 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2074.codfw.wmnet [production]
09:21 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netbox-dev2003.codfw.wmnet [production]
09:19 <jayme@cumin1003> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs [production]
09:18 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1075.eqiad.wmnet [production]
09:18 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1074.eqiad.wmnet [production]
09:17 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host netbox-dev2003.codfw.wmnet [production]
09:15 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1025.eqiad.wmnet [production]
09:15 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2074.codfw.wmnet [production]
09:15 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2073.codfw.wmnet [production]
09:14 <jayme@cumin1003> START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-staging-master-codfw@codfw [production]
09:14 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1025.eqiad.wmnet [production]
09:13 <klausman@cumin1003> START - Cookbook sre.cassandra.roll-reboot rolling reboot on A:ml-cache-codfw [production]
09:12 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1024.eqiad.wmnet [production]
09:12 <klausman@cumin1003> END (PASS) - Cookbook sre.cassandra.roll-reboot (exit_code=0) rolling reboot on A:ml-cache-eqiad [production]
09:12 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1024.eqiad.wmnet [production]
09:10 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1074.eqiad.wmnet [production]
09:10 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1073.eqiad.wmnet [production]
09:08 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2073.codfw.wmnet [production]
09:08 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2072.codfw.wmnet [production]
09:08 <slyngshede@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on 23 hosts with reason: Update ULSFO LVS service IPs [production]
09:06 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1024.eqiad.wmnet [production]
09:03 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1073.eqiad.wmnet [production]
09:03 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1072.eqiad.wmnet [production]
09:02 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2072.codfw.wmnet [production]
09:02 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2071.codfw.wmnet [production]
09:02 <slyngshede@cumin1003> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool ulsfo [reason: no reason specified, T418971] [production]
09:02 <slyngshede@cumin1003> START - Cookbook sre.dns.admin DNS admin: depool ulsfo [reason: no reason specified, T418971] [production]
09:01 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ping1004.eqiad.wmnet [production]
09:00 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1024.eqiad.wmnet [production]
08:58 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1023.eqiad.wmnet [production]
08:58 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1023.eqiad.wmnet [production]
08:57 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ping1004.eqiad.wmnet [production]
08:56 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1072.eqiad.wmnet [production]
08:56 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1071.eqiad.wmnet [production]
08:55 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2071.codfw.wmnet [production]
08:55 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2070.codfw.wmnet [production]
08:52 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1023.eqiad.wmnet [production]
08:50 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1023.eqiad.wmnet [production]
08:48 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1071.eqiad.wmnet [production]
08:47 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2070.codfw.wmnet [production]
08:46 <klausman@cumin1003> START - Cookbook sre.cassandra.roll-reboot rolling reboot on A:ml-cache-eqiad [production]
08:29 <hashar> Restarting CI Jenkins for plugin upgrade # T420347 [production]
08:22 <aklapper@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.46.0-wmf.20 refs T413811 [production]
07:45 <ayounsi@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 32934 [production]
07:42 <btullis@cumin1003> END (PASS) - Cookbook sre.hadoop.reboot-workers (exit_code=0) for Hadoop analytics cluster [production]