251-300 of 10000 results (112ms)
2026-05-21 ยง
11:39 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wikikube-worker-exp2001.codfw.wmnet [production]
11:38 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host testreduce1002.eqiad.wmnet [production]
11:37 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1049.eqiad.wmnet [production]
11:36 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc-misc1002.eqiad.wmnet [production]
11:36 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-misc1001.eqiad.wmnet [production]
11:35 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1038.eqiad.wmnet [production]
11:35 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging2001.codfw.wmnet [production]
11:35 <klausman@cumin1003> START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:ml-staging-worker [production]
11:35 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc-wf1002.eqiad.wmnet [production]
11:34 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1038.eqiad.wmnet [production]
11:34 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host testreduce1002.eqiad.wmnet [production]
11:33 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host wikikube-worker-exp2001.codfw.wmnet [production]
11:32 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-wf1001.eqiad.wmnet [production]
11:31 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc-misc1001.eqiad.wmnet [production]
11:30 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt-staging2001.codfw.wmnet [production]
11:30 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance es2037', diff saved to https://phabricator.wikimedia.org/P92759 and previous config saved to /var/cache/conftool/dbconfig/20260521-113028-fceratto.json [production]
11:27 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host maps2014.codfw.wmnet [production]
11:27 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1038.eqiad.wmnet [production]
11:26 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host apt-staging2001.codfw.wmnet [production]
11:26 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc-wf1001.eqiad.wmnet [production]
11:24 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1038.eqiad.wmnet [production]
11:24 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1034.eqiad.wmnet [production]
11:24 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1034.eqiad.wmnet [production]
11:20 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host maps2014.codfw.wmnet [production]
11:20 <slyngshede@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6013.drmrs.wmnet [production]
11:20 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance es2037 (T426633)', diff saved to https://phabricator.wikimedia.org/P92758 and previous config saved to /var/cache/conftool/dbconfig/20260521-112021-fceratto.json [production]
11:18 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1034.eqiad.wmnet [production]
11:14 <jmm@cumin2002> END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling reboot on A:ldap-replicas-eqiad [production]
11:13 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-jumbo1016.eqiad.wmnet with OS trixie [production]
11:12 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host maps2013.codfw.wmnet [production]
11:11 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1034.eqiad.wmnet [production]
11:09 <slyngshede@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp601[3-4].drmrs.wmnet} and A:cp [production]
11:08 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling es2037 (T426633)', diff saved to https://phabricator.wikimedia.org/P92757 and previous config saved to /var/cache/conftool/dbconfig/20260521-110851-fceratto.json [production]
11:08 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on es2037.codfw.wmnet with reason: Maintenance [production]
11:08 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance es2036 (T426633)', diff saved to https://phabricator.wikimedia.org/P92756 and previous config saved to /var/cache/conftool/dbconfig/20260521-110822-fceratto.json [production]
11:06 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1033.eqiad.wmnet [production]
11:06 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1033.eqiad.wmnet [production]
11:05 <jmm@cumin2002> START - Cookbook sre.ldap.roll-restart-reboot-replica rolling reboot on A:ldap-replicas-eqiad [production]
11:05 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host maps2013.codfw.wmnet [production]
11:04 <slyngshede@cumin1003> END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp600[5-6].drmrs.wmnet} and A:cp [production]
11:04 <slyngshede@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6006.drmrs.wmnet [production]
11:02 <jmm@cumin2002> END (PASS) - Cookbook sre.ldap.roll-restart-reboot-replica (exit_code=0) rolling reboot on A:ldap-replicas-codfw [production]
11:00 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1033.eqiad.wmnet [production]
10:59 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-jumbo1016.eqiad.wmnet with reason: host reimage [production]
10:58 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance es2036', diff saved to https://phabricator.wikimedia.org/P92753 and previous config saved to /var/cache/conftool/dbconfig/20260521-105815-fceratto.json [production]
10:57 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1033.eqiad.wmnet [production]
10:56 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1044.eqiad.wmnet [production]
10:56 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1044.eqiad.wmnet [production]
10:55 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-jumbo1016.eqiad.wmnet with reason: host reimage [production]
10:54 <jmm@cumin2002> START - Cookbook sre.ldap.roll-restart-reboot-replica rolling reboot on A:ldap-replicas-codfw [production]