1-50 of 10000 results (36ms)
2026-07-24 ยง
11:33 <fnegri@cumin1003> END (FAIL) - Cookbook sre.mysql.multiinstance_reboot (exit_code=99) for 7 hosts [production]
11:11 <fnegri@cumin1003> START - Cookbook sre.mysql.multiinstance_reboot for 7 hosts [production]
10:56 <fnegri@cumin1003> END (FAIL) - Cookbook sre.mysql.multiinstance_reboot (exit_code=99) for 7 hosts [production]
10:47 <fnegri@cumin1003> START - Cookbook sre.mysql.multiinstance_reboot for 7 hosts [production]
10:44 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2010.codfw.wmnet with OS trixie [production]
10:44 <elukey@cumin1003> START - Cookbook sre.hosts.reimage for host sretest2010.codfw.wmnet with OS trixie [production]
10:41 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2010.codfw.wmnet with OS trixie [production]
10:41 <elukey@cumin1003> START - Cookbook sre.hosts.reimage for host sretest2010.codfw.wmnet with OS trixie [production]
10:35 <fnegri@cumin1003> END (FAIL) - Cookbook sre.mysql.multiinstance_reboot (exit_code=99) for 8 hosts [production]
10:34 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2010.codfw.wmnet with OS trixie [production]
10:33 <elukey@cumin1003> START - Cookbook sre.hosts.reimage for host sretest2010.codfw.wmnet with OS trixie [production]
10:32 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2010.codfw.wmnet with OS trixie [production]
10:32 <elukey@cumin1003> START - Cookbook sre.hosts.reimage for host sretest2010.codfw.wmnet with OS trixie [production]
10:31 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2010.codfw.wmnet with OS trixie [production]
10:31 <elukey@cumin1003> START - Cookbook sre.hosts.reimage for host sretest2010.codfw.wmnet with OS trixie [production]
10:30 <fnegri@cumin1003> START - Cookbook sre.mysql.multiinstance_reboot for 8 hosts [production]
10:24 <elukey@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest2010.codfw.wmnet with OS trixie [production]
10:19 <elukey@cumin1003> START - Cookbook sre.hosts.reimage for host sretest2010.codfw.wmnet with OS trixie [production]
10:18 <fnegri@cumin1003> END (FAIL) - Cookbook sre.mysql.multiinstance_reboot (exit_code=99) for 16 hosts [production]
10:17 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-serve-ctrl2001.codfw.wmnet [production]
10:13 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-serve-ctrl2001.codfw.wmnet [production]
10:11 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-staging-ctrl2001.codfw.wmnet [production]
10:02 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-staging-ctrl2001.codfw.wmnet [production]
10:02 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-staging-ctrl2002.codfw.wmnet [production]
09:57 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-staging-ctrl2002.codfw.wmnet [production]
09:56 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-serve-ctrl2002.codfw.wmnet [production]
09:51 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-serve-ctrl2002.codfw.wmnet [production]
09:51 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-serve-ctrl1002.eqiad.wmnet [production]
09:47 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-serve-ctrl1002.eqiad.wmnet [production]
09:47 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-serve-ctrl1001.eqiad.wmnet [production]
09:44 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-serve-ctrl1001.eqiad.wmnet [production]
09:34 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-staging-etcd2003.codfw.wmnet [production]
09:32 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-staging-etcd2003.codfw.wmnet [production]
09:32 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-staging-etcd2002.codfw.wmnet [production]
09:30 <brouberol@dns1004> END - running authdns-update [production]
09:29 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-staging-etcd2002.codfw.wmnet [production]
09:29 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-staging-etcd2001.codfw.wmnet [production]
09:27 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.bmc-user-mgmt (exit_code=0) for 9 hosts [production]
09:27 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-staging-etcd2001.codfw.wmnet [production]
09:27 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-etcd2001.codfw.wmnet [production]
09:26 <elukey@cumin1003> START - Cookbook sre.hosts.bmc-user-mgmt for 9 hosts [production]
09:26 <brouberol@dns1004> START - running authdns-update [production]
09:25 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.bmc-user-mgmt (exit_code=0) for 57 hosts [production]
09:24 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-etcd2001.codfw.wmnet [production]
09:24 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-etcd2002.codfw.wmnet [production]
09:22 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-etcd2002.codfw.wmnet [production]
09:21 <elukey@cumin1003> START - Cookbook sre.hosts.bmc-user-mgmt for 57 hosts [production]
09:20 <klausman@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM ml-etcd2003.codfw.wmnet [production]
09:19 <fnegri@cumin1003> START - Cookbook sre.mysql.multiinstance_reboot for 16 hosts [production]
09:16 <klausman@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM ml-etcd2003.codfw.wmnet [production]