351-400 of 10000 results (122ms)
2026-05-19 ยง
14:22 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be1079.eqiad.wmnet [production]
14:22 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1078.eqiad.wmnet [production]
14:21 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2006.codfw.wmnet [production]
14:20 <cwilliams@cumin1003> START - Cookbook sre.hosts.reimage for host db2243.codfw.wmnet with OS trixie [production]
14:19 <root@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1204.eqiad.wmnet with OS trixie [production]
14:18 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2078.codfw.wmnet [production]
14:18 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2077.codfw.wmnet [production]
14:17 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2243: Upgrading db2243.codfw.wmnet [production]
14:16 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2243: Upgrading db2243.codfw.wmnet [production]
14:16 <cwilliams@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
14:16 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2006.codfw.wmnet [production]
14:16 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2005.codfw.wmnet [production]
14:16 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2005.codfw.wmnet [production]
14:14 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be1078.eqiad.wmnet [production]
14:14 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1077.eqiad.wmnet [production]
14:11 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2005.codfw.wmnet [production]
14:11 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2005.codfw.wmnet [production]
14:11 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2004.codfw.wmnet [production]
14:11 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2004.codfw.wmnet [production]
14:10 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2077.codfw.wmnet [production]
14:10 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2076.codfw.wmnet [production]
14:07 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be1077.eqiad.wmnet [production]
14:07 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1076.eqiad.wmnet [production]
14:07 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2004.codfw.wmnet [production]
14:07 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.roll-reboot (exit_code=0) rolling reboot on A:dnsbox and A:magru and (A:dnsbox) [production]
14:07 <sukhe@cumin1003> cookbooks.sre.dns.roll-reboot finished rebooting dns7002.wikimedia.org [production]
14:06 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2004.codfw.wmnet [production]
14:06 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2003.codfw.wmnet [production]
14:06 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2003.codfw.wmnet [production]
14:04 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6001.drmrs.wmnet [production]
14:04 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti6001.drmrs.wmnet [production]
14:02 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2076.codfw.wmnet [production]
14:02 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2003.codfw.wmnet [production]
14:02 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2075.codfw.wmnet [production]
14:02 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host dse-k8s-wdqs-test1001.eqiad.wmnet with OS bookworm [production]
14:02 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2003.codfw.wmnet [production]
14:02 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2002.codfw.wmnet [production]
14:02 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2002.codfw.wmnet [production]
14:01 <btullis@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dse-k8s-wdqs-test1001.eqiad.wmnet with OS bookworm [production]
14:01 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host dse-k8s-wdqs-test1001.eqiad.wmnet with OS bookworm [production]
13:59 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db[1204-1205].eqiad.wmnet with reason: restart/reimage [production]
13:57 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2002.codfw.wmnet [production]
13:57 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be1076.eqiad.wmnet [production]
13:57 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1075.eqiad.wmnet [production]
13:57 <sukhe@cumin1003> cookbooks.sre.dns.roll-reboot begin reboot of dns7002.wikimedia.org [production]
13:57 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2002.codfw.wmnet [production]
13:57 <elukey@cumin1003> START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:aux-worker-codfw [production]
13:55 <btullis@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dse-k8s-wdqs-test1001.eqiad.wmnet with OS bookworm [production]
13:55 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2075.codfw.wmnet [production]
13:55 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2074.codfw.wmnet [production]