1651-1700 of 10000 results (39ms)
2023-10-09 ยง
14:02 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1104.eqiad.wmnet [production]
13:55 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2113.codfw.wmnet with reason: Maintenance [production]
13:55 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2113.codfw.wmnet with reason: Maintenance [production]
13:55 <wm-bot2> fran@wmf3169 END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) (T341285) [admin]
13:54 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1104.eqiad.wmnet [production]
13:54 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1103.eqiad.wmnet [production]
13:48 <jbond@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:48 <jbond@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:48 <jbond@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:47 <jbond@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:47 <jbond@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:46 <jbond@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:46 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1103.eqiad.wmnet [production]
13:46 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1102.eqiad.wmnet [production]
13:46 <jbond@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:46 <jbond@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:46 <jbond@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:45 <wm-bot2> fran@wmf3169 START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (T341285) [admin]
13:43 <jbond@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sretest1001.eqiad.wmnet [production]
13:40 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1102.eqiad.wmnet [production]
13:40 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1101.eqiad.wmnet [production]
13:38 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.ceph.osd.undrain_node [admin]
13:35 <volans> uploaded spicerack_7.4.0 to apt.wikimedia.org bullseye-wikimedia [production]
13:32 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1101.eqiad.wmnet [production]
13:32 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1100.eqiad.wmnet [production]
13:24 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1100.eqiad.wmnet [production]
13:23 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1099.eqiad.wmnet [production]
13:16 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1099.eqiad.wmnet [production]
13:16 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1098.eqiad.wmnet [production]
13:13 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
13:12 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.ceph.osd.undrain_node [admin]
13:06 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1098.eqiad.wmnet [production]
13:06 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1097.eqiad.wmnet [production]
13:04 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
12:58 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1097.eqiad.wmnet [production]
12:58 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1095.eqiad.wmnet [production]
12:52 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1095.eqiad.wmnet [production]
12:52 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1094.eqiad.wmnet [production]
12:46 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1094.eqiad.wmnet [production]
12:46 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1093.eqiad.wmnet [production]
12:40 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1093.eqiad.wmnet [production]
12:40 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1092.eqiad.wmnet [production]
12:35 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1092.eqiad.wmnet [production]
12:35 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1091.eqiad.wmnet [production]
12:33 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.ceph.osd.undrain_node [admin]
12:28 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1091.eqiad.wmnet [production]
12:28 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1090.eqiad.wmnet [production]
12:23 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1090.eqiad.wmnet [production]
12:23 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1089.eqiad.wmnet [production]
12:16 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1089.eqiad.wmnet [production]