51-100 of 10000 results (37ms)
2026-07-28 §
11:55 <wmbot~dcaro@acme> END (FAIL) - Cookbook wmcs.openstack.get_project_for_proxy (exit_code=99) [admin]
11:55 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.get_project_for_proxy [admin]
11:55 <wmbot~dcaro@acme> END (FAIL) - Cookbook wmcs.openstack.get_project_for_proxy (exit_code=99) [admin]
11:55 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.get_project_for_proxy [admin]
03:13 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node [admin]
02:40 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=0) [admin]
02:07 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds [admin]
02:02 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=99) [admin]
01:57 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds [admin]
2026-07-27 §
22:33 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=99) [admin]
18:50 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds [admin]
18:49 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=99) [admin]
18:49 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds [admin]
16:26 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=99) [admin]
15:52 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds [admin]
15:51 <andrewbogott> temporarily muting ceph slow ops alerts ("ceph health mute BLUESTORE_SLOW_OP_ALERT --sticky") for T431659 [admin]
2026-07-24 §
15:10 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=0) [admin]
14:48 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds [admin]
2026-07-23 §
13:44 <andrewbogott> restarting designate services in eqiad1; seeing many miscellaneous designate-sink errors in logs [admin]
13:44 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment eqiad1 for service: project,designate [admin]
13:44 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for service: project,designate [admin]
2026-07-22 §
18:16 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1071.eqiad.wmnet' (T431374) [admin]
18:11 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1071.eqiad.wmnet' (T431374) [admin]
18:05 <andrewbogott> serveraction powercycle on cloudvirt1071 [admin]
18:04 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) (T431374) [admin]
18:03 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.set_maintenance (T431374) [admin]
12:46 <taavi> add security group rules for all projects for new metricsinfra VIPs T401813 [admin]
02:25 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for main branch [admin]
02:24 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for main branch [admin]
2026-07-21 §
15:28 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
15:27 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
15:27 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
15:27 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
15:23 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
15:22 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
15:22 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
15:21 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
15:20 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
15:20 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
15:11 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
15:10 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
15:07 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
15:06 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
14:38 <godog> switch from SystemdUnitDown (eqiad only) to SystemdUnitFailed (codfw/eqiad) alerts -- there might be some codfw noise coming - T428873 [admin]
2026-07-20 §
21:27 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
21:27 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
21:27 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
21:26 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
21:25 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
21:25 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]