51-100 of 10000 results (20ms)
2025-07-10 ยง
22:00 <andrew@cumin2002> START - Cookbook sre.hosts.reboot-single for host cloudcephosd1036.eqiad.wmnet [production]
21:55 <andrew@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1036.eqiad.wmnet [production]
21:48 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
21:47 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
21:32 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1035.eqiad.wmnet with OS bookworm [production]
21:12 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1035.eqiad.wmnet with reason: host reimage [production]
21:06 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1035.eqiad.wmnet with reason: host reimage [production]
20:54 <jforrester@deploy1003> Finished scap sync-world: Backport for [[gerrit:1137480|Use `sul` dblist in InitialiseSettings]] (duration: 11m 43s) [production]
20:48 <jforrester@deploy1003> jforrester, bd808: Continuing with sync [production]
20:44 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1035.eqiad.wmnet with OS bookworm [production]
20:44 <jforrester@deploy1003> jforrester, bd808: Backport for [[gerrit:1137480|Use `sul` dblist in InitialiseSettings]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:42 <andrew@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
20:42 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1137480|Use `sul` dblist in InitialiseSettings]] [production]
20:41 <andrew@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
20:39 <robh@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
20:39 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcephosd1035.eqiad.wmnet [production]
20:25 <root@cumin1003> END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
20:25 <root@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
20:25 <robh@cumin2002> START - Cookbook sre.hosts.reboot-single for host cloudcephosd1035.eqiad.wmnet [production]
20:24 <root@cumin1003> END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
20:24 <root@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
20:21 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
20:14 <aqu@deploy1003> Finished deploy [airflow-dags/analytics@c558ea4]: Artifactct analytics / main (duration: 00m 43s) [production]
20:13 <aqu@deploy1003> Started deploy [airflow-dags/analytics@c558ea4]: Artifactct analytics / main [production]
20:12 <aqu@deploy1003> Finished deploy [airflow-dags/analytics_test@c558ea4]: Artifactct analytics-test (duration: 00m 13s) [production]
20:12 <aqu@deploy1003> Started deploy [airflow-dags/analytics_test@c558ea4]: Artifactct analytics-test [production]
19:59 <wmbot~lucaswerkmeister@tools-bastion-13> deployed 8c32f8b90c (l10n updates: hu) [tools.lexeme-forms]
19:52 <wmbot~lucaswerkmeister@tools-bastion-13> deployed b2bc6237f0 (l10n updates: hu) [tools.wd-image-positions]
19:46 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1048.eqiad.wmnet with OS bookworm [production]
19:28 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1048.eqiad.wmnet with reason: host reimage [production]
19:22 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1048.eqiad.wmnet with reason: host reimage [production]
19:07 <root@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
19:07 <root@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
19:05 <root@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
19:05 <root@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
19:02 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host cloudcephosd1048.eqiad.wmnet with OS bookworm [production]
19:01 <root@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
19:01 <root@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
19:00 <root@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cloudcephosd1006.eqiad.wmnet'] [production]
19:00 <root@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudcephosd1006.eqiad.wmnet'] [production]
19:00 <root@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cloudcephosd1035.eqiad.wmnet'] [production]
19:00 <root@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudcephosd1035.eqiad.wmnet'] [production]
18:59 <andrew@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=93) for host cloudcephosd1048.eqiad.wmnet with OS bookworm [production]
18:58 <root@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
18:58 <root@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
18:50 <andrew@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
18:50 <andrew@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
18:50 <andrew@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
18:50 <andrew@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]
18:49 <andrew@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cloudcephosd1035.eqiad.wmnet [production]