1651-1700 of 10000 results (94ms)
2024-06-03 ยง
14:54 <hashar@deploy1002> Started deploy [gerrit/gerrit@6ba3f2e]: Rebuild plugins for Java 17 - T364342 [production]
14:54 <cgoubert@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1004 [production]
14:53 <cgoubert@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1004 [production]
14:53 <cgoubert@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:53 <cgoubert@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1443 to wikikube-worker1004 - cgoubert@cumin1002" [production]
14:53 <hashar@deploy1002> Finished deploy [gerrit/gerrit@c93e47d]: Rebuild plugins for Java 17 - T364342 (duration: 00m 05s) [production]
14:53 <hashar@deploy1002> Started deploy [gerrit/gerrit@c93e47d]: Rebuild plugins for Java 17 - T364342 [production]
14:52 <Dreamy_Jazz> Afternoon UTC backport window done [production]
14:52 <cgoubert@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1443 to wikikube-worker1004 - cgoubert@cumin1002" [production]
14:51 <dreamyjazz@deploy1002> Finished scap: Backport for [[gerrit:1038310|Ensure excluded SHA-1s have numeric keys for scanFilesInScanTable.php (T366473)]] (duration: 12m 04s) [production]
14:45 <cgoubert@cumin1002> START - Cookbook sre.dns.netbox [production]
14:45 <cgoubert@cumin1002> START - Cookbook sre.hosts.rename from mw1443 to wikikube-worker1004 [production]
14:44 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw1427 to wikikube-worker1003 [production]
14:44 <cgoubert@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1003 [production]
14:43 <dreamyjazz@deploy1002> dreamyjazz: Continuing with sync [production]
14:42 <cgoubert@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:42 <cgoubert@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1003 [production]
14:42 <cgoubert@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1427 to wikikube-worker1003 - cgoubert@cumin1002" [production]
14:41 <dreamyjazz@deploy1002> dreamyjazz: Backport for [[gerrit:1038310|Ensure excluded SHA-1s have numeric keys for scanFilesInScanTable.php (T366473)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:41 <cgoubert@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1427 to wikikube-worker1003 - cgoubert@cumin1002" [production]
14:39 <dreamyjazz@deploy1002> Started scap: Backport for [[gerrit:1038310|Ensure excluded SHA-1s have numeric keys for scanFilesInScanTable.php (T366473)]] [production]
14:38 <cgoubert@cumin1002> START - Cookbook sre.dns.netbox [production]
14:38 <cgoubert@cumin1002> START - Cookbook sre.hosts.rename from mw1427 to wikikube-worker1003 [production]
14:38 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw1426 to wikikube-worker1002 [production]
14:38 <cgoubert@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1002 [production]
14:37 <cgoubert@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1002 [production]
14:37 <cgoubert@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:37 <cgoubert@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1426 to wikikube-worker1002 - cgoubert@cumin1002" [production]
14:35 <cgoubert@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1426 to wikikube-worker1002 - cgoubert@cumin1002" [production]
14:34 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts mw1358.eqiad.wmnet [production]
14:33 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw1358.eqiad.wmnet [production]
14:33 <vgutierrez> repool text@ulsfo with IPIP encapsulation enabled - T366466 [production]
14:31 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host snapshot1012.eqiad.wmnet with OS bullseye [production]
14:31 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts mw1358.eqiad.wmnet [production]
14:31 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw1358.eqiad.wmnet [production]
14:30 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts mw1358.eqiad.wmnet [production]
14:30 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw1358.eqiad.wmnet [production]
14:30 <jiji@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc-wf2001.codfw.wmnet with OS bookworm [production]
14:29 <cgoubert@cumin1002> START - Cookbook sre.dns.netbox [production]
14:29 <cgoubert@cumin1002> START - Cookbook sre.hosts.rename from mw1426 to wikikube-worker1002 [production]
14:28 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host snapshot1010.eqiad.wmnet with OS bullseye [production]
14:25 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc-wf1001.eqiad.wmnet with OS bookworm [production]
14:24 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hosts.rename (exit_code=99) from mw1358 to wikikube-worker1001 [production]
14:24 <cgoubert@cumin1002> START - Cookbook sre.hosts.rename from mw1358 to wikikube-worker1001 [production]
14:20 <logmsgbot> @deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:19 <logmsgbot> @deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:12 <jiji@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc-wf2001.codfw.wmnet with reason: host reimage [production]
14:09 <jiji@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mc-wf2001.codfw.wmnet with reason: host reimage [production]
14:08 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc-wf1001.eqiad.wmnet with reason: host reimage [production]
14:05 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on snapshot1012.eqiad.wmnet with reason: host reimage [production]