3251-3300 of 10000 results (96ms)
2023-11-21 ยง
18:30 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
18:29 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:976291|Undeploy DoubleWiki, Part III (T351675)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
18:18 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host an-worker1157.eqiad.wmnet with OS bullseye [production]
18:16 <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:976291|Undeploy DoubleWiki, Part III (T351675)]] [production]
18:15 <jynus> restart of bacula-sd on backup1009 T351725 [production]
18:13 <jclark@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['an-worker1158'] [production]
18:13 <jclark@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['an-worker1158'] [production]
18:11 <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:976288|Undeploy DoubleWiki, Part II (T351675)]] (duration: 08m 24s) [production]
18:06 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
18:04 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:976288|Undeploy DoubleWiki, Part II (T351675)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
18:03 <robh@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:03 <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:976288|Undeploy DoubleWiki, Part II (T351675)]] [production]
18:02 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
18:02 <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:975912|Undeploy DoubleWiki, Part I (T351675)]] (duration: 08m 27s) [production]
17:59 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:59 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updating restbase servers in codfw - jhancock@cumin2002" [production]
17:58 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updating restbase servers in codfw - jhancock@cumin2002" [production]
17:56 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
17:56 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
17:54 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:975912|Undeploy DoubleWiki, Part I (T351675)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
17:54 <jclark@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['an-worker1174'] [production]
17:53 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1174'] [production]
17:53 <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:975912|Undeploy DoubleWiki, Part I (T351675)]] [production]
17:49 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1173'] [production]
17:46 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1170'] [production]
17:44 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1169'] [production]
17:44 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1168'] [production]
17:44 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1167'] [production]
17:43 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1174'] [production]
17:43 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1172'] [production]
17:42 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1173'] [production]
17:42 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1172'] [production]
17:42 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1171'] [production]
17:42 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1171'] [production]
17:40 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1172'] [production]
17:40 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1172'] [production]
17:40 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1166'] [production]
17:40 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1171'] [production]
17:40 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1171'] [production]
17:40 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1171'] [production]
17:40 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1171'] [production]
17:40 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1170'] [production]
17:39 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1164'] [production]
17:39 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1165'] [production]
17:38 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1169'] [production]
17:38 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1168'] [production]
17:38 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1167'] [production]
17:38 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1160'] [production]
17:38 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1159'] [production]
17:37 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1163'] [production]