5251-5300 of 10000 results (107ms)
2023-11-27 ยง
14:52 <jclark@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host an-worker1159 [production]
14:52 <jclark@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host an-worker1158 [production]
14:52 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2093'] [production]
14:52 <jclark@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host an-worker1158 [production]
14:52 <jclark@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host an-worker1157 [production]
14:52 <jclark@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host an-worker1157 [production]
14:52 <jclark@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host an-worker1160 [production]
14:52 <jclark@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host an-worker1160 [production]
14:52 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['elastic2088'] [production]
14:51 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic2091.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:51 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2092'] [production]
14:51 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['elastic2092'] [production]
14:51 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2092'] [production]
14:51 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirtlocal1001.eqiad.wmnet with OS bookworm [production]
14:50 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic2095.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:49 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2090'] [production]
14:49 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['elastic2090'] [production]
14:49 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2090'] [production]
14:48 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic2093.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:48 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic2092.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:48 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2089'] [production]
14:48 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['elastic2089'] [production]
14:47 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2089'] [production]
14:47 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['elastic2087'] [production]
14:46 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic2090.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:46 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host dns4003.wikimedia.org [production]
14:46 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2088'] [production]
14:46 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['elastic2088'] [production]
14:45 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic2089.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:45 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2088'] [production]
14:44 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic2088.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:43 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:977121|Enable native MathML rendering on dewiki (T350787)]] (duration: 09m 19s) [production]
14:43 <bking@cumin1001> END (ERROR) - Cookbook sre.wdqs.data-reload (exit_code=97) [production]
14:41 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2087'] [production]
14:40 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['elastic2087'] [production]
14:40 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2087'] [production]
14:39 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host elastic2096.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:38 <jforrester@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
14:38 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host elastic2095.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:38 <jforrester@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
14:38 <urbanecm@deploy2002> urbanecm and physikerwelt: Continuing with sync [production]
14:38 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host elastic2094.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:37 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host elastic2087.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:37 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host elastic2093.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:36 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host elastic2092.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:35 <urbanecm@deploy2002> urbanecm and physikerwelt: Backport for [[gerrit:977121|Enable native MathML rendering on dewiki (T350787)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:35 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host elastic2091.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:34 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:977121|Enable native MathML rendering on dewiki (T350787)]] [production]
14:34 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host elastic2090.mgmt.codfw.wmnet with reboot policy FORCED [production]
14:34 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:975377|bjnwikiquote: add timezone, wgSitename (T350235)]], [[gerrit:975594|dgawiki: add logos, timezone and sitename (T350229)]] (duration: 10m 57s) [production]