6951-7000 of 10000 results (149ms)
2023-12-18 ยง
16:20 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2080'] [production]
16:18 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2078'] [production]
16:18 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2077'] [production]
16:18 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2076'] [production]
16:18 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2076'] [production]
16:17 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2075'] [production]
16:17 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2074'] [production]
16:17 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2079'] [production]
16:17 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2079'] [production]
16:16 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2078'] [production]
16:16 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2077'] [production]
16:16 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2075'] [production]
16:16 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2074'] [production]
16:16 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2080.mgmt.codfw.wmnet with reboot policy FORCED [production]
16:14 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2079.mgmt.codfw.wmnet with reboot policy FORCED [production]
16:02 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2076.mgmt.codfw.wmnet with reboot policy FORCED [production]
16:01 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2078.mgmt.codfw.wmnet with reboot policy FORCED [production]
16:01 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2077.mgmt.codfw.wmnet with reboot policy FORCED [production]
16:01 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2075.mgmt.codfw.wmnet with reboot policy FORCED [production]
16:01 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2074.mgmt.codfw.wmnet with reboot policy FORCED [production]
15:49 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2080.mgmt.codfw.wmnet with reboot policy FORCED [production]
15:49 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2079.mgmt.codfw.wmnet with reboot policy FORCED [production]
15:49 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2078.mgmt.codfw.wmnet with reboot policy FORCED [production]
15:49 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2077.mgmt.codfw.wmnet with reboot policy FORCED [production]
15:49 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2076.mgmt.codfw.wmnet with reboot policy FORCED [production]
15:49 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2075.mgmt.codfw.wmnet with reboot policy FORCED [production]
15:49 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-be2074.mgmt.codfw.wmnet with reboot policy FORCED [production]
15:42 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:42 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ms-be2074-2080 to codfw - jhancock@cumin2002" [production]
15:41 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ms-be2074-2080 to codfw - jhancock@cumin2002" [production]
15:37 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/services/recommendation-api: sync [production]
15:36 <elukey@deploy2002> helmfile [eqiad] START helmfile.d/services/recommendation-api: sync [production]
15:16 <fabfur> repooling cp4037 (T352876) [production]
15:16 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp4037.ulsfo.wmnet [production]
15:16 <fabfur@cumin1001> START - Cookbook sre.hosts.remove-downtime for cp4037.ulsfo.wmnet [production]
15:04 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:983229|Configure and enable StatsLib for production (T343024)]], [[gerrit:983529|Revert "util.main: Don't use mw.Map(), use a native Map() instead" (T353571 T353076)]] (duration: 10m 20s) [production]
14:58 <urbanecm@deploy2002> cwhite and urbanecm and chlod: Continuing with sync [production]
14:55 <urbanecm@deploy2002> cwhite and urbanecm and chlod: Backport for [[gerrit:983229|Configure and enable StatsLib for production (T343024)]], [[gerrit:983529|Revert "util.main: Don't use mw.Map(), use a native Map() instead" (T353571 T353076)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:53 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:983229|Configure and enable StatsLib for production (T343024)]], [[gerrit:983529|Revert "util.main: Don't use mw.Map(), use a native Map() instead" (T353571 T353076)]] [production]
14:52 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:981714|Enable action blocks for zhwiki (T353120)]] (duration: 08m 58s) [production]
14:47 <urbanecm@deploy2002> milkydefer and urbanecm: Continuing with sync [production]
14:45 <moritzm> installing nagios-plugins-contrib bugfix updates from Bookworm point release [production]
14:45 <moritzm> installing nagios-plugins-contrib bugfix updates [production]
14:44 <urbanecm@deploy2002> milkydefer and urbanecm: Backport for [[gerrit:981714|Enable action blocks for zhwiki (T353120)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:44 <mfossati@deploy2002> Finished deploy [airflow-dags/platform_eng@d275e4f]: (no justification provided) (duration: 00m 32s) [production]
14:44 <mfossati@deploy2002> Started deploy [airflow-dags/platform_eng@d275e4f]: (no justification provided) [production]
14:43 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:981714|Enable action blocks for zhwiki (T353120)]] [production]
14:43 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:982873|Add a testing stream for page-prediction-change events (T349919)]], [[gerrit:983178|CheckUser: Enable read new for event tables migration everywhere (T341829)]] (duration: 19m 00s) [production]
14:37 <urbanecm@deploy2002> dreamyjazz and aikochou and urbanecm: Continuing with sync [production]
14:36 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/services/recommendation-api: sync [production]