|
2023-12-18
ยง
|
| 16:20 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2079'] |
[production] |
| 16:20 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['ms-be2079'] |
[production] |
| 16:20 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2080'] |
[production] |
| 16:18 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2078'] |
[production] |
| 16:18 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2077'] |
[production] |
| 16:18 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2076'] |
[production] |
| 16:18 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2076'] |
[production] |
| 16:17 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2075'] |
[production] |
| 16:17 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['ms-be2074'] |
[production] |
| 16:17 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2079'] |
[production] |
| 16:17 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2079'] |
[production] |
| 16:16 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2078'] |
[production] |
| 16:16 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2077'] |
[production] |
| 16:16 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2075'] |
[production] |
| 16:16 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-be2074'] |
[production] |
| 16:16 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2080.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 16:14 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2079.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 16:02 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2076.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 16:01 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2078.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 16:01 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2077.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 16:01 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2075.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 16:01 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2074.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 15:49 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ms-be2080.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 15:49 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ms-be2079.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 15:49 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ms-be2078.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 15:49 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ms-be2077.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 15:49 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ms-be2076.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 15:49 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ms-be2075.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 15:49 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ms-be2074.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 15:42 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 15:42 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ms-be2074-2080 to codfw - jhancock@cumin2002" |
[production] |
| 15:41 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ms-be2074-2080 to codfw - jhancock@cumin2002" |
[production] |
| 15:37 |
<elukey@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/recommendation-api: sync |
[production] |
| 15:36 |
<elukey@deploy2002> |
helmfile [eqiad] START helmfile.d/services/recommendation-api: sync |
[production] |
| 15:16 |
<fabfur> |
repooling cp4037 (T352876) |
[production] |
| 15:16 |
<fabfur@cumin1001> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp4037.ulsfo.wmnet |
[production] |
| 15:16 |
<fabfur@cumin1001> |
START - Cookbook sre.hosts.remove-downtime for cp4037.ulsfo.wmnet |
[production] |
| 15:04 |
<urbanecm@deploy2002> |
Finished scap: Backport for [[gerrit:983229|Configure and enable StatsLib for production (T343024)]], [[gerrit:983529|Revert "util.main: Don't use mw.Map(), use a native Map() instead" (T353571 T353076)]] (duration: 10m 20s) |
[production] |
| 14:58 |
<urbanecm@deploy2002> |
cwhite and urbanecm and chlod: Continuing with sync |
[production] |
| 14:55 |
<urbanecm@deploy2002> |
cwhite and urbanecm and chlod: Backport for [[gerrit:983229|Configure and enable StatsLib for production (T343024)]], [[gerrit:983529|Revert "util.main: Don't use mw.Map(), use a native Map() instead" (T353571 T353076)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 14:53 |
<urbanecm@deploy2002> |
Started scap: Backport for [[gerrit:983229|Configure and enable StatsLib for production (T343024)]], [[gerrit:983529|Revert "util.main: Don't use mw.Map(), use a native Map() instead" (T353571 T353076)]] |
[production] |
| 14:52 |
<urbanecm@deploy2002> |
Finished scap: Backport for [[gerrit:981714|Enable action blocks for zhwiki (T353120)]] (duration: 08m 58s) |
[production] |
| 14:47 |
<urbanecm@deploy2002> |
milkydefer and urbanecm: Continuing with sync |
[production] |
| 14:45 |
<moritzm> |
installing nagios-plugins-contrib bugfix updates from Bookworm point release |
[production] |
| 14:45 |
<moritzm> |
installing nagios-plugins-contrib bugfix updates |
[production] |
| 14:44 |
<urbanecm@deploy2002> |
milkydefer and urbanecm: Backport for [[gerrit:981714|Enable action blocks for zhwiki (T353120)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 14:44 |
<mfossati@deploy2002> |
Finished deploy [airflow-dags/platform_eng@d275e4f]: (no justification provided) (duration: 00m 32s) |
[production] |
| 14:44 |
<mfossati@deploy2002> |
Started deploy [airflow-dags/platform_eng@d275e4f]: (no justification provided) |
[production] |
| 14:43 |
<urbanecm@deploy2002> |
Started scap: Backport for [[gerrit:981714|Enable action blocks for zhwiki (T353120)]] |
[production] |
| 14:43 |
<urbanecm@deploy2002> |
Finished scap: Backport for [[gerrit:982873|Add a testing stream for page-prediction-change events (T349919)]], [[gerrit:983178|CheckUser: Enable read new for event tables migration everywhere (T341829)]] (duration: 19m 00s) |
[production] |