|
2023-09-20
§
|
| 00:54 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pki1002.eqiad.wmnet with reason: host reimage |
[production] |
| 00:51 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on pki1002.eqiad.wmnet with reason: host reimage |
[production] |
| 00:38 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host pki1002.eqiad.wmnet with OS bullseye |
[production] |
| 00:10 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['db1232'] |
[production] |
| 00:10 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['db1233'] |
[production] |
| 00:09 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['db1231'] |
[production] |
| 00:02 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['db1229'] |
[production] |
| 00:01 |
<jclark@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['db1233'] |
[production] |
| 00:01 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['db1230'] |
[production] |
| 00:01 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['db1228'] |
[production] |
| 00:01 |
<jclark@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['db1232'] |
[production] |
| 00:00 |
<jclark@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['db1231'] |
[production] |
| 00:00 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['db1227'] |
[production] |
| 00:00 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['db1226'] |
[production] |
|
2023-09-19
§
|
| 23:52 |
<jclark@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['db1230'] |
[production] |
| 23:52 |
<jclark@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['db1229'] |
[production] |
| 23:52 |
<jclark@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['db1228'] |
[production] |
| 23:51 |
<jclark@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['db1227'] |
[production] |
| 23:51 |
<jclark@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['db1226'] |
[production] |
| 23:51 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1229.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 23:31 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1229.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 23:30 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 23:29 |
<jclark@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 23:26 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1232.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 23:18 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1233.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 23:18 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1231.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:58 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1233.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:58 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1232.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:58 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1231.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:57 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1228.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:57 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1230.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:56 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1227.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:56 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1226.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:54 |
<jclark@cumin1001> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db1229.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:51 |
<bearloga@deploy2002> |
Finished deploy [airflow-dags/analytics_product@b603e64]: (no justification provided) (duration: 00m 05s) |
[production] |
| 22:51 |
<bearloga@deploy2002> |
Started deploy [airflow-dags/analytics_product@b603e64]: (no justification provided) |
[production] |
| 22:46 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1229.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 22:45 |
<jclark@cumin1001> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db1229.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 21:50 |
<brennen@deploy2002> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.27 refs T345888 |
[production] |
| 21:49 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1227.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 21:49 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1228.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 21:49 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1230.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 21:49 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1229.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 21:49 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.provision for host db1226.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 21:48 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host db1232 |
[production] |
| 21:47 |
<jclark@cumin1001> |
START - Cookbook sre.network.configure-switch-interfaces for host db1232 |
[production] |
| 21:46 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 21:45 |
<jclark@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 21:41 |
<brennen> |
train 1.41.0-wmf.27 (T345888): blockers resolved; rolling to group0 |
[production] |
| 21:37 |
<brennen@deploy2002> |
Finished scap: Backport for [[gerrit:959013|Disable client preferences by default (T345363)]] (duration: 40m 45s) |
[production] |