|
2023-05-31
ยง
|
| 20:54 |
<zabe@deploy1002> |
zabe: Backport for [[gerrit:924605|Start reading from rev_comment_id everywhere (T299954)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet |
[production] |
| 20:52 |
<zabe@deploy1002> |
Started scap: Backport for [[gerrit:924605|Start reading from rev_comment_id everywhere (T299954)]] |
[production] |
| 20:40 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:925007|Fix description link icon positioning (T329364)]] (duration: 12m 51s) |
[production] |
| 20:30 |
<mforns@deploy1002> |
Finished deploy [analytics/refinery@04c11e6] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@04c11e6] (duration: 01m 29s) |
[production] |
| 20:28 |
<urbanecm@deploy1002> |
arlolra and urbanecm: Backport for [[gerrit:925007|Fix description link icon positioning (T329364)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet |
[production] |
| 20:28 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@04c11e6] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@04c11e6] |
[production] |
| 20:28 |
<mforns@deploy1002> |
Finished deploy [analytics/refinery@04c11e6] (thin): Regular analytics weekly train THIN [analytics/refinery@04c11e6] (duration: 00m 04s) |
[production] |
| 20:28 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@04c11e6] (thin): Regular analytics weekly train THIN [analytics/refinery@04c11e6] |
[production] |
| 20:27 |
<mforns@deploy1002> |
Finished deploy [analytics/refinery@04c11e6]: Regular analytics weekly train [analytics/refinery@04c11e6] (duration: 05m 53s) |
[production] |
| 20:27 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['dns1004'] |
[production] |
| 20:27 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:925007|Fix description link icon positioning (T329364)]] |
[production] |
| 20:26 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1004'] |
[production] |
| 20:26 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:923751|Enable EditInSequence for beta-testing on napwikisource (T337472)]] (duration: 10m 09s) |
[production] |
| 20:22 |
<mforns@deploy1002> |
Started deploy [analytics/refinery@04c11e6]: Regular analytics weekly train [analytics/refinery@04c11e6] |
[production] |
| 20:18 |
<urbanecm@deploy1002> |
soda and urbanecm: Backport for [[gerrit:923751|Enable EditInSequence for beta-testing on napwikisource (T337472)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet |
[production] |
| 20:17 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['dns1006'] |
[production] |
| 20:16 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['dns1005'] |
[production] |
| 20:16 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:923751|Enable EditInSequence for beta-testing on napwikisource (T337472)]] |
[production] |
| 20:15 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:924994|Enables ab test for multiple languages (T336969)]] (duration: 11m 56s) |
[production] |
| 20:10 |
<robh@cumin1001> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns1004'] |
[production] |
| 20:09 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1004'] |
[production] |
| 20:07 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1006'] |
[production] |
| 20:07 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1005'] |
[production] |
| 20:07 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['dns1004'] |
[production] |
| 20:05 |
<urbanecm@deploy1002> |
ksarabia and urbanecm: Backport for [[gerrit:924994|Enables ab test for multiple languages (T336969)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet |
[production] |
| 20:03 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:924994|Enables ab test for multiple languages (T336969)]] |
[production] |
| 19:57 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1004'] |
[production] |
| 19:55 |
<robh@cumin1001> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns1004'] |
[production] |
| 19:55 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1004'] |
[production] |
| 19:55 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['dns1004'] |
[production] |
| 19:54 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1004'] |
[production] |
| 19:54 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dns1006.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 19:54 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dns1005.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 19:54 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dns1004.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 19:20 |
<JustHann_> |
we started swapping in dumpsdata1006 as primary nfs dumps server, replacing dumpsdata1005 at 16:55 UTC and completed at 19:09 UTC |
[production] |
| 19:19 |
<robh@cumin1001> |
START - Cookbook sre.hosts.provision for host dns1006.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 19:18 |
<robh@cumin1001> |
START - Cookbook sre.hosts.provision for host dns1005.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 19:17 |
<robh@cumin1001> |
START - Cookbook sre.hosts.provision for host dns1004.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 19:16 |
<robh@cumin1001> |
END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts ['dns1004'] |
[production] |
| 19:16 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1004'] |
[production] |
| 19:14 |
<robh@cumin1001> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns1006'] |
[production] |
| 19:14 |
<robh@cumin1001> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns1005'] |
[production] |
| 19:14 |
<robh@cumin1001> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['dns1004'] |
[production] |
| 19:13 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1006'] |
[production] |
| 19:13 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1005'] |
[production] |
| 19:13 |
<robh@cumin1001> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns1004'] |
[production] |
| 19:12 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dns1006 |
[production] |
| 19:11 |
<robh@cumin1001> |
START - Cookbook sre.network.configure-switch-interfaces for host dns1006 |
[production] |
| 19:11 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dns1005 |
[production] |
| 19:10 |
<robh@cumin1001> |
START - Cookbook sre.network.configure-switch-interfaces for host dns1005 |
[production] |