|
2022-01-18
ยง
|
| 23:11 |
<jhathaway> |
rebooting mx1001 to revert to the old kernel |
[production] |
| 22:59 |
<sbassett> |
Deployed security patch for T298434 to 1.38.0-wmf.18 |
[production] |
| 22:57 |
<sbassett> |
Deployed security patch for T298434 to 1.380-wmf.17 |
[production] |
| 21:42 |
<jhuneidi@deploy1002> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.38.0-wmf.18 refs T293959 |
[production] |
| 21:29 |
<jhuneidi@deploy1002> |
Finished scap: testwikis to 1.38.0-wmf.18 refs T293959 (duration: 38m 31s) |
[production] |
| 21:26 |
<jhathaway> |
rebooting mx1001, to test new kernel |
[production] |
| 20:50 |
<jhuneidi@deploy1002> |
Started scap: testwikis to 1.38.0-wmf.18 refs T293959 |
[production] |
| 20:50 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 20:49 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 20:49 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 20:48 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 20:43 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 20:42 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 20:42 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 20:41 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 20:25 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 20:24 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 20:24 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 20:23 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 18:27 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 18:26 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 18:26 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 18:25 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 18:20 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 18:20 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 0ff5874469b717cba38ed7cff0669754517a3553: pwnwiki: Deploy Growth features to newcomers (T298115) (duration: 02m 14s) |
[production] |
| 18:18 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 18:18 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 18:17 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 17:57 |
<dcausse> |
restarting blazegraph on wdqs1007 (jvm stuck for 13hours) |
[production] |
| 17:37 |
<hashar> |
restarted zuul on contint2001 |
[production] |
| 17:16 |
<moritzm> |
installing gmp security updates |
[production] |
| 16:53 |
<klausman@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve2001.codfw.wmnet |
[production] |
| 16:53 |
<hnowlan@cumin1001> |
START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster |
[production] |
| 16:52 |
<hashar> |
contint2001: restarted ferm service |
[production] |
| 16:49 |
<hnowlan@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host restbase2010.codfw.wmnet with OS buster |
[production] |
| 16:48 |
<hnowlan@cumin1001> |
START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster |
[production] |
| 16:47 |
<hnowlan@cumin1001> |
END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host restbase2010.codfw.wmnet with OS buster |
[production] |
| 16:45 |
<klausman@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host ml-serve2001.codfw.wmnet |
[production] |
| 16:21 |
<hnowlan@cumin1001> |
START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster |
[production] |
| 16:14 |
<hnowlan@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host restbase2010.codfw.wmnet with OS buster |
[production] |
| 16:13 |
<hnowlan@cumin1001> |
START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster |
[production] |
| 16:11 |
<hnowlan@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host restbase2010.codfw.wmnet with OS buster |
[production] |
| 16:10 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. |
[production] |
| 16:09 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. |
[production] |
| 16:07 |
<hnowlan@cumin1001> |
START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster |
[production] |
| 16:03 |
<moritzm> |
installing xen security updates on buster (client-side libraries) |
[production] |
| 15:59 |
<hashar> |
Shutting down CI for maintenance on contint2001 # T283582 |
[production] |
| 15:54 |
<godog> |
update kartotherian certs on maps hosts and roll-reload nginx - T297604 |
[production] |
| 15:54 |
<moritzm> |
installing libssh2 security updates on stretch |
[production] |
| 15:50 |
<aqu@deploy1002> |
Finished deploy [airflow-dags/analytics-test@3ad07a0]: (no justification provided) (duration: 00m 09s) |
[production] |