|
2022-06-25
§
|
| 18:17 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1002.eqiad.wmnet |
[production] |
| 18:17 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1001.eqiad.wmnet |
[production] |
| 18:12 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host sretest1002.eqiad.wmnet |
[production] |
| 18:12 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host sretest1001.eqiad.wmnet |
[production] |
| 13:16 |
<elukey> |
restart rsyslog on ml-staging-ctrl200[1,2] - broken connections to centrallog |
[production] |
| 10:53 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 08m 27s) |
[production] |
| 10:45 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 10:44 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 01m 33s) |
[production] |
| 10:42 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 10:28 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 00m 18s) |
[production] |
| 10:28 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 10:25 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 00m 04s) |
[production] |
| 10:25 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 10:23 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 49m 58s) |
[production] |
| 09:54 |
<elukey> |
restart rsyslog on ml-serve-ctrl200[1,2] - broken connections to centrallog |
[production] |
| 09:33 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 09:32 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 00m 04s) |
[production] |
| 09:32 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
|
2022-06-24
§
|
| 19:35 |
<dancy@deploy1002> |
backport aborted: (duration: 00m 12s) |
[production] |
| 18:59 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:58 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:58 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:57 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:52 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:51 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:51 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:50 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 16:31 |
<sukhe> |
finished running homer * commit "adding sukhe" CR: 8071451 |
[production] |
| 15:18 |
<dancy@deploy1002> |
Finished deploy [integration/docroot@ea9b8fa]: (no justification provided) (duration: 00m 08s) |
[production] |
| 15:17 |
<dancy@deploy1002> |
Started deploy [integration/docroot@ea9b8fa]: (no justification provided) |
[production] |
| 15:07 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 14:57 |
<cmjohnson@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 14:54 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 00m 04s) |
[production] |
| 14:53 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 14:53 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 02m 37s) |
[production] |
| 14:50 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 14:48 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 00m 08s) |
[production] |
| 14:48 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 14:40 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 00m 07s) |
[production] |
| 14:40 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 14:39 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 00m 07s) |
[production] |
| 14:39 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |
| 14:35 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1113:3315 (re)pooling @ 100%: After kernel upgrade', diff saved to https://phabricator.wikimedia.org/P30242 and previous config saved to /var/cache/conftool/dbconfig/20220624-143544-root.json |
[production] |
| 14:35 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1113:3316 (re)pooling @ 100%: After kernel upgrade', diff saved to https://phabricator.wikimedia.org/P30241 and previous config saved to /var/cache/conftool/dbconfig/20220624-143537-root.json |
[production] |
| 14:31 |
<sukhe> |
running homer * commit "adding sukhe" CR: 807145 |
[production] |
| 14:23 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1114 (re)pooling @ 100%: After kernel upgrade', diff saved to https://phabricator.wikimedia.org/P30240 and previous config saved to /var/cache/conftool/dbconfig/20220624-142303-root.json |
[production] |
| 14:20 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1113:3315 (re)pooling @ 75%: After kernel upgrade', diff saved to https://phabricator.wikimedia.org/P30239 and previous config saved to /var/cache/conftool/dbconfig/20220624-142040-root.json |
[production] |
| 14:20 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1113:3316 (re)pooling @ 75%: After kernel upgrade', diff saved to https://phabricator.wikimedia.org/P30238 and previous config saved to /var/cache/conftool/dbconfig/20220624-142033-root.json |
[production] |
| 14:14 |
<bmansurov@deploy1002> |
Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 00m 07s) |
[production] |
| 14:14 |
<bmansurov@deploy1002> |
Started deploy [airflow-dags/research@b3fe77c]: (no justification provided) |
[production] |