|
2019-09-25
ยง
|
| 09:18 |
<twentyafterfour@deploy1001> |
Started deploy [releng/phatality@8f05ba9]: (no justification provided) |
[production] |
| 09:16 |
<twentyafterfour@deploy1001> |
Finished deploy [releng/phatality@8f05ba9]: (no justification provided) (duration: 00m 54s) |
[production] |
| 09:15 |
<twentyafterfour@deploy1001> |
Started deploy [releng/phatality@8f05ba9]: (no justification provided) |
[production] |
| 09:07 |
<@> |
helmfile [CODFW] Ran 'sync' command on namespace 'restrouter' for release 'codfw' . |
[production] |
| 09:06 |
<@> |
helmfile [EQIAD] Ran 'sync' command on namespace 'restrouter' for release 'production' . |
[production] |
| 09:02 |
<@> |
helmfile [EQIAD] Ran 'sync' command on namespace 'restrouter' for release 'production' . |
[production] |
| 09:02 |
<@> |
helmfile [EQIAD] Ran 'sync' command on namespace 'restrouter' for release 'production' . |
[production] |
| 09:01 |
<@> |
helmfile [EQIAD] Ran 'sync' command on namespace 'restrouter' for release 'production' . |
[production] |
| 08:52 |
<godog> |
roll-restart kibana |
[production] |
| 08:50 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 08:50 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 08:48 |
<twentyafterfour@deploy1001> |
Finished deploy [releng/phatality@8f05ba9]: (no justification provided) (duration: 00m 05s) |
[production] |
| 08:48 |
<twentyafterfour@deploy1001> |
Started deploy [releng/phatality@8f05ba9]: (no justification provided) |
[production] |
| 08:48 |
<twentyafterfour@deploy1001> |
Finished deploy [releng/phatality@8f05ba9]: (no justification provided) (duration: 09m 26s) |
[production] |
| 08:44 |
<vgutierrez> |
repooling cp4027 - T233667 |
[production] |
| 08:39 |
<twentyafterfour@deploy1001> |
Started deploy [releng/phatality@8f05ba9]: (no justification provided) |
[production] |
| 07:51 |
<dcausse@deploy1001> |
Synchronized wmf-config/CirrusSearch-production.php: T233584 revert: [cirrus] temp disable sanity check (duration: 01m 05s) |
[production] |
| 07:38 |
<moritzm> |
installing emacs updates for buster (from SUA update, extended ELPA repository key) |
[production] |
| 07:28 |
<urbanecm@deploy1001> |
Synchronized static/images/mobile/copyright/: c761ec1: Revert "Add localized Wikipedia wordmark for szlwiki" (T233104) (duration: 01m 04s) |
[production] |
| 07:27 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: c761ec1: Revert "Add localized Wikipedia wordmark for szlwiki" (T233104) (duration: 01m 16s) |
[production] |
| 07:17 |
<onimisionipe> |
pool wdqs1005 to allow depooling wdqs1004 to handle lag issues |
[production] |
| 07:17 |
<elukey> |
allow analytics users to log in into stat1005 |
[production] |
| 06:33 |
<_joe_> |
restarting pybal on all low-traffic lbs |
[production] |
| 06:29 |
<@> |
helmfile [CODFW] Ran 'sync' command on namespace 'restrouter' for release 'codfw' . |
[production] |
| 06:29 |
<@> |
helmfile [EQIAD] Ran 'sync' command on namespace 'restrouter' for release 'production' . |
[production] |
| 06:21 |
<marostegui> |
Deploy schema change on db2085:3311 T233625 |
[production] |
| 06:20 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db2085:3311 T233625', diff saved to https://phabricator.wikimedia.org/P9171 and previous config saved to /var/cache/conftool/dbconfig/20190925-062036-marostegui.json |
[production] |
| 05:33 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 05:33 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 05:24 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 05:24 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 05:24 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 05:23 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 05:23 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 05:23 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 05:23 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 05:23 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 05:11 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 05:11 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 05:06 |
<marostegui> |
Run a data check on labsdb1011 - T233766 |
[production] |
| 04:43 |
<marostegui> |
Deploy schema change on s3 with replication - T231172 |
[production] |
| 03:28 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.34.0-wmf.24 refs T220749 |
[production] |
| 03:03 |
<krinkle@deploy1001> |
Synchronized docroot/noc/: c7c6c0ee0, 8405bf1c2 (duration: 01m 05s) |
[production] |
| 03:01 |
<krinkle@deploy1001> |
Synchronized src/: c7c6c0ee0, 8405bf1c2 (for noc.wm.o) (duration: 01m 09s) |
[production] |
| 02:58 |
<twentyafterfour> |
belatedly promoting wmf.24 to group0 refs T220749 |
[production] |
| 02:32 |
<onimisionipe> |
depool wdqs1005 to let it catch up with lag |
[production] |
| 02:30 |
<onimisionipe> |
pool wdqs1006 - it has caught up with lag |
[production] |
| 01:16 |
<mutante> |
stat1007 - restart nagios-nrpe-server, echo "please don't use all of the RAM on this server" | wall |
[production] |
| 01:14 |
<krinkle@deploy1001> |
Synchronized wmf-config/: 3373247e12 (duration: 01m 04s) |
[production] |
| 01:12 |
<krinkle@deploy1001> |
Synchronized src/WmfClusters.php: 3373247e123b (duration: 01m 04s) |
[production] |