|
2022-05-31
§
|
| 21:26 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:26 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:26 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1167.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:26 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1167.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:26 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1178 (T60674)', diff saved to https://phabricator.wikimedia.org/P29271 and previous config saved to /var/cache/conftool/dbconfig/20220531-212610-ladsgroup.json |
[production] |
| 21:11 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 21:11 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1178', diff saved to https://phabricator.wikimedia.org/P29270 and previous config saved to /var/cache/conftool/dbconfig/20220531-211105-ladsgroup.json |
[production] |
| 21:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 21:08 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 21:06 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on 10 hosts with reason: Maintenance |
[production] |
| 21:06 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on 10 hosts with reason: Maintenance |
[production] |
| 21:06 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2121.codfw.wmnet with reason: Maintenance |
[production] |
| 21:06 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db2121.codfw.wmnet with reason: Maintenance |
[production] |
| 21:06 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1101:3317 (T309311)', diff saved to https://phabricator.wikimedia.org/P29269 and previous config saved to /var/cache/conftool/dbconfig/20220531-210613-ladsgroup.json |
[production] |
| 21:04 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:59 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:56 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1178', diff saved to https://phabricator.wikimedia.org/P29268 and previous config saved to /var/cache/conftool/dbconfig/20220531-205559-ladsgroup.json |
[production] |
| 20:52 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:52 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:52 |
<urbanecm> |
UTC late backport window completed |
[production] |
| 20:52 |
<urbanecm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: eaab90234cc7fac8d2cf459c1e959bdbe186e4fa: Do not load SimilarEditors if QuickSurveys is not installed (T306909) (duration: 03m 12s) |
[production] |
| 20:51 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1101:3317', diff saved to https://phabricator.wikimedia.org/P29267 and previous config saved to /var/cache/conftool/dbconfig/20220531-205108-ladsgroup.json |
[production] |
| 20:46 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:43 |
<urbanecm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: 51f314f49e2df6ec7784b5200535bb45d8bec154: Assign similareditors right to the checkuser group (T307205) (duration: 03m 06s) |
[production] |
| 20:41 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:40 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1178 (T60674)', diff saved to https://phabricator.wikimedia.org/P29266 and previous config saved to /var/cache/conftool/dbconfig/20220531-204054-ladsgroup.json |
[production] |
| 20:40 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:40 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:39 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:36 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1101:3317', diff saved to https://phabricator.wikimedia.org/P29265 and previous config saved to /var/cache/conftool/dbconfig/20220531-203603-ladsgroup.json |
[production] |
| 20:23 |
<urbanecm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: 660afb14144db36d94deccae59d4ead096e10e5f: Add SimilarEditors extension – III: Add to CommonSettings (T306909) (duration: 03m 09s) |
[production] |
| 20:20 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1101:3317 (T309311)', diff saved to https://phabricator.wikimedia.org/P29264 and previous config saved to /var/cache/conftool/dbconfig/20220531-202058-ladsgroup.json |
[production] |
| 20:19 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 97551748271963ea59bd4f28b2fb1a1b48dd0c29: Add SimilarEditors extension – II: Add to InitialiseSettings, default off (T306909) (duration: 03m 06s) |
[production] |
| 20:18 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:18 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:17 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:17 |
<bking@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge plugin upgrade - bking@cumin1001 - T309648 |
[production] |
| 20:17 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:14 |
<urbanecm@deploy1002> |
Synchronized wmf-config/extension-list: b88690ee8ccbc50a51c6ef9dcdcbe3faecc3170f: Add SimilarEditors extension – I: Add to i18n (T306909) (duration: 03m 07s) |
[production] |
| 20:11 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1178 (T60674)', diff saved to https://phabricator.wikimedia.org/P29263 and previous config saved to /var/cache/conftool/dbconfig/20220531-201059-ladsgroup.json |
[production] |
| 20:11 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1178.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:10 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1178.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:10 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1126 (T60674)', diff saved to https://phabricator.wikimedia.org/P29262 and previous config saved to /var/cache/conftool/dbconfig/20220531-201051-ladsgroup.json |
[production] |
| 20:08 |
<bking@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge plugin upgrade - bking@cumin1001 - T309648 |
[production] |
| 19:55 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1126', diff saved to https://phabricator.wikimedia.org/P29261 and previous config saved to /var/cache/conftool/dbconfig/20220531-195546-ladsgroup.json |
[production] |
| 19:41 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 19:40 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1126', diff saved to https://phabricator.wikimedia.org/P29259 and previous config saved to /var/cache/conftool/dbconfig/20220531-194040-ladsgroup.json |
[production] |
| 19:40 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 19:40 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 19:36 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |