|
2022-10-17
ยง
|
| 14:07 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2168:3317', diff saved to https://phabricator.wikimedia.org/P35513 and previous config saved to /var/cache/conftool/dbconfig/20221017-140717-ladsgroup.json |
[production] |
| 14:05 |
<cgoubert@cumin1001> |
conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics,name=eqiad |
[production] |
| 14:05 |
<claime> |
Repooling eventgate-analytics in eqiad - T303543 |
[production] |
| 14:04 |
<cgoubert@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply |
[production] |
| 14:04 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db2109 (T318955)', diff saved to https://phabricator.wikimedia.org/P35512 and previous config saved to /var/cache/conftool/dbconfig/20221017-140452-ladsgroup.json |
[production] |
| 14:04 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2109.codfw.wmnet with reason: Maintenance |
[production] |
| 14:04 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 8:00:00 on db2109.codfw.wmnet with reason: Maintenance |
[production] |
| 14:04 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2105 (T318955)', diff saved to https://phabricator.wikimedia.org/P35511 and previous config saved to /var/cache/conftool/dbconfig/20221017-140430-ladsgroup.json |
[production] |
| 14:04 |
<cgoubert@deploy1002> |
helmfile [eqiad] START helmfile.d/services/eventgate-analytics: apply |
[production] |
| 14:00 |
<cgoubert@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=eventgate-analytics,name=eqiad |
[production] |
| 14:00 |
<claime> |
Depooling eventgate-analytics in eqiad - T303543 |
[production] |
| 13:57 |
<cgoubert@cumin1001> |
conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics,name=codfw |
[production] |
| 13:56 |
<claime> |
Repooling eventgate-analytics in codfw - T303543 |
[production] |
| 13:56 |
<cgoubert@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/eventgate-analytics: apply |
[production] |
| 13:56 |
<cgoubert@deploy1002> |
helmfile [codfw] START helmfile.d/services/eventgate-analytics: apply |
[production] |
| 13:52 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2168:3317 (T318950)', diff saved to https://phabricator.wikimedia.org/P35510 and previous config saved to /var/cache/conftool/dbconfig/20221017-135211-ladsgroup.json |
[production] |
| 13:51 |
<cgoubert@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=eventgate-analytics,name=codfw |
[production] |
| 13:50 |
<claime> |
Depooling eventgate-analytics in codfw - T303543 |
[production] |
| 13:49 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db2168:3317 (T318950)', diff saved to https://phabricator.wikimedia.org/P35509 and previous config saved to /var/cache/conftool/dbconfig/20221017-134953-ladsgroup.json |
[production] |
| 13:49 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2168.codfw.wmnet with reason: Maintenance |
[production] |
| 13:49 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db2168.codfw.wmnet with reason: Maintenance |
[production] |
| 13:49 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T318950)', diff saved to https://phabricator.wikimedia.org/P35508 and previous config saved to /var/cache/conftool/dbconfig/20221017-134931-ladsgroup.json |
[production] |
| 13:49 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2105', diff saved to https://phabricator.wikimedia.org/P35507 and previous config saved to /var/cache/conftool/dbconfig/20221017-134924-ladsgroup.json |
[production] |
| 13:49 |
<jclark@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 13:48 |
<claime> |
Repooled eventgate-logging-external in equiad - T303543 |
[production] |
| 13:47 |
<cgoubert@deploy1002> |
helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply |
[production] |
| 13:47 |
<jclark@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 13:46 |
<cgoubert@deploy1002> |
helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply |
[production] |
| 13:29 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:843481|GrowthExperiments: enable the vue version of mentee overview in all wikis (T300532)]] (duration: 06m 24s) |
[production] |
| 13:28 |
<cgoubert@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=eventgate-logging-external,name=codfw |
[production] |
| 13:27 |
<claime> |
Depooling eventgate-logging-external in codfw - T303543 |
[production] |
| 13:23 |
<urbanecm@deploy1002> |
urbanecm and sgimeno: Backport for [[gerrit:843481|GrowthExperiments: enable the vue version of mentee overview in all wikis (T300532)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet |
[production] |
| 13:23 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:843481|GrowthExperiments: enable the vue version of mentee overview in all wikis (T300532)]] |
[production] |
| 13:22 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:842967|Enable Sandbox Extension at Bengali Wikiquote (T320903)]] (duration: 04m 54s) |
[production] |
| 13:19 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P35504 and previous config saved to /var/cache/conftool/dbconfig/20221017-131918-ladsgroup.json |
[production] |
| 13:19 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2105 (T318955)', diff saved to https://phabricator.wikimedia.org/P35503 and previous config saved to /var/cache/conftool/dbconfig/20221017-131911-ladsgroup.json |
[production] |
| 13:18 |
<urbanecm@deploy1002> |
urbanecm and mdsshakil: Backport for [[gerrit:842967|Enable Sandbox Extension at Bengali Wikiquote (T320903)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet |
[production] |
| 13:17 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:842967|Enable Sandbox Extension at Bengali Wikiquote (T320903)]] |
[production] |
| 13:17 |
<urbanecm@deploy1002> |
Finished scap: 52821e09c: 35000a4b: dewiktionary: Update logo (T320891) (duration: 04m 03s) |
[production] |
| 13:13 |
<urbanecm@deploy1002> |
Started scap: 52821e09c: 35000a4b: dewiktionary: Update logo (T320891) |
[production] |
| 13:10 |
<urbanecm@deploy1002> |
Finished scap: b434c5a84: 9d10a60ea: Wordmark changes (T320944, T320840) (duration: 04m 32s) |
[production] |
| 13:06 |
<root@cumin1001> |
END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) |
[production] |
| 13:06 |
<root@cumin1001> |
START - Cookbook sre.discovery.service-route |
[production] |
| 13:05 |
<urbanecm@deploy1002> |
Started scap: b434c5a84: 9d10a60ea: Wordmark changes (T320944, T320840) |
[production] |
| 13:04 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db2105 (T318955)', diff saved to https://phabricator.wikimedia.org/P35502 and previous config saved to /var/cache/conftool/dbconfig/20221017-130440-ladsgroup.json |
[production] |
| 13:04 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2105.codfw.wmnet with reason: Maintenance |
[production] |
| 13:04 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 8:00:00 on db2105.codfw.wmnet with reason: Maintenance |
[production] |
| 13:04 |
<ladsgroup@cumin1001> |
END (ERROR) - Cookbook sre.hosts.downtime (exit_code=97) for 8:00:00 on db2105.codfw.wmnet with reason: Maintenance |
[production] |
| 13:04 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 8:00:00 on db2105.codfw.wmnet with reason: Maintenance |
[production] |
| 13:04 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T318950)', diff saved to https://phabricator.wikimedia.org/P35501 and previous config saved to /var/cache/conftool/dbconfig/20221017-130412-ladsgroup.json |
[production] |