|
2026-04-16
ยง
|
| 21:33 |
<cscott@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1270518|Deploy PRV to 4 wikis (T423188)]], [[gerrit:1270567|[bnwikisource] Enable PageImages on NS:4, NS:100, NS:104, NS:106, NS:114]] (duration: 17m 26s) |
[production] |
| 21:29 |
<cscott@deploy1003> |
cscott, arlolra, bodhisattwa: Continuing with sync |
[production] |
| 21:23 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling db1260 (T419635)', diff saved to https://phabricator.wikimedia.org/P90997 and previous config saved to /var/cache/conftool/dbconfig/20260416-212348-fceratto.json |
[production] |
| 21:23 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1260.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:23 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1252 (T419635)', diff saved to https://phabricator.wikimedia.org/P90996 and previous config saved to /var/cache/conftool/dbconfig/20260416-212323-fceratto.json |
[production] |
| 21:17 |
<cscott@deploy1003> |
cscott, arlolra, bodhisattwa: Backport for [[gerrit:1270518|Deploy PRV to 4 wikis (T423188)]], [[gerrit:1270567|[bnwikisource] Enable PageImages on NS:4, NS:100, NS:104, NS:106, NS:114]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 21:16 |
<cscott@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1270518|Deploy PRV to 4 wikis (T423188)]], [[gerrit:1270567|[bnwikisource] Enable PageImages on NS:4, NS:100, NS:104, NS:106, NS:114]] |
[production] |
| 21:13 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1252', diff saved to https://phabricator.wikimedia.org/P90995 and previous config saved to /var/cache/conftool/dbconfig/20260416-211315-fceratto.json |
[production] |
| 21:03 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1252', diff saved to https://phabricator.wikimedia.org/P90994 and previous config saved to /var/cache/conftool/dbconfig/20260416-210307-fceratto.json |
[production] |
| 20:52 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1252 (T419635)', diff saved to https://phabricator.wikimedia.org/P90993 and previous config saved to /var/cache/conftool/dbconfig/20260416-205258-fceratto.json |
[production] |
| 20:51 |
<stran@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1270872|Deploy IRS to enwiki's Event Talk namespace (T423042)]], [[gerrit:1254359|Make abstractwiki a multi-lingual Wikidata client (T420420)]], [[gerrit:1272770|Enable attribution.v0-beta in RestSandboxSpecs for all wikis (T419545)]] (duration: 08m 36s) |
[production] |
| 20:48 |
<stran@deploy1003> |
aaron, stran, jforrester: Continuing with sync |
[production] |
| 20:44 |
<stran@deploy1003> |
aaron, stran, jforrester: Backport for [[gerrit:1270872|Deploy IRS to enwiki's Event Talk namespace (T423042)]], [[gerrit:1254359|Make abstractwiki a multi-lingual Wikidata client (T420420)]], [[gerrit:1272770|Enable attribution.v0-beta in RestSandboxSpecs for all wikis (T419545)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:43 |
<stran@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1270872|Deploy IRS to enwiki's Event Talk namespace (T423042)]], [[gerrit:1254359|Make abstractwiki a multi-lingual Wikidata client (T420420)]], [[gerrit:1272770|Enable attribution.v0-beta in RestSandboxSpecs for all wikis (T419545)]] |
[production] |
| 20:36 |
<stran@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1270888|Allow the 'ReportIncidentEnabledNamespaces' config to be ovewritten (T423042)]] (duration: 09m 07s) |
[production] |
| 20:33 |
<stran@deploy1003> |
stran: Continuing with sync |
[production] |
| 20:29 |
<stran@deploy1003> |
stran: Backport for [[gerrit:1270888|Allow the 'ReportIncidentEnabledNamespaces' config to be ovewritten (T423042)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:27 |
<stran@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1270888|Allow the 'ReportIncidentEnabledNamespaces' config to be ovewritten (T423042)]] |
[production] |
| 20:17 |
<maryum> |
Removed private mitigation for T419137 |
[production] |
| 20:09 |
<mstyles@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1267116|config: Enable EmailConfirmationBanner on selected wikis (T421366)]] (duration: 06m 06s) |
[production] |
| 20:08 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2238 (T419961)', diff saved to https://phabricator.wikimedia.org/P90992 and previous config saved to /var/cache/conftool/dbconfig/20260416-200839-fceratto.json |
[production] |
| 20:05 |
<mstyles@deploy1003> |
mmartorana, mstyles: Continuing with sync |
[production] |
| 20:05 |
<mstyles@deploy1003> |
mmartorana, mstyles: Backport for [[gerrit:1267116|config: Enable EmailConfirmationBanner on selected wikis (T421366)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:03 |
<mstyles@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1267116|config: Enable EmailConfirmationBanner on selected wikis (T421366)]] |
[production] |
| 19:58 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2238', diff saved to https://phabricator.wikimedia.org/P90991 and previous config saved to /var/cache/conftool/dbconfig/20260416-195831-fceratto.json |
[production] |
| 19:48 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2238', diff saved to https://phabricator.wikimedia.org/P90990 and previous config saved to /var/cache/conftool/dbconfig/20260416-194823-fceratto.json |
[production] |
| 19:48 |
<zabe@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1269758|Set $wgGlobalUsageSharedRepoWiki for testcommonswiki (T421914)]], [[gerrit:1269759|Also disable updates for GloballyWantedFiles on testcommonswiki (T421914)]] (duration: 06m 48s) |
[production] |
| 19:44 |
<zabe@deploy1003> |
zabe: Continuing with sync |
[production] |
| 19:43 |
<zabe@deploy1003> |
zabe: Backport for [[gerrit:1269758|Set $wgGlobalUsageSharedRepoWiki for testcommonswiki (T421914)]], [[gerrit:1269759|Also disable updates for GloballyWantedFiles on testcommonswiki (T421914)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 19:41 |
<zabe@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1269758|Set $wgGlobalUsageSharedRepoWiki for testcommonswiki (T421914)]], [[gerrit:1269759|Also disable updates for GloballyWantedFiles on testcommonswiki (T421914)]] |
[production] |
| 19:38 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2238 (T419961)', diff saved to https://phabricator.wikimedia.org/P90989 and previous config saved to /var/cache/conftool/dbconfig/20260416-193814-fceratto.json |
[production] |
| 19:36 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-ctrl2005.codfw.wmnet with OS trixie |
[production] |
| 19:34 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-ctrl2004.codfw.wmnet with OS trixie |
[production] |
| 19:31 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling db2238 (T419961)', diff saved to https://phabricator.wikimedia.org/P90988 and previous config saved to /var/cache/conftool/dbconfig/20260416-193100-fceratto.json |
[production] |
| 19:30 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2238.codfw.wmnet with reason: Maintenance |
[production] |
| 19:30 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2226 (T419961)', diff saved to https://phabricator.wikimedia.org/P90987 and previous config saved to /var/cache/conftool/dbconfig/20260416-193028-fceratto.json |
[production] |
| 19:21 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-ctrl2005.codfw.wmnet with reason: host reimage |
[production] |
| 19:20 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P90986 and previous config saved to /var/cache/conftool/dbconfig/20260416-192020-fceratto.json |
[production] |
| 19:19 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-ctrl2004.codfw.wmnet with reason: host reimage |
[production] |
| 19:16 |
<jasmine@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-ctrl2005.codfw.wmnet with reason: host reimage |
[production] |
| 19:15 |
<jasmine@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-ctrl2004.codfw.wmnet with reason: host reimage |
[production] |
| 19:14 |
<otto@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply |
[production] |
| 19:14 |
<otto@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply |
[production] |
| 19:12 |
<otto@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply |
[production] |
| 19:12 |
<otto@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply |
[production] |
| 19:11 |
<otto@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply |
[production] |
| 19:11 |
<otto@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply |
[production] |
| 19:10 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P90985 and previous config saved to /var/cache/conftool/dbconfig/20260416-191012-fceratto.json |
[production] |
| 19:03 |
<jasmine@cumin1003> |
START - Cookbook sre.hosts.reimage for host wikikube-ctrl2005.codfw.wmnet with OS trixie |
[production] |
| 19:02 |
<jasmine@cumin1003> |
START - Cookbook sre.hosts.reimage for host wikikube-ctrl2004.codfw.wmnet with OS trixie |
[production] |