|
2026-04-29
ยง
|
| 23:18 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host tools-k8s-worker1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 23:18 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host tools-k8s-worker1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 23:04 |
<cscott@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1279452|Enable Parsoid Read Views for 20% of enwiki mobile web traffic (T424880)]] (duration: 14m 03s) |
[production] |
| 22:59 |
<cscott@deploy1003> |
cscott: Continuing with deployment |
[production] |
| 22:52 |
<cscott@deploy1003> |
cscott: Backport for [[gerrit:1279452|Enable Parsoid Read Views for 20% of enwiki mobile web traffic (T424880)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 22:50 |
<cscott@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1279452|Enable Parsoid Read Views for 20% of enwiki mobile web traffic (T424880)]] |
[production] |
| 22:39 |
<cscott@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1277770|Deploy PRV to 12 wikis (T424590)]], [[gerrit:1279450|Deploy Parsoid Read Views to 6 language converter wikis (T423785)]] (duration: 21m 03s) |
[production] |
| 22:35 |
<cscott@deploy1003> |
arlolra, cscott: Continuing with deployment |
[production] |
| 22:20 |
<cscott@deploy1003> |
arlolra, cscott: Backport for [[gerrit:1277770|Deploy PRV to 12 wikis (T424590)]], [[gerrit:1279450|Deploy Parsoid Read Views to 6 language converter wikis (T423785)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 22:18 |
<cscott@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1277770|Deploy PRV to 12 wikis (T424590)]], [[gerrit:1279450|Deploy Parsoid Read Views to 6 language converter wikis (T423785)]] |
[production] |
| 22:07 |
<dancy@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1279430|enwikiversity: Enable the abuse filter block action on English Wikiversity (T424053)]], [[gerrit:1278363|enwikiversity: Add some user rights to the curator user group on English Wikiversity (T424445)]] (duration: 62m 26s) |
[production] |
| 22:03 |
<dancy@deploy1003> |
vadymts1, dancy: Continuing with deployment |
[production] |
| 21:06 |
<dancy@deploy1003> |
vadymts1, dancy: Backport for [[gerrit:1279430|enwikiversity: Enable the abuse filter block action on English Wikiversity (T424053)]], [[gerrit:1278363|enwikiversity: Add some user rights to the curator user group on English Wikiversity (T424445)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 21:04 |
<dancy@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1279430|enwikiversity: Enable the abuse filter block action on English Wikiversity (T424053)]], [[gerrit:1278363|enwikiversity: Add some user rights to the curator user group on English Wikiversity (T424445)]] |
[production] |
| 21:00 |
<phuedx@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1279431|Load TestKitchen earlier (T424876)]] (duration: 11m 33s) |
[production] |
| 20:56 |
<phuedx@deploy1003> |
phuedx, sbisson: Continuing with deployment |
[production] |
| 20:50 |
<phuedx@deploy1003> |
phuedx, sbisson: Backport for [[gerrit:1279431|Load TestKitchen earlier (T424876)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:48 |
<phuedx@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1279431|Load TestKitchen earlier (T424876)]] |
[production] |
| 20:44 |
<dancy@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1277569|Enable mobile editor abandonment survey on enwiki (T423923)]], [[gerrit:1279448|Abandon editor survey: UI updates (T422931)]] (duration: 11m 43s) |
[production] |
| 20:40 |
<dancy@deploy1003> |
dancy, caro, kemayo: Continuing with deployment |
[production] |
| 20:34 |
<dancy@deploy1003> |
dancy, caro, kemayo: Backport for [[gerrit:1277569|Enable mobile editor abandonment survey on enwiki (T423923)]], [[gerrit:1279448|Abandon editor survey: UI updates (T422931)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:32 |
<dancy@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1277569|Enable mobile editor abandonment survey on enwiki (T423923)]], [[gerrit:1279448|Abandon editor survey: UI updates (T422931)]] |
[production] |
| 20:27 |
<dancy@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1265959|arbcom_zhwiki: Enable SecurePoll without PII rights (T419309)]] (duration: 07m 16s) |
[production] |
| 20:23 |
<dancy@deploy1003> |
1f616emo, dancy: Continuing with deployment |
[production] |
| 20:21 |
<dancy@deploy1003> |
1f616emo, dancy: Backport for [[gerrit:1265959|arbcom_zhwiki: Enable SecurePoll without PII rights (T419309)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:19 |
<dancy@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1265959|arbcom_zhwiki: Enable SecurePoll without PII rights (T419309)]] |
[production] |
| 20:17 |
<dancy@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1279406|cswiki: lift IP cap for edithathon (T424843)]], [[gerrit:1279422|arbcom_enwiki: update logo, icon (T424555)]], [[gerrit:1279404|enwikiquote: enable UseSandboxLink (T424863)]] (duration: 06m 59s) |
[production] |
| 20:13 |
<dancy@deploy1003> |
anzx, dancy: Continuing with deployment |
[production] |
| 20:12 |
<dancy@deploy1003> |
anzx, dancy: Backport for [[gerrit:1279406|cswiki: lift IP cap for edithathon (T424843)]], [[gerrit:1279422|arbcom_enwiki: update logo, icon (T424555)]], [[gerrit:1279404|enwikiquote: enable UseSandboxLink (T424863)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:10 |
<dancy@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1279406|cswiki: lift IP cap for edithathon (T424843)]], [[gerrit:1279422|arbcom_enwiki: update logo, icon (T424555)]], [[gerrit:1279404|enwikiquote: enable UseSandboxLink (T424863)]] |
[production] |
| 20:04 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2195 (T419961)', diff saved to https://phabricator.wikimedia.org/P91997 and previous config saved to /var/cache/conftool/dbconfig/20260429-200455-fceratto.json |
[production] |
| 19:54 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2195', diff saved to https://phabricator.wikimedia.org/P91996 and previous config saved to /var/cache/conftool/dbconfig/20260429-195447-fceratto.json |
[production] |
| 19:44 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2195', diff saved to https://phabricator.wikimedia.org/P91995 and previous config saved to /var/cache/conftool/dbconfig/20260429-194439-fceratto.json |
[production] |
| 19:34 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2195 (T419961)', diff saved to https://phabricator.wikimedia.org/P91994 and previous config saved to /var/cache/conftool/dbconfig/20260429-193431-fceratto.json |
[production] |
| 19:27 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling db2195 (T419961)', diff saved to https://phabricator.wikimedia.org/P91993 and previous config saved to /var/cache/conftool/dbconfig/20260429-192729-fceratto.json |
[production] |
| 19:27 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2195.codfw.wmnet with reason: Maintenance |
[production] |
| 19:26 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2181 (T419961)', diff saved to https://phabricator.wikimedia.org/P91992 and previous config saved to /var/cache/conftool/dbconfig/20260429-192658-fceratto.json |
[production] |
| 19:25 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 19:25 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add dns infor for asw1-23-ulsfo - pt1979@cumin2002" |
[production] |
| 19:24 |
<pt1979@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add dns infor for asw1-23-ulsfo - pt1979@cumin2002" |
[production] |
| 19:20 |
<pt1979@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
| 19:16 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2181', diff saved to https://phabricator.wikimedia.org/P91990 and previous config saved to /var/cache/conftool/dbconfig/20260429-191650-fceratto.json |
[production] |
| 19:06 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2181', diff saved to https://phabricator.wikimedia.org/P91989 and previous config saved to /var/cache/conftool/dbconfig/20260429-190641-fceratto.json |
[production] |
| 18:56 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2181 (T419961)', diff saved to https://phabricator.wikimedia.org/P91988 and previous config saved to /var/cache/conftool/dbconfig/20260429-185634-fceratto.json |
[production] |
| 18:49 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling db2181 (T419961)', diff saved to https://phabricator.wikimedia.org/P91987 and previous config saved to /var/cache/conftool/dbconfig/20260429-184925-fceratto.json |
[production] |
| 18:49 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2181.codfw.wmnet with reason: Maintenance |
[production] |
| 18:48 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2167 (T419961)', diff saved to https://phabricator.wikimedia.org/P91986 and previous config saved to /var/cache/conftool/dbconfig/20260429-184854-fceratto.json |
[production] |
| 18:38 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2167', diff saved to https://phabricator.wikimedia.org/P91985 and previous config saved to /var/cache/conftool/dbconfig/20260429-183845-fceratto.json |
[production] |
| 18:28 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2167', diff saved to https://phabricator.wikimedia.org/P91984 and previous config saved to /var/cache/conftool/dbconfig/20260429-182837-fceratto.json |
[production] |
| 18:18 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2167 (T419961)', diff saved to https://phabricator.wikimedia.org/P91983 and previous config saved to /var/cache/conftool/dbconfig/20260429-181829-fceratto.json |
[production] |