|
2026-04-30
ยง
|
| 21:31 |
<cdobbins@cumin2002> |
conftool action : get/pooled; selector: name=cp4040.ulsfo.wmnet |
[production] |
| 21:31 |
<cdobbins@cumin2002> |
conftool action : get/pooled; selector: name=cp4044.ulsfo.wmnet |
[production] |
| 21:28 |
<cdobbins@cumin2002> |
conftool action : get/pooled; selector: name=cp* |
[production] |
| 21:28 |
<cdobbins@cumin2002> |
conftool action : get/pooled; selector: name=cp4041.ulsfo.wmnet |
[production] |
| 21:11 |
<jhuneidi@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1280657|hCaptcha: Reduce default MAX_LOAD_ATTEMPTS from 10 to 6 (T421204)]], [[gerrit:1280656|hCaptcha: Label load and execute duration metrics with outcome (T421204)]] (duration: 05m 47s) |
[production] |
| 21:08 |
<jhuneidi@deploy1003> |
kharlan, jhuneidi: Continuing with deployment |
[production] |
| 21:07 |
<jhuneidi@deploy1003> |
kharlan, jhuneidi: Backport for [[gerrit:1280657|hCaptcha: Reduce default MAX_LOAD_ATTEMPTS from 10 to 6 (T421204)]], [[gerrit:1280656|hCaptcha: Label load and execute duration metrics with outcome (T421204)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 21:07 |
<mutante> |
zuul1001/zuul2001 - rmdir /etc/nodepool |
[production] |
| 21:06 |
<jhuneidi@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1280657|hCaptcha: Reduce default MAX_LOAD_ATTEMPTS from 10 to 6 (T421204)]], [[gerrit:1280656|hCaptcha: Label load and execute duration metrics with outcome (T421204)]] |
[production] |
| 20:50 |
<jhuneidi@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1280516|Suggestion Mode controlled experiment: limit exposure to newcomers (T422736)]], [[gerrit:1280552|Abandon the editor survey: update edit count restriction (T422931)]] (duration: 08m 33s) |
[production] |
| 20:47 |
<jhuneidi@deploy1003> |
caro, jhuneidi: Continuing with deployment |
[production] |
| 20:46 |
<jasmine@deploy1003> |
helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/sophroid: apply |
[production] |
| 20:46 |
<jasmine@deploy1003> |
helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/sophroid: apply |
[production] |
| 20:44 |
<jhuneidi@deploy1003> |
caro, jhuneidi: Backport for [[gerrit:1280516|Suggestion Mode controlled experiment: limit exposure to newcomers (T422736)]], [[gerrit:1280552|Abandon the editor survey: update edit count restriction (T422931)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:42 |
<jhuneidi@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1280516|Suggestion Mode controlled experiment: limit exposure to newcomers (T422736)]], [[gerrit:1280552|Abandon the editor survey: update edit count restriction (T422931)]] |
[production] |
| 20:37 |
<jasmine@deploy1003> |
helmfile [aux-k8s-codfw] DONE helmfile.d/aux-k8s-services/sophroid: apply |
[production] |
| 20:36 |
<jhuneidi@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1274928|ukwiki: Remove the patroller user group and adjust various user rights (T423461)]], [[gerrit:1279477|nlwiki: Modify autoconfirmed requirements for nlwiki (T424898)]], [[gerrit:1247186|dewiki: Add abusefilter group (T418815)]], [[gerrit:1236361|Add map domains for ruwiki to the list of externallinks-excluded domains (T416174)]], [[gerrit:12804 |
[production] |
| 20:35 |
<jasmine@deploy1003> |
helmfile [aux-k8s-codfw] START helmfile.d/aux-k8s-services/sophroid: apply |
[production] |
| 20:32 |
<jhuneidi@deploy1003> |
vadymts1, seawolf35gerrit, jhuneidi, codenamenoreste, mgchecker: Continuing with deployment |
[production] |
| 20:32 |
<jclark@cumin1003> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 20:31 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 20:30 |
<jclark@cumin1003> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 20:29 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 20:26 |
<James_F> |
Zuul: [mediawiki/tools/api-testing] Make PHP 8.5 CI voting |
[releng] |
| 20:23 |
<jhuneidi@deploy1003> |
vadymts1, seawolf35gerrit, jhuneidi, codenamenoreste, mgchecker: Backport for [[gerrit:1274928|ukwiki: Remove the patroller user group and adjust various user rights (T423461)]], [[gerrit:1279477|nlwiki: Modify autoconfirmed requirements for nlwiki (T424898)]], [[gerrit:1247186|dewiki: Add abusefilter group (T418815)]], [[gerrit:1236361|Add map domains for ruwiki to the list of externallinks-exclu |
[production] |
| 20:21 |
<jhuneidi@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1274928|ukwiki: Remove the patroller user group and adjust various user rights (T423461)]], [[gerrit:1279477|nlwiki: Modify autoconfirmed requirements for nlwiki (T424898)]], [[gerrit:1247186|dewiki: Add abusefilter group (T418815)]], [[gerrit:1236361|Add map domains for ruwiki to the list of externallinks-excluded domains (T416174)]], [[gerrit:128044 |
[production] |
| 20:16 |
<James_F> |
jforrester@doc1004:~$ # sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/WebAuthn/ # T415832 |
[releng] |
| 20:14 |
<James_F> |
Zuul: [mediawiki/extensions/WebAuthn] Archive, for T415832 / T303495 |
[releng] |
| 20:09 |
<cscott@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1279454|Increase Parsoid Read Views to 100% of enwiki mobile web traffic (T424880)]] (duration: 07m 01s) |
[production] |
| 20:06 |
<cscott@deploy1003> |
cscott: Continuing with deployment |
[production] |
| 20:04 |
<cscott@deploy1003> |
cscott: Backport for [[gerrit:1279454|Increase Parsoid Read Views to 100% of enwiki mobile web traffic (T424880)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:02 |
<cscott@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1279454|Increase Parsoid Read Views to 100% of enwiki mobile web traffic (T424880)]] |
[production] |
| 19:54 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1251 (T419961)', diff saved to https://phabricator.wikimedia.org/P92130 and previous config saved to /var/cache/conftool/dbconfig/20260430-195431-fceratto.json |
[production] |
| 19:44 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1251', diff saved to https://phabricator.wikimedia.org/P92129 and previous config saved to /var/cache/conftool/dbconfig/20260430-194423-fceratto.json |
[production] |
| 19:34 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1251', diff saved to https://phabricator.wikimedia.org/P92128 and previous config saved to /var/cache/conftool/dbconfig/20260430-193415-fceratto.json |
[production] |
| 19:24 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1251 (T419961)', diff saved to https://phabricator.wikimedia.org/P92127 and previous config saved to /var/cache/conftool/dbconfig/20260430-192407-fceratto.json |
[production] |
| 19:15 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling db1251 (T419961)', diff saved to https://phabricator.wikimedia.org/P92126 and previous config saved to /var/cache/conftool/dbconfig/20260430-191527-fceratto.json |
[production] |
| 19:15 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1251.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:15 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1235 (T419961)', diff saved to https://phabricator.wikimedia.org/P92125 and previous config saved to /var/cache/conftool/dbconfig/20260430-191507-fceratto.json |
[production] |
| 19:04 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1235', diff saved to https://phabricator.wikimedia.org/P92124 and previous config saved to /var/cache/conftool/dbconfig/20260430-190459-fceratto.json |
[production] |
| 18:54 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1235', diff saved to https://phabricator.wikimedia.org/P92123 and previous config saved to /var/cache/conftool/dbconfig/20260430-185451-fceratto.json |
[production] |
| 18:44 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1235 (T419961)', diff saved to https://phabricator.wikimedia.org/P92122 and previous config saved to /var/cache/conftool/dbconfig/20260430-184439-fceratto.json |
[production] |
| 18:31 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling db1235 (T419961)', diff saved to https://phabricator.wikimedia.org/P92121 and previous config saved to /var/cache/conftool/dbconfig/20260430-183130-fceratto.json |
[production] |
| 18:31 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1235.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:31 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1234 (T419961)', diff saved to https://phabricator.wikimedia.org/P92120 and previous config saved to /var/cache/conftool/dbconfig/20260430-183100-fceratto.json |
[production] |
| 18:28 |
<dcausse@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 18:28 |
<dcausse@deploy1003> |
helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 18:20 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1234', diff saved to https://phabricator.wikimedia.org/P92119 and previous config saved to /var/cache/conftool/dbconfig/20260430-182052-fceratto.json |
[production] |
| 18:15 |
<jhuneidi@deploy1003> |
rebuilt and synchronized wikiversions files: group2 to 1.46.0-wmf.26 refs T423877 |
[production] |
| 18:10 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1234', diff saved to https://phabricator.wikimedia.org/P92118 and previous config saved to /var/cache/conftool/dbconfig/20260430-181044-fceratto.json |
[production] |