|
2026-05-01
§
|
| 09:57 |
<samtar@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1281423|Switch watchstar from Popover to Dialog (T417847)]] (duration: 06m 49s) |
[production] |
| 09:53 |
<samtar@deploy1003> |
samtar: Continuing with deployment |
[production] |
| 09:52 |
<samtar@deploy1003> |
samtar: Backport for [[gerrit:1281423|Switch watchstar from Popover to Dialog (T417847)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 09:50 |
<samtar@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1281423|Switch watchstar from Popover to Dialog (T417847)]] |
[production] |
| 09:38 |
<urbanecm@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1281426|Update the interwiki cache (T239173)]] (duration: 06m 05s) |
[production] |
| 09:32 |
<urbanecm@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1281426|Update the interwiki cache (T239173)]] |
[production] |
| 08:13 |
<cgoubert@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply |
[production] |
| 08:13 |
<cgoubert@deploy1003> |
helmfile [eqiad] START helmfile.d/services/rest-gateway: apply |
[production] |
| 08:13 |
<cgoubert@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply |
[production] |
| 08:13 |
<cgoubert@deploy1003> |
helmfile [codfw] START helmfile.d/services/rest-gateway: apply |
[production] |
| 08:13 |
<cgoubert@deploy1003> |
helmfile [staging] DONE helmfile.d/services/rest-gateway: apply |
[production] |
| 08:12 |
<cgoubert@deploy1003> |
helmfile [staging] START helmfile.d/services/rest-gateway: apply |
[production] |
| 03:26 |
<akhatun@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply |
[production] |
| 03:26 |
<akhatun@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply |
[production] |
| 02:07 |
<mwpresync@deploy1003> |
Finished scap build-images: Publishing wmf/next image (duration: 06m 41s) |
[production] |
| 02:00 |
<mwpresync@deploy1003> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 00:16 |
<zabe@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1280417|Add script to fix fr_deleted drifts (T424553)]] (duration: 07m 05s) |
[production] |
| 00:13 |
<zabe@deploy1003> |
zabe: Continuing with deployment |
[production] |
| 00:11 |
<zabe@deploy1003> |
zabe: Backport for [[gerrit:1280417|Add script to fix fr_deleted drifts (T424553)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 00:09 |
<zabe@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1280417|Add script to fix fr_deleted drifts (T424553)]] |
[production] |
|
2026-04-30
§
|
| 23:51 |
<dzahn@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on zuul1001.eqiad.wmnet with reason: T421398 |
[production] |
| 23:51 |
<dzahn@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on zuul2001.codfw.wmnet with reason: T421398 |
[production] |
| 21:31 |
<cdobbins@cumin2002> |
conftool action : get/pooled; selector: name=cp4040.ulsfo.wmnet |
[production] |
| 21:31 |
<cdobbins@cumin2002> |
conftool action : get/pooled; selector: name=cp4044.ulsfo.wmnet |
[production] |
| 21:28 |
<cdobbins@cumin2002> |
conftool action : get/pooled; selector: name=cp* |
[production] |
| 21:28 |
<cdobbins@cumin2002> |
conftool action : get/pooled; selector: name=cp4041.ulsfo.wmnet |
[production] |
| 21:11 |
<jhuneidi@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1280657|hCaptcha: Reduce default MAX_LOAD_ATTEMPTS from 10 to 6 (T421204)]], [[gerrit:1280656|hCaptcha: Label load and execute duration metrics with outcome (T421204)]] (duration: 05m 47s) |
[production] |
| 21:08 |
<jhuneidi@deploy1003> |
kharlan, jhuneidi: Continuing with deployment |
[production] |
| 21:07 |
<jhuneidi@deploy1003> |
kharlan, jhuneidi: Backport for [[gerrit:1280657|hCaptcha: Reduce default MAX_LOAD_ATTEMPTS from 10 to 6 (T421204)]], [[gerrit:1280656|hCaptcha: Label load and execute duration metrics with outcome (T421204)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 21:07 |
<mutante> |
zuul1001/zuul2001 - rmdir /etc/nodepool |
[production] |
| 21:06 |
<jhuneidi@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1280657|hCaptcha: Reduce default MAX_LOAD_ATTEMPTS from 10 to 6 (T421204)]], [[gerrit:1280656|hCaptcha: Label load and execute duration metrics with outcome (T421204)]] |
[production] |
| 20:50 |
<jhuneidi@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1280516|Suggestion Mode controlled experiment: limit exposure to newcomers (T422736)]], [[gerrit:1280552|Abandon the editor survey: update edit count restriction (T422931)]] (duration: 08m 33s) |
[production] |
| 20:47 |
<jhuneidi@deploy1003> |
caro, jhuneidi: Continuing with deployment |
[production] |
| 20:46 |
<jasmine@deploy1003> |
helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/sophroid: apply |
[production] |
| 20:46 |
<jasmine@deploy1003> |
helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/sophroid: apply |
[production] |
| 20:44 |
<jhuneidi@deploy1003> |
caro, jhuneidi: Backport for [[gerrit:1280516|Suggestion Mode controlled experiment: limit exposure to newcomers (T422736)]], [[gerrit:1280552|Abandon the editor survey: update edit count restriction (T422931)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:42 |
<jhuneidi@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1280516|Suggestion Mode controlled experiment: limit exposure to newcomers (T422736)]], [[gerrit:1280552|Abandon the editor survey: update edit count restriction (T422931)]] |
[production] |
| 20:37 |
<jasmine@deploy1003> |
helmfile [aux-k8s-codfw] DONE helmfile.d/aux-k8s-services/sophroid: apply |
[production] |
| 20:36 |
<jhuneidi@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1274928|ukwiki: Remove the patroller user group and adjust various user rights (T423461)]], [[gerrit:1279477|nlwiki: Modify autoconfirmed requirements for nlwiki (T424898)]], [[gerrit:1247186|dewiki: Add abusefilter group (T418815)]], [[gerrit:1236361|Add map domains for ruwiki to the list of externallinks-excluded domains (T416174)]], [[gerrit:12804 |
[production] |
| 20:35 |
<jasmine@deploy1003> |
helmfile [aux-k8s-codfw] START helmfile.d/aux-k8s-services/sophroid: apply |
[production] |
| 20:32 |
<jhuneidi@deploy1003> |
vadymts1, seawolf35gerrit, jhuneidi, codenamenoreste, mgchecker: Continuing with deployment |
[production] |
| 20:32 |
<jclark@cumin1003> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 20:31 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 20:30 |
<jclark@cumin1003> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 20:29 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART |
[production] |
| 20:23 |
<jhuneidi@deploy1003> |
vadymts1, seawolf35gerrit, jhuneidi, codenamenoreste, mgchecker: Backport for [[gerrit:1274928|ukwiki: Remove the patroller user group and adjust various user rights (T423461)]], [[gerrit:1279477|nlwiki: Modify autoconfirmed requirements for nlwiki (T424898)]], [[gerrit:1247186|dewiki: Add abusefilter group (T418815)]], [[gerrit:1236361|Add map domains for ruwiki to the list of externallinks-exclu |
[production] |
| 20:21 |
<jhuneidi@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1274928|ukwiki: Remove the patroller user group and adjust various user rights (T423461)]], [[gerrit:1279477|nlwiki: Modify autoconfirmed requirements for nlwiki (T424898)]], [[gerrit:1247186|dewiki: Add abusefilter group (T418815)]], [[gerrit:1236361|Add map domains for ruwiki to the list of externallinks-excluded domains (T416174)]], [[gerrit:128044 |
[production] |
| 20:09 |
<cscott@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1279454|Increase Parsoid Read Views to 100% of enwiki mobile web traffic (T424880)]] (duration: 07m 01s) |
[production] |
| 20:06 |
<cscott@deploy1003> |
cscott: Continuing with deployment |
[production] |
| 20:04 |
<cscott@deploy1003> |
cscott: Backport for [[gerrit:1279454|Increase Parsoid Read Views to 100% of enwiki mobile web traffic (T424880)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |