101-150 of 10000 results (23ms)
2026-06-22 ยง
13:27 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host es1039.eqiad.wmnet with OS trixie [production]
13:26 <tchin@deploy1003> Finished scap sync-world: Backport for [[gerrit:1300892|[PageViewInfo] Add new config (T411771)]] (duration: 14m 24s) [production]
13:25 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1039: Upgrading es1039.eqiad.wmnet [production]
13:25 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool es1039: Upgrading es1039.eqiad.wmnet [production]
13:24 <marostegui@cumin1003> dbmaint on es7@eqiad T429463 [production]
13:24 <marostegui@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
13:19 <tchin@deploy1003> tchin: Continuing with deployment [production]
13:17 <tchin@deploy1003> tchin: Backport for [[gerrit:1300892|[PageViewInfo] Add new config (T411771)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:11 <tchin@deploy1003> Started scap sync-world: Backport for [[gerrit:1300892|[PageViewInfo] Add new config (T411771)]] [production]
13:04 <oblivian@cumin2003> END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "Fix utf-8 name handling - oblivian@cumin2003" [production]
13:04 <oblivian@cumin2003> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Fix utf-8 name handling - oblivian@cumin2003 [production]
13:03 <oblivian@cumin2003> START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Fix utf-8 name handling - oblivian@cumin2003 [production]
13:03 <oblivian@cumin2003> START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Fix utf-8 name handling - oblivian@cumin2003" [production]
13:03 <fceratto@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for db2212.codfw.wmnet [production]
13:03 <fceratto@cumin1003> START - Cookbook sre.hosts.remove-downtime for db2212.codfw.wmnet [production]
13:02 <fceratto@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for db2189.codfw.wmnet [production]
13:02 <fceratto@cumin1003> START - Cookbook sre.hosts.remove-downtime for db2189.codfw.wmnet [production]
12:55 <Msz2001> Deployed changes to private code (SuggestedInvestigations and PrivateSettings.php) [production]
12:38 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]
12:38 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es1040: Migration of es1040.eqiad.wmnet completed [production]
12:38 <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1304761|hCaptcha: Skip blocked-IP risk-score collection for crawlers (T429755)]] (duration: 16m 20s) [production]
12:33 <atsuko@deploy1003> mwscript-k8s job started: foreachwikiindblist mwscript.dblist extensions/Translate/scripts/ttmserver-export.php --ttmserver codfw-k8s # T425377 populating translation memory (dblist: https://phabricator.wikimedia.org/P94319) [production]
12:33 <atsuko@deploy1003> mwscript-k8s job started: foreachwikiindblist mwscript.dblist extensions/Translate/scripts/ttmserver-export.php --ttmserver eqiad-k8s # T425377 populating translation memory (dblist: https://phabricator.wikimedia.org/P94318) [production]
12:32 <kharlan@deploy1003> kharlan: Continuing with deployment [production]
12:28 <kharlan@deploy1003> kharlan: Backport for [[gerrit:1304761|hCaptcha: Skip blocked-IP risk-score collection for crawlers (T429755)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
12:22 <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1304761|hCaptcha: Skip blocked-IP risk-score collection for crawlers (T429755)]] [production]
12:19 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/ratelimit: apply [production]
12:18 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/ratelimit: apply [production]
12:15 <kamila@deploy1003> Finished scap sync-world: upgrade canaries to Debian Bookworm (duration: 10m 33s) [production]
12:14 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/ratelimit: apply [production]
12:13 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/ratelimit: apply [production]
12:12 <cgoubert@deploy1003> helmfile [staging] DONE helmfile.d/services/ratelimit: apply [production]
12:12 <cgoubert@deploy1003> helmfile [staging] START helmfile.d/services/ratelimit: apply [production]
12:06 <kamila@deploy1003> Started scap sync-world: upgrade canaries to Debian Bookworm [production]
11:53 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/ratelimit: apply [production]
11:53 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool es1040: Migration of es1040.eqiad.wmnet completed [production]
11:52 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/ratelimit: apply [production]
11:52 <kamila@deploy1003> Finished scap sync-world: Upgrade mw-debug,mw-experimental to debian bookworm (duration: 33m 39s) [production]
11:51 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/ratelimit: apply [production]
11:50 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/ratelimit: apply [production]
11:49 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/ratelimit: apply [production]
11:48 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/ratelimit: apply [production]
11:48 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/ratelimit: apply [production]
11:48 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/ratelimit: apply [production]
11:47 <cgoubert@deploy1003> helmfile [staging] DONE helmfile.d/services/ratelimit: apply [production]
11:47 <cgoubert@deploy1003> helmfile [staging] START helmfile.d/services/ratelimit: apply [production]
11:47 <cgoubert@deploy1003> helmfile [staging] DONE helmfile.d/services/ratelimit: apply [production]
11:47 <cgoubert@deploy1003> helmfile [staging] START helmfile.d/services/ratelimit: apply [production]
11:41 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es1040.eqiad.wmnet with OS trixie [production]
11:24 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es1040.eqiad.wmnet with reason: host reimage [production]