101-150 of 10000 results (24ms)
2026-06-11 ยง
10:01 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
09:58 <jiji@deploy1003> Finished scap sync-world: Backport for [[gerrit:1300580|ProductionServices.php: switch filebackend.php back to rdb1013 (T291916 T419976)]] (duration: 15m 41s) [production]
09:54 <jiji@deploy1003> jiji: Continuing with deployment [production]
09:46 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2045.codfw.wmnet with reason: host reimage [production]
09:45 <jiji@deploy1003> jiji: Backport for [[gerrit:1300580|ProductionServices.php: switch filebackend.php back to rdb1013 (T291916 T419976)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
09:45 <hashar> Converted mediawiki/core branches REL1_39, REL1_40, REL1_41, REL1_42 to tags # T428864 [releng]
09:43 <jiji@deploy1003> Started scap sync-world: Backport for [[gerrit:1300580|ProductionServices.php: switch filebackend.php back to rdb1013 (T291916 T419976)]] [production]
09:42 <marostegui@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on es2045.codfw.wmnet with reason: host reimage [production]
09:37 <elukey> uploaded spicerack_12.8.0 to apt.wikimedia.org bookworm-wikimedia,trixie-wikimedia [production]
09:26 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host es2045.codfw.wmnet with OS trixie [production]
09:26 <marostegui@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host es2045.codfw.wmnet with OS bookworm [production]
09:25 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]
09:25 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2176: Migration of db2176.codfw.wmnet completed [production]
09:19 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]
09:19 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1219: Migration of db1219.eqiad.wmnet completed [production]
09:18 <hashar> Converting REL1_42 branches to tags # T428864 [releng]
09:18 <hashar> Converting REL1_41 branches to tags # T428864 [releng]
09:11 <claime> cumin -x 'A:swift-fe' "disable-puppet 'Disabling puppet for ratelimit deploy - cgoubert'" [production]
09:05 <hashar> Converting REL1_40 branches to tags # T428864 [releng]
08:57 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host es2045.codfw.wmnet with OS bookworm [production]
08:56 <hashar> Converting REL1_39 branches to tags # T428864 [releng]
08:40 <hashar> gerrit: deleted mediawiki/core branch "development" that pointed to 7f622781cc31053b121f6f4ddbff506cba10d38e (which is contained by master). Had probably been created by a direct push. [releng]
08:39 <cwilliams@cumin1003> START - Cookbook sre.mysql.pool pool db2176: Migration of db2176.codfw.wmnet completed [production]
08:34 <atsuko@deploy1003> mwscript-k8s job started: foreachwikiindblist mwscript.dblist extensions/Translate/scripts/ttmserver-export.php --ttmserver eqiad-test # T425377 populating ttmserver index on test cluster to estimate time required for the release (dblist: https://phabricator.wikimedia.org/P94055) [production]
08:34 <cwilliams@cumin1003> START - Cookbook sre.mysql.pool pool db1219: Migration of db1219.eqiad.wmnet completed [production]
08:33 <atsuko@deploy1003> mwscript-k8s job started: foreachwikiindblist mwscript.dblist extensions/Translate/scripts/ttmserver-export.php --ttmserver eqiad-test # T425377 populating ttmserver index on test cluster to estimate time required for the release (dblist: https://phabricator.wikimedia.org/P94053) [production]
08:30 <jnuche@deploy1003> Finished deploy [releng/jenkins-deploy@6200ab1] (releasing): T428823 (duration: 01m 18s) [production]
08:29 <jnuche@deploy1003> Started deploy [releng/jenkins-deploy@6200ab1] (releasing): T428823 [production]
08:27 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2176.codfw.wmnet with OS trixie [production]
08:25 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool pc1021: Migration to 10.11.17 [production]
08:25 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) [production]
08:25 <marostegui@cumin1003> START - Cookbook sre.mysql.parsercache [production]
08:25 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool pc1021: Migration to 10.11.17 [production]
08:25 <atsuko@deploy1003> mwscript-k8s job started: foreachwikiindblist mwscript.dblist extensions/Translate/scripts/ttmserver-export.php --ttmserver eqiad-test # T425377 populating ttmserver index on test cluster to estimate time required for the release (dblist: https://phabricator.wikimedia.org/P94052) [production]
08:24 <jnuche@deploy1003> Finished deploy [releng/jenkins-deploy@6200ab1] (releasing): Testing upgrade for T428823 (duration: 01m 17s) [production]
08:23 <jnuche@deploy1003> Started deploy [releng/jenkins-deploy@6200ab1] (releasing): Testing upgrade for T428823 [production]
08:22 <atsuko@deploy1003> mwscript-k8s job started: foreachwikiindblist mwscript.dblist extensions/Translate/scripts/ttmserver-export.php --ttmserver eqiad-test # T425377 populating ttmserver index on test cluster to estimate time required for the release (dblist: https://phabricator.wikimedia.org/P94051) [production]
08:22 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1219.eqiad.wmnet with OS trixie [production]
08:17 <moritzm> installing PHP 8.2 security updates [production]
08:15 <dcausse@deploy1003> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
08:14 <dcausse@deploy1003> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
08:11 <dcausse@deploy1003> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
08:11 <dcausse@deploy1003> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
08:09 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2176.codfw.wmnet with reason: host reimage [production]
08:08 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host rdb1013.eqiad.wmnet with OS trixie [production]
08:06 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti5004.eqsin.wmnet to cluster eqsin02 and group 01 [production]
08:06 <dcausse@deploy1003> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
08:06 <dcausse@deploy1003> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
08:05 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on pc2021.codfw.wmnet,pc1021.eqiad.wmnet with reason: upgrade [production]
08:05 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1219.eqiad.wmnet with reason: host reimage [production]