1-50 of 10000 results (121ms)
2026-06-25 ยง
14:42 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host db2234.codfw.wmnet with OS trixie [production]
14:38 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2245.codfw.wmnet with reason: host reimage [production]
14:36 <marostegui> Drop database apiportalwiki on sanitarium and wikireplicas T430102 [production]
14:34 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1247.eqiad.wmnet with reason: host reimage [production]
14:30 <cwilliams@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db2245.codfw.wmnet with reason: host reimage [production]
14:28 <cwilliams@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db1247.eqiad.wmnet with reason: host reimage [production]
14:28 <jmm@cumin2003> START - Cookbook sre.hosts.reimage for host build2004.codfw.wmnet with OS trixie [production]
14:21 <hashar> Restarting CI Jenkins on contint1002 [production]
14:14 <cwilliams@cumin1003> START - Cookbook sre.hosts.reimage for host db2245.codfw.wmnet with OS trixie [production]
14:12 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2245: Upgrading db2245.codfw.wmnet [production]
14:12 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2245: Upgrading db2245.codfw.wmnet [production]
14:11 <cwilliams@cumin1003> dbmaint on s4@codfw T429893 [production]
14:11 <cwilliams@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
14:11 <cwilliams@cumin1003> START - Cookbook sre.hosts.reimage for host db1247.eqiad.wmnet with OS trixie [production]
14:09 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1247: Upgrading db1247.eqiad.wmnet [production]
14:08 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1247: Upgrading db1247.eqiad.wmnet [production]
14:08 <cwilliams@cumin1003> dbmaint on s4@eqiad T429893 [production]
14:08 <cwilliams@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
14:05 <Dreamy_Jazz> Ran `delete from cuci_user where ciu_ciwm_id = 4;` for T430156 [production]
14:04 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1077.eqiad.wmnet with OS trixie [production]
14:00 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]
14:00 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2237: Migration of db2237.codfw.wmnet completed [production]
13:57 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]
13:57 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1243: Migration of db1243.eqiad.wmnet completed [production]
13:55 <ayounsi@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2224: rack depool [production]
13:54 <ayounsi@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2225: rack depool [production]
13:51 <jmm@cumin2003> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=97) for new host build2004.codfw.wmnet [production]
13:51 <jmm@cumin2003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host build2004.codfw.wmnet with OS trixie [production]
13:37 <moritzm> installing imagemagick security updates [production]
13:28 <cscott@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
13:28 <cscott@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
13:28 <cscott@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
13:28 <cscott@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
13:21 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti2028.codfw.wmnet to cluster codfw and group A [production]
13:19 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1077.eqiad.wmnet with reason: host reimage [production]
13:16 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply [production]
13:16 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply [production]
13:16 <zabe> zabe@deploy1003:~$ mwscript namespaceDupes.php isvwiki --fix # T429935 [production]
13:15 <cwilliams@cumin1003> START - Cookbook sre.mysql.pool pool db2237: Migration of db2237.codfw.wmnet completed [production]
13:14 <cscott@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
13:14 <cscott@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
13:14 <cscott@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
13:13 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1305476|isvwiki: set timezone, sitename and logos (T429935)]], [[gerrit:1248909|Use Hadoop for Mostcategories on commonswiki (T413362)]] (duration: 07m 30s) [production]
13:13 <cscott@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
13:12 <filippo@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1077.eqiad.wmnet with reason: host reimage [production]
13:11 <cwilliams@cumin1003> START - Cookbook sre.mysql.pool pool db1243: Migration of db1243.eqiad.wmnet completed [production]
13:09 <ayounsi@cumin1003> START - Cookbook sre.mysql.pool pool db2224: rack depool [production]
13:09 <zabe@deploy1003> zabe, anzx: Continuing with deployment [production]
13:09 <ayounsi@cumin1003> START - Cookbook sre.mysql.pool pool db2225: rack depool [production]
13:08 <ayounsi@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs2003.codfw.wmnet,dse-k8s-wdqs-test2001.codfw.wmnet [production]