51-100 of 10000 results (28ms)
2026-04-24 ยง
14:00 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1185: after reimage to trixie [production]
14:00 <moritzm> imported zookeeper 3.4.13-6+deb11u1~wmf13u1 into component/zookeeper34 for trixie-wikimedia (forward port of Zookeeper 3.4 from Bullseye to Trixie) T424266 [production]
13:59 <moritzm> imported zookeeper 3.4.13-6+deb11u1~wmf13u1 into component/zookeeper34 for trixie-wikimedia (forward port of Zookeeper 3.4 from Bullseye to Trixie) [production]
13:55 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1219 (T419635)', diff saved to https://phabricator.wikimedia.org/P91485 and previous config saved to /var/cache/conftool/dbconfig/20260424-135555-fceratto.json [production]
13:55 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1219.eqiad.wmnet with reason: Maintenance [production]
13:55 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1218 (T419635)', diff saved to https://phabricator.wikimedia.org/P91484 and previous config saved to /var/cache/conftool/dbconfig/20260424-135529-fceratto.json [production]
13:47 <klausman@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve1014.eqiad.wmnet [production]
13:45 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1218', diff saved to https://phabricator.wikimedia.org/P91482 and previous config saved to /var/cache/conftool/dbconfig/20260424-134522-fceratto.json [production]
13:41 <klausman@cumin1003> START - Cookbook sre.hosts.reboot-single for host ml-serve1014.eqiad.wmnet [production]
13:40 <klausman@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve1014.eqiad.wmnet [production]
13:35 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1218', diff saved to https://phabricator.wikimedia.org/P91479 and previous config saved to /var/cache/conftool/dbconfig/20260424-133513-fceratto.json [production]
13:33 <klausman@cumin1003> START - Cookbook sre.hosts.reboot-single for host ml-serve1014.eqiad.wmnet [production]
13:31 <klausman@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve1015.eqiad.wmnet [production]
13:26 <klausman@cumin1003> START - Cookbook sre.hosts.reboot-single for host ml-serve1015.eqiad.wmnet [production]
13:25 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1218 (T419635)', diff saved to https://phabricator.wikimedia.org/P91476 and previous config saved to /var/cache/conftool/dbconfig/20260424-132505-fceratto.json [production]
13:21 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db2223: after reimage to trixie [production]
13:19 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2223.codfw.wmnet with OS trixie [production]
13:18 <klausman@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve1015.eqiad.wmnet [production]
13:14 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db1185: after reimage to trixie [production]
13:12 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1185.eqiad.wmnet with OS trixie [production]
13:11 <klausman@cumin1003> START - Cookbook sre.hosts.reboot-single for host ml-serve1015.eqiad.wmnet [production]
13:08 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1218 (T419635)', diff saved to https://phabricator.wikimedia.org/P91473 and previous config saved to /var/cache/conftool/dbconfig/20260424-130840-fceratto.json [production]
13:08 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1218.eqiad.wmnet with reason: Maintenance [production]
13:08 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1206 (T419635)', diff saved to https://phabricator.wikimedia.org/P91472 and previous config saved to /var/cache/conftool/dbconfig/20260424-130815-fceratto.json [production]
12:58 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P91471 and previous config saved to /var/cache/conftool/dbconfig/20260424-125807-fceratto.json [production]
12:54 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2223.codfw.wmnet with reason: host reimage [production]
12:50 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1185.eqiad.wmnet with reason: host reimage [production]
12:47 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P91470 and previous config saved to /var/cache/conftool/dbconfig/20260424-124759-fceratto.json [production]
12:45 <marostegui@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db2223.codfw.wmnet with reason: host reimage [production]
12:42 <marostegui@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db1185.eqiad.wmnet with reason: host reimage [production]
12:37 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1206 (T419635)', diff saved to https://phabricator.wikimedia.org/P91468 and previous config saved to /var/cache/conftool/dbconfig/20260424-123751-fceratto.json [production]
12:29 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1244 (T419961)', diff saved to https://phabricator.wikimedia.org/P91467 and previous config saved to /var/cache/conftool/dbconfig/20260424-122939-fceratto.json [production]
12:29 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1244.eqiad.wmnet with reason: Maintenance [production]
12:29 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1243 (T419961)', diff saved to https://phabricator.wikimedia.org/P91466 and previous config saved to /var/cache/conftool/dbconfig/20260424-122910-fceratto.json [production]
12:28 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host db1185.eqiad.wmnet with OS trixie [production]
12:28 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host db2223.codfw.wmnet with OS trixie [production]
12:27 <Reedy> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1276428 [releng]
12:27 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2223: Reimage to Trixie [production]
12:27 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1185: Reimage to Trixie [production]
12:27 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2223: Reimage to Trixie [production]
12:27 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db1185: Reimage to Trixie [production]
12:27 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2223.codfw.wmnet with reason: Reimage to Trixie [production]
12:27 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db1185.eqiad.wmnet with reason: Reimage to Trixie [production]
12:21 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1206 (T419635)', diff saved to https://phabricator.wikimedia.org/P91463 and previous config saved to /var/cache/conftool/dbconfig/20260424-122125-fceratto.json [production]
12:21 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1206.eqiad.wmnet with reason: Maintenance [production]
12:21 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1196 (T419635)', diff saved to https://phabricator.wikimedia.org/P91462 and previous config saved to /var/cache/conftool/dbconfig/20260424-122100-fceratto.json [production]
12:19 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1243', diff saved to https://phabricator.wikimedia.org/P91461 and previous config saved to /var/cache/conftool/dbconfig/20260424-121902-fceratto.json [production]
12:17 <elukey@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'sync'. [production]
12:17 <elukey@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'sync'. [production]
12:17 <elukey@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]