101-150 of 10000 results (85ms)
2026-04-14 ยง
07:36 <mvernon@cumin2002> START - Cookbook sre.hosts.move-vlan for host ms-be2068 [production]
07:35 <mvernon@cumin2002> START - Cookbook sre.hosts.reimage for host ms-be2068.codfw.wmnet with OS bullseye [production]
07:32 <marostegui@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db2180.codfw.wmnet with reason: host reimage [production]
07:22 <mszwarc@deploy1003> Finished scap sync-world: Backport for [[gerrit:1270772|Prepare $wgOATH2FARequiredGroupRemovalPages for next groups (T423118)]] (duration: 12m 36s) [production]
07:16 <mszwarc@deploy1003> mszwarc: Continuing with sync [production]
07:15 <mszwarc@deploy1003> mszwarc: Backport for [[gerrit:1270772|Prepare $wgOATH2FARequiredGroupRemovalPages for next groups (T423118)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:14 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host db2180.codfw.wmnet with OS trixie [production]
07:12 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2180: Reimage to Trixie [production]
07:11 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2180: Reimage to Trixie [production]
07:11 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2180.codfw.wmnet with reason: Reimage to Trixie [production]
07:11 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2180.codfw.wmnet with reason: Reimage to Trixie [production]
07:10 <mszwarc@deploy1003> Started scap sync-world: Backport for [[gerrit:1270772|Prepare $wgOATH2FARequiredGroupRemovalPages for next groups (T423118)]] [production]
07:09 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2180.codfw.wmnet with reason: Reimage to Trixie [production]
07:09 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2180.codfw.wmnet with reason: Reimage to Trixie [production]
07:06 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db1180: after upgrade [production]
06:58 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2217: repool after reimage to trixie [production]
06:57 <jmm@dns1004> END - running authdns-update [production]
06:56 <jmm@dns1004> START - running authdns-update [production]
06:47 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetserver1002.eqiad.wmnet [production]
06:40 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host puppetserver1002.eqiad.wmnet [production]
06:40 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetserver2002.codfw.wmnet [production]
06:33 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host puppetserver2002.codfw.wmnet [production]
06:30 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
06:30 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1180.eqiad.wmnet with OS trixie [production]
06:30 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
06:27 <jmm@dns1004> END - running authdns-update [production]
06:25 <jmm@dns1004> START - running authdns-update [production]
06:22 <jmm@dns1004> END - running authdns-update [production]
06:20 <jmm@dns1004> START - running authdns-update [production]
06:13 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db2217: repool after reimage to trixie [production]
06:11 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2217.codfw.wmnet with OS trixie [production]
06:08 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1180.eqiad.wmnet with reason: host reimage [production]
06:02 <marostegui@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db1180.eqiad.wmnet with reason: host reimage [production]
06:02 <jmm@dns1004> END - running authdns-update [production]
06:00 <jmm@dns1004> START - running authdns-update [production]
05:54 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2217.codfw.wmnet with reason: host reimage [production]
05:49 <marostegui@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db2217.codfw.wmnet with reason: host reimage [production]
05:47 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host db1180.eqiad.wmnet with OS trixie [production]
05:46 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db1180: Upgrade package [production]
05:35 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db1180.eqiad.wmnet with reason: Reimage to Trixie [production]
05:35 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db1180: Upgrade package [production]
05:30 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host db2217.codfw.wmnet with OS trixie [production]
05:28 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2217: Reimage [production]
05:27 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2217: Reimage [production]
05:27 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2217.codfw.wmnet with reason: Reimage to Trixie [production]
04:02 <mwpresync@deploy1003> Pruned MediaWiki: 1.46.0-wmf.21 (duration: 02m 34s) [production]
03:39 <mwpresync@deploy1003> Finished scap sync-world: testwikis to 1.46.0-wmf.24 refs T420482 (duration: 35m 44s) [production]
03:03 <mwpresync@deploy1003> Started scap sync-world: testwikis to 1.46.0-wmf.24 refs T420482 [production]
00:57 <ladsgroup@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1227: Work done [production]
00:51 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for aqs1025.eqiad.wmnet [production]