1-50 of 10000 results (101ms)
2026-08-18 ยง
17:55 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1201.eqiad.wmnet with OS bookworm [production]
17:50 <ladsgroup@deploy1003> ladsgroup: Backport for [[gerrit:1326380|Introduce main lock manager service (T366938 T427999)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:48 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1326380|Introduce main lock manager service (T366938 T427999)]] [production]
17:48 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1156.eqiad.wmnet with reason: host reimage [production]
17:46 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1146.eqiad.wmnet with reason: host reimage [production]
17:45 <cdobbins@cumin1003> END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-esams and A:cp - 9.2.15 upgrade (T434478) [production]
17:42 <jasmine@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-ctrl2006.codfw.wmnet with OS trixie [production]
17:41 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1177.eqiad.wmnet with reason: host reimage [production]
17:38 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1202.eqiad.wmnet with reason: host reimage [production]
17:34 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1201.eqiad.wmnet with reason: host reimage [production]
17:30 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1156.eqiad.wmnet with reason: host reimage [production]
17:29 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1177.eqiad.wmnet with reason: host reimage [production]
17:28 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1146.eqiad.wmnet with reason: host reimage [production]
17:28 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1202.eqiad.wmnet with reason: host reimage [production]
17:27 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1201.eqiad.wmnet with reason: host reimage [production]
17:25 <jasmine@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-ctrl2006.codfw.wmnet with reason: host reimage [production]
17:21 <jasmine@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-ctrl2006.codfw.wmnet with reason: host reimage [production]
17:14 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1202.eqiad.wmnet with OS bookworm [production]
17:14 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1201.eqiad.wmnet with OS bookworm [production]
17:14 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1177.eqiad.wmnet with OS bookworm [production]
17:14 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1156.eqiad.wmnet with OS bookworm [production]
17:14 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1146.eqiad.wmnet with OS bookworm [production]
17:09 <dancy@deploy1003> Finished scap sync-world: Backport for [[gerrit:1326885|w/deployment-info.php: Handle new file format (T434726)]] (duration: 07m 15s) [production]
17:08 <jasmine@cumin2002> START - Cookbook sre.hosts.reimage for host wikikube-ctrl2006.codfw.wmnet with OS trixie [production]
17:05 <dancy@deploy1003> dancy: Continuing with deployment [production]
17:04 <dancy@deploy1003> dancy: Backport for [[gerrit:1326885|w/deployment-info.php: Handle new file format (T434726)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:02 <dancy@deploy1003> Started scap sync-world: Backport for [[gerrit:1326885|w/deployment-info.php: Handle new file format (T434726)]] [production]
16:50 <dancy@deploy1003> Finished scap sync-world: Testing T434726 (duration: 06m 40s) [production]
16:43 <dancy@deploy1003> Started scap sync-world: Testing T434726 [production]
16:43 <dancy@deploy1003> Installation of scap version "4.282.0" completed for 3 hosts [production]
16:41 <dancy@deploy1003> Installing scap version "4.282.0" for 3 host(s) [production]
16:41 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1145.eqiad.wmnet with OS bookworm [production]
16:34 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1200.eqiad.wmnet with OS bookworm [production]
16:32 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1199.eqiad.wmnet with OS bookworm [production]
16:18 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1145.eqiad.wmnet with reason: host reimage [production]
16:13 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1200.eqiad.wmnet with reason: host reimage [production]
16:09 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1199.eqiad.wmnet with reason: host reimage [production]
16:05 <cdobbins@cumin1003> START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-esams and A:cp - 9.2.15 upgrade (T434478) [production]
16:05 <cjd91> sudo -i cookbook sre.cdn.roll-upgrade-ats --query 'A:cp-esams' --task-id T434478 --reason '9.2.15 upgrade' [production]
16:03 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1200.eqiad.wmnet with reason: host reimage [production]
16:02 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1145.eqiad.wmnet with reason: host reimage [production]
16:02 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1199.eqiad.wmnet with reason: host reimage [production]
15:50 <moritzm> installing zip security updates [production]
15:48 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1200.eqiad.wmnet with OS bookworm [production]
15:47 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1199.eqiad.wmnet with OS bookworm [production]
15:47 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1145.eqiad.wmnet with OS bookworm [production]
15:41 <topranks> bounce PIC 0/0 on cr1-magru to set port to 40G [production]
15:37 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1236.eqiad.wmnet with OS bookworm [production]
15:29 <aikochou@deploy1003> helmfile [ml-serve-eqiad] 'sync' command on namespace 'ores-legacy' for release 'main' . [production]
15:26 <aikochou@deploy1003> helmfile [ml-serve-codfw] 'sync' command on namespace 'ores-legacy' for release 'main' . [production]