651-700 of 10000 results (177ms)
2026-08-17 §
19:32 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1161.eqiad.wmnet with reason: host reimage [production]
19:29 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1195.eqiad.wmnet with reason: host reimage [production]
19:26 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1161.eqiad.wmnet with reason: host reimage [production]
19:26 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1160.eqiad.wmnet with reason: host reimage [production]
19:26 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1184.eqiad.wmnet with reason: host reimage [production]
19:26 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1162.eqiad.wmnet with reason: host reimage [production]
19:25 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1195.eqiad.wmnet with reason: host reimage [production]
19:19 <bking@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
19:11 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1195.eqiad.wmnet with OS bookworm [production]
19:10 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1194.eqiad.wmnet with OS bookworm [production]
19:10 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1184.eqiad.wmnet with OS bookworm [production]
19:10 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1162.eqiad.wmnet with OS bookworm [production]
19:10 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1161.eqiad.wmnet with OS bookworm [production]
19:10 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1160.eqiad.wmnet with OS bookworm [production]
19:10 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
19:09 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
19:03 <eevans@cumin1003> START - Cookbook sre.cassandra.roll-restart for nodes matching A:aqs-codfw: Upgrade to Java 17 — T433026 - eevans@cumin1003 [production]
18:58 <dancy@deploy1003> Finished scap sync-world: testing T375514 (duration: 03m 13s) [production]
18:55 <dancy@deploy1003> Started scap sync-world: testing T375514 [production]
18:55 <dwisehaupt@dns1006> END - running authdns-update [production]
18:54 <dancy@deploy1003> Installation of scap version "4.281.1" completed for 3 hosts [production]
18:54 <swfrench@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host conf2009.codfw.wmnet [production]
18:53 <dwisehaupt@dns1006> START - running authdns-update [production]
18:52 <dancy@deploy1003> Installing scap version "4.281.1" for 3 host(s) [production]
18:47 <swfrench@cumin2002> START - Cookbook sre.hosts.reboot-single for host conf2009.codfw.wmnet [production]
18:41 <swfrench@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host conf2008.codfw.wmnet [production]
18:34 <swfrench@cumin2002> START - Cookbook sre.hosts.reboot-single for host conf2008.codfw.wmnet [production]
18:30 <swfrench@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host conf2007.codfw.wmnet [production]
18:23 <swfrench@cumin2002> START - Cookbook sre.hosts.reboot-single for host conf2007.codfw.wmnet [production]
18:16 <dwisehaupt@dns1005> END - running authdns-update [production]
18:14 <dwisehaupt@dns1005> START - running authdns-update [production]
18:04 <swfrench@deploy1003> Finished scap sync-world: Deploy "Point Test Wiki to new docroot" - T432412 (duration: 26m 03s) [production]
18:00 <swfrench@deploy1003> swfrench: Continuing with deployment [production]
17:51 <vriley@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudvirt1057.eqiad.wmnet with OS trixie [production]
17:47 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1180.eqiad.wmnet with OS bookworm [production]
17:39 <swfrench@deploy1003> swfrench: Deploy "Point Test Wiki to new docroot" - T432412 synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:39 <cdobbins@cumin1003> START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-eqsin and A:cp - 9.2.15 upgrade (T434478) [production]
17:38 <swfrench@deploy1003> Started scap sync-world: Deploy "Point Test Wiki to new docroot" - T432412 [production]
17:36 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1159.eqiad.wmnet with OS bookworm [production]
17:34 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1158.eqiad.wmnet with OS bookworm [production]
17:30 <eevans@cumin1003> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:aqs-eqiad: Upgrade to Java 17 — T433026 - eevans@cumin1003 [production]
17:30 <cdobbins@cumin1003> END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-ulsfo or A:cp-drmrs and A:cp - 9.2.15 upgrade (T434620) [production]
17:28 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1157.eqiad.wmnet with OS bookworm [production]
17:23 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1180.eqiad.wmnet with reason: host reimage [production]
17:22 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
17:21 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1193.eqiad.wmnet with OS bookworm [production]
17:21 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
17:21 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
17:20 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
17:20 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]