201-250 of 10000 results (177ms)
2026-08-14 ยง
08:07 <tappof@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host titan2002.codfw.wmnet [production]
08:05 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db2209: Pool back [production]
08:05 <btullis@cumin1003> START - Cookbook sre.dns.netbox [production]
08:00 <tappof@cumin1003> START - Cookbook sre.hosts.reboot-single for host titan2002.codfw.wmnet [production]
07:59 <btullis@cumin1003> START - Cookbook sre.hosts.move-vlan for host an-worker1229 [production]
07:58 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host an-worker1230 [production]
07:58 <btullis@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host an-worker1230 [production]
07:55 <btullis@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host an-worker1230 [production]
07:55 <btullis@cumin1003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) an-worker1230.eqiad.wmnet 23.53.64.10.in-addr.arpa 3.2.0.0.3.5.0.0.4.6.0.0.0.1.0.0.8.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
07:55 <btullis@cumin1003> START - Cookbook sre.dns.wipe-cache an-worker1230.eqiad.wmnet 23.53.64.10.in-addr.arpa 3.2.0.0.3.5.0.0.4.6.0.0.0.1.0.0.8.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
07:55 <btullis@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
07:55 <btullis@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host an-worker1230 - btullis@cumin1003" [production]
07:55 <btullis@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host an-worker1230 - btullis@cumin1003" [production]
07:51 <jayme@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubestagemaster2005.codfw.wmnet with OS trixie [production]
07:48 <btullis@cumin1003> START - Cookbook sre.dns.netbox [production]
07:41 <btullis@cumin1003> START - Cookbook sre.hosts.move-vlan for host an-worker1230 [production]
07:41 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1229.eqiad.wmnet with OS bookworm [production]
07:41 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1230.eqiad.wmnet with OS bookworm [production]
07:39 <marostegui@cumin1003> dbctl commit (dc=all): 'Remove db1152 from dbctl T434480', diff saved to https://phabricator.wikimedia.org/P96090 and previous config saved to /var/cache/conftool/dbconfig/20260814-073941-marostegui.json [production]
07:29 <jayme@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubestagemaster2005.codfw.wmnet with reason: host reimage [production]
07:23 <jayme@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on kubestagemaster2005.codfw.wmnet with reason: host reimage [production]
07:04 <jayme@cumin1003> START - Cookbook sre.hosts.reimage for host kubestagemaster2005.codfw.wmnet with OS trixie [production]
06:53 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1228.eqiad.wmnet with OS bookworm [production]
06:44 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1227.eqiad.wmnet with OS bookworm [production]
06:38 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1209.eqiad.wmnet with OS bookworm [production]
06:36 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1175.eqiad.wmnet with OS bookworm [production]
06:33 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1228.eqiad.wmnet with reason: host reimage [production]
06:27 <ryankemper@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1228.eqiad.wmnet with reason: host reimage [production]
06:25 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1227.eqiad.wmnet with reason: host reimage [production]
06:21 <ryankemper@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1227.eqiad.wmnet with reason: host reimage [production]
06:18 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1209.eqiad.wmnet with reason: host reimage [production]
06:14 <ryankemper@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1209.eqiad.wmnet with reason: host reimage [production]
06:14 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host an-worker1228 [production]
06:14 <ryankemper@cumin2003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host an-worker1228 [production]
06:13 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1175.eqiad.wmnet with reason: host reimage [production]
06:12 <ryankemper@cumin2003> START - Cookbook sre.network.configure-switch-interfaces for host an-worker1228 [production]
06:12 <ryankemper@cumin2003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) an-worker1228.eqiad.wmnet 20.53.64.10.in-addr.arpa 0.2.0.0.3.5.0.0.4.6.0.0.0.1.0.0.8.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
06:12 <ryankemper@cumin2003> START - Cookbook sre.dns.wipe-cache an-worker1228.eqiad.wmnet 20.53.64.10.in-addr.arpa 0.2.0.0.3.5.0.0.4.6.0.0.0.1.0.0.8.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
06:12 <ryankemper@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
06:12 <ryankemper@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host an-worker1228 - ryankemper@cumin2003" [production]
06:12 <ryankemper@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host an-worker1228 - ryankemper@cumin2003" [production]
06:09 <ryankemper@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1175.eqiad.wmnet with reason: host reimage [production]
06:07 <ryankemper@cumin2003> START - Cookbook sre.dns.netbox [production]
06:07 <ryankemper@cumin2003> START - Cookbook sre.hosts.move-vlan for host an-worker1228 [production]
06:07 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host an-worker1227 [production]
06:07 <ryankemper@cumin2003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host an-worker1227 [production]
06:06 <ryankemper@cumin2003> START - Cookbook sre.network.configure-switch-interfaces for host an-worker1227 [production]
06:06 <ryankemper@cumin2003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) an-worker1227.eqiad.wmnet 19.53.64.10.in-addr.arpa 9.1.0.0.3.5.0.0.4.6.0.0.0.1.0.0.8.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
06:06 <ryankemper@cumin2003> START - Cookbook sre.dns.wipe-cache an-worker1227.eqiad.wmnet 19.53.64.10.in-addr.arpa 9.1.0.0.3.5.0.0.4.6.0.0.0.1.0.0.8.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
06:06 <ryankemper@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]