51-100 of 10000 results (77ms)
2025-11-10 ยง
18:25 <dzahn@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: people1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - dzahn@cumin2002" [production]
18:24 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2091.codfw.wmnet with reason: host reimage [production]
18:23 <dzahn@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: people1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - dzahn@cumin2002" [production]
18:23 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
18:23 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
18:22 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
18:22 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
18:20 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
18:20 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
18:20 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
18:20 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
18:18 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcontrol1008-dev.eqiad.wmnet with OS trixie [production]
18:18 <andrew@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcontrol1008-dev.eqiad.wmnet with OS trixie [production]
18:17 <jhancock@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2093.codfw.wmnet with reason: host reimage [production]
18:17 <jhancock@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2091.codfw.wmnet with reason: host reimage [production]
18:16 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
18:16 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
18:15 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
18:15 <dzahn@cumin2002> START - Cookbook sre.dns.netbox [production]
18:15 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
18:15 <jhancock@cumin1003> START - Cookbook sre.hosts.reimage for host ms-be2094.codfw.wmnet with OS bullseye [production]
18:15 <jhancock@cumin1003> START - Cookbook sre.hosts.reimage for host ms-be2093.codfw.wmnet with OS bullseye [production]
18:14 <jhancock@cumin1003> START - Cookbook sre.hosts.reimage for host ms-be2091.codfw.wmnet with OS bullseye [production]
18:14 <jhancock@cumin1003> START - Cookbook sre.hosts.reimage for host ms-be2090.codfw.wmnet with OS bullseye [production]
18:12 <ryankemper> [WDQS] Restarted wdqs-main in codfw [production]
18:12 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
18:12 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
18:11 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
18:11 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
18:11 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
18:11 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
18:10 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
18:10 <dzahn@cumin2002> START - Cookbook sre.hosts.decommission for hosts people1004.eqiad.wmnet [production]
18:10 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
18:09 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on people1004.eqiad.wmnet with reason: decom [production]
18:06 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
18:05 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
18:05 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
18:05 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
18:04 <mmartorana@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
18:04 <mmartorana@deploy2002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
18:04 <mmartorana@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
18:04 <mmartorana@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
18:03 <mmartorana@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
18:03 <mmartorana@deploy2002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
18:03 <mmartorana@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
18:02 <mmartorana@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
18:02 <mmartorana@deploy2002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
18:01 <mmartorana@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
18:01 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]