151-200 of 10000 results (15ms)
2026-08-04 ยง
13:31 <otto@deploy1003> helmfile [codfw] START helmfile.d/services/eventstreams: apply [production]
13:31 <otto@deploy1003> helmfile [staging] DONE helmfile.d/services/eventstreams: apply [production]
13:31 <otto@deploy1003> helmfile [staging] START helmfile.d/services/eventstreams: apply [production]
13:29 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1154.eqiad.wmnet [production]
13:28 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1154.eqiad.wmnet [production]
13:28 <jayme@cumin1003> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1154.eqiad.wmnet [production]
13:28 <jayme@cumin1003> END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=1) Renumbering for host wikikube-worker1141.eqiad.wmnet [production]
13:28 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1141.eqiad.wmnet [production]
13:28 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1141.eqiad.wmnet [production]
13:26 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer [toolsbeta]
13:22 <otto@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply [production]
13:22 <otto@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply [production]
13:06 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1096.eqiad.wmnet with OS trixie [production]
13:05 <swfrench@dns1004> END - running authdns-update [production]
13:03 <swfrench@dns1004> START - running authdns-update [production]
12:49 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1096.eqiad.wmnet with reason: host reimage [production]
12:43 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 1:00:00 on db1171.eqiad.wmnet with reason: decom [production]
12:42 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 1:00:00 on db1150.eqiad.wmnet with reason: decom [production]
12:42 <mvernon@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1096.eqiad.wmnet with reason: host reimage [production]
12:38 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db[1164,1217].eqiad.wmnet with reason: cloning [production]
12:33 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2096.codfw.wmnet with OS trixie [production]
12:22 <mvernon@cumin1003> START - Cookbook sre.hosts.reimage for host ms-be1096.eqiad.wmnet with OS trixie [production]
12:18 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-harbor [tools]
12:14 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2096.codfw.wmnet with reason: host reimage [production]
12:14 <jayme@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1141.eqiad.wmnet with OS trixie [production]
12:13 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-harbor [tools]
12:10 <mvernon@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2096.codfw.wmnet with reason: host reimage [production]
12:10 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1289.eqiad.wmnet [production]
12:10 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component maintain-harbor [tools]
12:07 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-harbor [tools]
12:06 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-harbor [toolsbeta]
12:05 <cwilliams@cumin1003> START - Cookbook sre.hosts.reboot-single for host db1289.eqiad.wmnet [production]
12:05 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1288.eqiad.wmnet [production]
12:04 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-harbor [toolsbeta]
11:59 <cwilliams@cumin1003> START - Cookbook sre.hosts.reboot-single for host db1288.eqiad.wmnet [production]
11:59 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1287.eqiad.wmnet [production]
11:56 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers [tools]
11:54 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1097.eqiad.wmnet with OS trixie [production]
11:54 <cwilliams@cumin1003> START - Cookbook sre.hosts.reboot-single for host db1287.eqiad.wmnet [production]
11:54 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1286.eqiad.wmnet [production]
11:53 <jayme@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1141.eqiad.wmnet with reason: host reimage [production]
11:51 <mvernon@cumin2003> START - Cookbook sre.hosts.reimage for host ms-be2096.codfw.wmnet with OS trixie [production]
11:49 <jayme@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1141.eqiad.wmnet with reason: host reimage [production]
11:48 <cwilliams@cumin1003> START - Cookbook sre.hosts.reboot-single for host db1286.eqiad.wmnet [production]
11:48 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1284.eqiad.wmnet [production]
11:43 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2095.codfw.wmnet with OS trixie [production]
11:43 <cwilliams@cumin1003> START - Cookbook sre.hosts.reboot-single for host db1284.eqiad.wmnet [production]
11:43 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1283.eqiad.wmnet [production]
11:42 <klausman@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on ml-serve1015.eqiad.wmnet with reason: Downtime to get full picture of current BIOS settings beyond what Redfish shows [production]
11:39 <cmooney@cumin1003> END (FAIL) - Cookbook sre.network.tls (exit_code=99) for network device lswtest-d8-eqiad [production]