351-400 of 10000 results (24ms)
2026-03-13 ยง
12:07 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
12:03 <aokoth@cumin1003> START - Cookbook sre.hosts.reboot-single for host vrts2002.codfw.wmnet [production]
12:02 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
12:02 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
12:01 <jynus@cumin1003> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host backup1016.eqiad.wmnet [production]
12:01 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-worker1019.eqiad.wmnet [production]
11:59 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-worker1018.eqiad.wmnet [production]
11:59 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
11:59 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
11:54 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host dse-k8s-worker1019.eqiad.wmnet [production]
11:54 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host dse-k8s-worker1018.eqiad.wmnet [production]
11:51 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
11:51 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
11:50 <jynus@cumin1003> START - Cookbook sre.hosts.reboot-single for host backup1016.eqiad.wmnet [production]
11:49 <jynus@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-backup2004.codfw.wmnet [production]
11:43 <jynus@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-backup2004.codfw.wmnet [production]
11:43 <jynus@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-backup1004.eqiad.wmnet [production]
11:37 <jynus@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-backup1004.eqiad.wmnet [production]
11:36 <jynus@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-backup2003.codfw.wmnet [production]
11:34 <jynus@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-backup1003.eqiad.wmnet [production]
11:32 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker1018.eqiad.wmnet with OS bookworm [production]
11:32 <btullis@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" [production]
11:30 <jynus@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-backup2003.codfw.wmnet [production]
11:28 <jynus@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-backup1003.eqiad.wmnet [production]
11:27 <btullis@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" [production]
11:26 <jelto@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy1001.eqiad.wmnet [production]
11:21 <arnaudb@cumin1003> END (ERROR) - Cookbook sre.hosts.reboot-single (exit_code=97) for host contint1003.wikimedia.org [production]
11:21 <jelto@cumin1003> START - Cookbook sre.hosts.reboot-single for host tcp-proxy1001.eqiad.wmnet [production]
11:21 <jelto@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy1002.eqiad.wmnet [production]
11:16 <jelto@cumin1003> START - Cookbook sre.hosts.reboot-single for host tcp-proxy1002.eqiad.wmnet [production]
11:16 <jelto@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy2001.codfw.wmnet [production]
11:16 <arnaudb@cumin1003> START - Cookbook sre.hosts.reboot-single for host contint1003.wikimedia.org [production]
11:12 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:wikikube-staging-master-codfw [production]
11:12 <arnaudb@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host zuul1001.eqiad.wmnet [production]
11:11 <jelto@cumin1003> START - Cookbook sre.hosts.reboot-single for host tcp-proxy2001.codfw.wmnet [production]
11:11 <jelto@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy2002.codfw.wmnet [production]
11:09 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker1018.eqiad.wmnet with reason: host reimage [production]
11:09 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker1019.eqiad.wmnet with OS bookworm [production]
11:09 <btullis@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" [production]
11:09 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:wikikube-staging-master-eqiad [production]
11:08 <btullis@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" [production]
11:08 <arnaudb@cumin1003> START - Cookbook sre.hosts.reboot-single for host zuul1001.eqiad.wmnet [production]
11:08 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcontrol1008-dev.eqiad.wmnet [production]
11:07 <jelto@cumin1003> START - Cookbook sre.hosts.reboot-single for host tcp-proxy2002.codfw.wmnet [production]
11:06 <jelto@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy3001.esams.wmnet [production]
11:05 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker1018.eqiad.wmnet with reason: host reimage [production]
11:01 <jelto@cumin1003> START - Cookbook sre.hosts.reboot-single for host tcp-proxy3001.esams.wmnet [production]
11:01 <filippo@cumin1003> START - Cookbook sre.hosts.reboot-single for host cloudcontrol1008-dev.eqiad.wmnet [production]
11:01 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudbackup1002-dev.eqiad.wmnet [production]
11:01 <jelto@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy3002.esams.wmnet [production]