4601-4650 of 10000 results (90ms)
2023-02-28 ยง
12:27 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-serve2002.codfw.wmnet with OS bullseye [production]
12:24 <root@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve2001.codfw.wmnet with reason: host reimage [production]
12:22 <klausman@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ml-serve2007.codfw.wmnet with reason: host reimage [production]
12:21 <klausman@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve2006.codfw.wmnet with reason: host reimage [production]
12:19 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve2004.codfw.wmnet with reason: host reimage [production]
12:17 <root@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve2001.codfw.wmnet with reason: host reimage [production]
12:17 <klausman@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve2005.codfw.wmnet with reason: host reimage [production]
12:15 <klausman@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve2008.codfw.wmnet with reason: host reimage [production]
12:12 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve2003.codfw.wmnet with reason: host reimage [production]
12:12 <klausman@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve2007.codfw.wmnet with reason: host reimage [production]
12:11 <klausman@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve2008.codfw.wmnet with reason: host reimage [production]
12:11 <klausman@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve2005.codfw.wmnet with reason: host reimage [production]
12:11 <klausman@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve2006.codfw.wmnet with reason: host reimage [production]
12:10 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve2002.codfw.wmnet with reason: host reimage [production]
12:09 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve2004.codfw.wmnet with reason: host reimage [production]
12:07 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve2003.codfw.wmnet with reason: host reimage [production]
12:07 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve2002.codfw.wmnet with reason: host reimage [production]
11:56 <klausman@cumin1001> START - Cookbook sre.hosts.reimage for host ml-serve2005.codfw.wmnet with OS bullseye [production]
11:55 <klausman@cumin1001> START - Cookbook sre.hosts.reimage for host ml-serve2006.codfw.wmnet with OS bullseye [production]
11:55 <klausman@cumin1001> START - Cookbook sre.hosts.reimage for host ml-serve2007.codfw.wmnet with OS bullseye [production]
11:55 <klausman@cumin1001> START - Cookbook sre.hosts.reimage for host ml-serve2008.codfw.wmnet with OS bullseye [production]
11:51 <elukey@cumin1001> START - Cookbook sre.hosts.reimage for host ml-serve2004.codfw.wmnet with OS bullseye [production]
11:50 <elukey@cumin1001> START - Cookbook sre.hosts.reimage for host ml-serve2003.codfw.wmnet with OS bullseye [production]
11:49 <elukey@cumin1001> START - Cookbook sre.hosts.reimage for host ml-serve2002.codfw.wmnet with OS bullseye [production]
11:48 <root@cumin1001> START - Cookbook sre.hosts.reimage for host ml-serve2001.codfw.wmnet with OS bullseye [production]
11:39 <root@cumin1001> END (PASS) - Cookbook sre.ganeti.reimage (exit_code=0) for host ml-serve-ctrl2002.codfw.wmnet with OS bullseye [production]
11:24 <root@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve-ctrl2002.codfw.wmnet with reason: host reimage [production]
11:21 <root@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve-ctrl2002.codfw.wmnet with reason: host reimage [production]
11:21 <marostegui> Install MariaDB 11.0.1 on db1106 T330643 [production]
11:11 <root@cumin1001> START - Cookbook sre.ganeti.reimage for host ml-serve-ctrl2002.codfw.wmnet with OS bullseye [production]
11:11 <root@cumin1001> END (PASS) - Cookbook sre.ganeti.reimage (exit_code=0) for host ml-serve-ctrl2001.codfw.wmnet with OS bullseye [production]
11:04 <jmm@cumin2002> END (PASS) - Cookbook sre.cdn.roll-restart-reboot-ncredir (exit_code=0) rolling restart_daemons on A:ncredir [production]
10:55 <jmm@cumin2002> START - Cookbook sre.cdn.roll-restart-reboot-ncredir rolling restart_daemons on A:ncredir [production]
10:54 <root@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve-ctrl2001.codfw.wmnet with reason: host reimage [production]
10:51 <jmm@cumin2002> END (PASS) - Cookbook sre.cdn.roll-restart-reboot-ncredir (exit_code=0) rolling restart_daemons on A:ncredir-ulsfo [production]
10:51 <root@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve-ctrl2001.codfw.wmnet with reason: host reimage [production]
10:50 <jmm@cumin2002> START - Cookbook sre.cdn.roll-restart-reboot-ncredir rolling restart_daemons on A:ncredir-ulsfo [production]
10:49 <elukey@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: sync [production]
10:49 <elukey@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: sync [production]
10:38 <root@cumin1001> START - Cookbook sre.ganeti.reimage for host ml-serve-ctrl2001.codfw.wmnet with OS bullseye [production]
10:33 <root@cumin1001> START - Cookbook sre.k8s.upgrade-cluster Upgrade K8s version: Upgrade to k8s 1.23 [production]
10:32 <root@cumin1001> END (FAIL) - Cookbook sre.k8s.upgrade-cluster (exit_code=99) Upgrade K8s version: Upgrade to k8s 1.23 [production]
10:32 <root@cumin1001> START - Cookbook sre.k8s.upgrade-cluster Upgrade K8s version: Upgrade to k8s 1.23 [production]
10:29 <jnuche@deploy1002> Installation of scap version "latest" completed for 8 hosts [production]
10:29 <jnuche@deploy1002> Installing scap version "latest" for 8 hosts [production]
10:26 <jmm@cumin2002> END (PASS) - Cookbook sre.wdqs.restart-nginx (exit_code=0) rolling restart_daemons on A:wdqs-all [production]
10:24 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 23951 [production]
10:22 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 23951 [production]
10:21 <moritzm> installing apr-util security updates on buster [production]
10:19 <jnuche@deploy1002> Installation of scap version "latest" completed for 1 hosts [production]