5251-5300 of 10000 results (67ms)
2022-05-02 ยง
19:28 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host logstash2002.codfw.wmnet [production]
19:28 <herron@cumin1001> START - Cookbook sre.hosts.reboot-single for host logstash1012.eqiad.wmnet [production]
19:26 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host logstash1011.eqiad.wmnet [production]
19:24 <herron@cumin1001> START - Cookbook sre.hosts.reboot-single for host logstash2002.codfw.wmnet [production]
19:24 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aqs2010.codfw.wmnet with reason: host reimage [production]
19:23 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host logstash2001.codfw.wmnet [production]
19:22 <herron@cumin1001> START - Cookbook sre.hosts.reboot-single for host logstash1011.eqiad.wmnet [production]
19:19 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host logstash1010.eqiad.wmnet [production]
19:19 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on aqs2010.codfw.wmnet with reason: host reimage [production]
19:18 <herron@cumin1001> START - Cookbook sre.hosts.reboot-single for host logstash2001.codfw.wmnet [production]
19:16 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs2011.codfw.wmnet with OS bullseye [production]
19:15 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host aqs2011.codfw.wmnet with OS bullseye [production]
19:14 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs2011.codfw.wmnet with OS bullseye [production]
19:14 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host aqs2011.codfw.wmnet with OS bullseye [production]
19:14 <herron@cumin1001> START - Cookbook sre.hosts.reboot-single for host logstash1010.eqiad.wmnet [production]
19:14 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host aqs2010.codfw.wmnet with OS bullseye [production]
19:12 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs2011.codfw.wmnet with OS bullseye [production]
19:06 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs2010.codfw.wmnet with OS bullseye [production]
18:59 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:51 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
18:46 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:44 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
18:41 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host aqs2011.codfw.wmnet with OS bullseye [production]
18:35 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host aqs2010.codfw.wmnet with OS bullseye [production]
18:31 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aqs2009.codfw.wmnet with OS bullseye [production]
18:28 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aqs2008.codfw.wmnet with OS bullseye [production]
18:24 <mutante> [mwmaint1002:~] $ sudo systemctl start mediawiki_job_purge_expired_blocks - starting new timer for T257473 [production]
18:24 <mutante> [mwmaint1002:~] $ sudo systemctl start mediawiki_job_purge_expired_blocks [production]
18:19 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aqs2009.codfw.wmnet with reason: host reimage [production]
18:16 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aqs2008.codfw.wmnet with reason: host reimage [production]
18:13 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on aqs2009.codfw.wmnet with reason: host reimage [production]
18:12 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on aqs2008.codfw.wmnet with reason: host reimage [production]
18:08 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host aqs2009.codfw.wmnet with OS bullseye [production]
18:07 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host aqs2008.codfw.wmnet with OS bullseye [production]
18:06 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=codfw,name=mw2286.codfw.wmnet [production]
18:06 <mutante> repooling mw2286 after hardware repair - T306823 [production]
18:01 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs2009.codfw.wmnet with OS bullseye [production]
17:59 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host aqs2008.codfw.wmnet with OS bullseye [production]
17:51 <ebernhardson@deploy1002> Finished deploy [search/mjolnir/deploy@f94bb01]: T306123: adjust uploaded models to always have a positive score (duration: 00m 45s) [production]
17:50 <ebernhardson@deploy1002> Started deploy [search/mjolnir/deploy@f94bb01]: T306123: adjust uploaded models to always have a positive score [production]
17:46 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudvirt1018.eqiad.wmnet [production]
17:44 <andrew@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:42 <andrew@cumin1001> START - Cookbook sre.dns.netbox [production]
17:38 <andrew@cumin1001> START - Cookbook sre.hosts.decommission for hosts cloudvirt1018.eqiad.wmnet [production]
17:30 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host aqs2009.codfw.wmnet with OS bullseye [production]
17:27 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host aqs2008.codfw.wmnet with OS bullseye [production]
17:08 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aqs2006.codfw.wmnet with OS bullseye [production]
17:05 <dcaro@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudmetrics1001.eqiad.wmnet [production]
17:01 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aqs2007.codfw.wmnet with OS bullseye [production]
16:56 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aqs2006.codfw.wmnet with reason: host reimage [production]