3401-3450 of 10000 results (113ms)
2024-02-06 ยง
13:29 <jgiannelos@deploy2002> Finished deploy [kartotherian/deploy@3325683] (codfw): (no justification provided) (duration: 00m 17s) [production]
13:29 <jgiannelos@deploy2002> Started deploy [kartotherian/deploy@3325683] (codfw): (no justification provided) [production]
13:28 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2317.codfw.wmnet with OS bullseye [production]
13:28 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2356.codfw.wmnet with reason: host reimage [production]
13:27 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2354.codfw.wmnet with reason: host reimage [production]
13:25 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2352.codfw.wmnet with reason: host reimage [production]
13:24 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2354.codfw.wmnet with reason: host reimage [production]
13:22 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1408.eqiad.wmnet with OS bullseye [production]
13:22 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2352.codfw.wmnet with reason: host reimage [production]
13:22 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2350.codfw.wmnet with reason: host reimage [production]
13:22 <jgiannelos@deploy2002> Finished deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) (duration: 00m 12s) [production]
13:21 <jgiannelos@deploy2002> Started deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) [production]
13:21 <jgiannelos@deploy2002> Finished deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) (duration: 00m 05s) [production]
13:20 <jgiannelos@deploy2002> Started deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) [production]
13:20 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1396.eqiad.wmnet with OS bullseye [production]
13:19 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2350.codfw.wmnet with reason: host reimage [production]
13:19 <arnaudb@cumin1002> START - Cookbook sre.hosts.reimage for host db2194.codfw.wmnet with OS bookworm [production]
13:17 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1394.eqiad.wmnet with OS bullseye [production]
13:16 <moritzm> pruning unneeded openjdk-17-jre-headless packages on restbase* hosts [production]
13:15 <btullis@cumin1002> START - Cookbook sre.hosts.reimage for host an-web1001.eqiad.wmnet with OS bullseye [production]
13:15 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1392.eqiad.wmnet with OS bullseye [production]
13:14 <jgiannelos@deploy2002> Finished deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) (duration: 00m 05s) [production]
13:14 <jgiannelos@deploy2002> Started deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) [production]
13:13 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2319.codfw.wmnet with reason: host reimage [production]
13:11 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2356.codfw.wmnet with OS bullseye [production]
13:11 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2318.codfw.wmnet with reason: host reimage [production]
13:11 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2319.codfw.wmnet with reason: host reimage [production]
13:10 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for mw1388.eqiad.wmnet [production]
13:10 <kamila@cumin1002> START - Cookbook sre.hosts.remove-downtime for mw1388.eqiad.wmnet [production]
13:10 <btullis@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host an-web1001.eqiad.wmnet with OS bullseye [production]
13:09 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2318.codfw.wmnet with reason: host reimage [production]
13:07 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2354.codfw.wmnet with OS bullseye [production]
13:06 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1388.eqiad.wmnet with OS bullseye [production]
13:05 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2352.codfw.wmnet with OS bullseye [production]
13:04 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1408.eqiad.wmnet with reason: host reimage [production]
13:03 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1390.eqiad.wmnet with OS bullseye [production]
13:03 <claime> Relaunching build-production-images [production]
13:02 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2350.codfw.wmnet with OS bullseye [production]
13:02 <aokoth@cumin1002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM vrts1002.eqiad.wmnet [production]
13:02 <claime> build2001 - Total reclaimed space: 23.31GB [production]
13:01 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1396.eqiad.wmnet with reason: host reimage [production]
13:01 <jgiannelos@deploy2002> Finished deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) (duration: 00m 01s) [production]
13:01 <jgiannelos@deploy2002> Started deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) [production]
13:00 <jgiannelos@deploy2002> Finished deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) (duration: 00m 01s) [production]
13:00 <jgiannelos@deploy2002> Started deploy [kartotherian/deploy@3325683] (eqiad): (no justification provided) [production]
12:59 <btullis@cumin1002> START - Cookbook sre.hosts.reimage for host an-web1001.eqiad.wmnet with OS bullseye [production]
12:59 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1408.eqiad.wmnet with reason: host reimage [production]
12:59 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1394.eqiad.wmnet with reason: host reimage [production]
12:59 <claime> Pruning images older than 45 days on build2001: docker image prune -a --filter "until=1080h"/25 [production]
12:59 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1396.eqiad.wmnet with reason: host reimage [production]