4501-4550 of 10000 results (99ms)
2024-01-16 ยง
20:06 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2294.codfw.wmnet with reason: host reimage [production]
20:03 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2297.codfw.wmnet with OS bullseye [production]
20:02 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2294.codfw.wmnet with reason: host reimage [production]
19:56 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2296.codfw.wmnet with OS bullseye [production]
19:56 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2292.codfw.wmnet with reason: host reimage [production]
19:53 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2293.codfw.wmnet with reason: host reimage [production]
19:52 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2295.codfw.wmnet with OS bullseye [production]
19:50 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2291.codfw.wmnet with reason: host reimage [production]
19:50 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1375.eqiad.wmnet with OS bullseye [production]
19:49 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2293.codfw.wmnet with reason: host reimage [production]
19:48 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2292.codfw.wmnet with reason: host reimage [production]
19:47 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2291.codfw.wmnet with reason: host reimage [production]
19:47 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1376.eqiad.wmnet with OS bullseye [production]
19:46 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2294.codfw.wmnet with OS bullseye [production]
19:45 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1374.eqiad.wmnet with OS bullseye [production]
19:45 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance [production]
19:45 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance [production]
19:45 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1230 (T354336)', diff saved to https://phabricator.wikimedia.org/P54759 and previous config saved to /var/cache/conftool/dbconfig/20240116-194509-marostegui.json [production]
19:34 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1360.eqiad.wmnet with OS bullseye [production]
19:32 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2293.codfw.wmnet with OS bullseye [production]
19:31 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2292.codfw.wmnet with OS bullseye [production]
19:31 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw2291.codfw.wmnet with OS bullseye [production]
19:31 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1363.eqiad.wmnet with OS bullseye [production]
19:30 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1230', diff saved to https://phabricator.wikimedia.org/P54758 and previous config saved to /var/cache/conftool/dbconfig/20240116-193002-marostegui.json [production]
19:29 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1375.eqiad.wmnet with reason: host reimage [production]
19:29 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1361.eqiad.wmnet with OS bullseye [production]
19:27 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1362.eqiad.wmnet with OS bullseye [production]
19:27 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1376.eqiad.wmnet with reason: host reimage [production]
19:24 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1374.eqiad.wmnet with reason: host reimage [production]
19:23 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1376.eqiad.wmnet with reason: host reimage [production]
19:21 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1375.eqiad.wmnet with reason: host reimage [production]
19:21 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1374.eqiad.wmnet with reason: host reimage [production]
19:14 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1230', diff saved to https://phabricator.wikimedia.org/P54757 and previous config saved to /var/cache/conftool/dbconfig/20240116-191456-marostegui.json [production]
19:13 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1360.eqiad.wmnet with reason: host reimage [production]
19:10 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1363.eqiad.wmnet with reason: host reimage [production]
19:08 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1361.eqiad.wmnet with reason: host reimage [production]
19:08 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1376.eqiad.wmnet with OS bullseye [production]
19:07 <kamila@cumin1002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1362.eqiad.wmnet with reason: host reimage [production]
19:07 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1375.eqiad.wmnet with OS bullseye [production]
19:06 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host mw1374.eqiad.wmnet with OS bullseye [production]
19:06 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1363.eqiad.wmnet with reason: host reimage [production]
19:05 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1362.eqiad.wmnet with reason: host reimage [production]
19:05 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1360.eqiad.wmnet with reason: host reimage [production]
19:04 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1361.eqiad.wmnet with reason: host reimage [production]
18:59 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1230 (T354336)', diff saved to https://phabricator.wikimedia.org/P54756 and previous config saved to /var/cache/conftool/dbconfig/20240116-185949-marostegui.json [production]
18:57 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1230 (T354336)', diff saved to https://phabricator.wikimedia.org/P54755 and previous config saved to /var/cache/conftool/dbconfig/20240116-185723-marostegui.json [production]
18:57 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1230.eqiad.wmnet with reason: Maintenance [production]
18:57 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db1230.eqiad.wmnet with reason: Maintenance [production]
18:56 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1216.eqiad.wmnet with reason: Maintenance [production]
18:56 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db1216.eqiad.wmnet with reason: Maintenance [production]