9701-9750 of 10000 results (124ms)
2024-02-23 ยง
14:24 <cmooney@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on testvm2002.codfw.wmnet with reason: host reimage [production]
14:22 <cmooney@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on testvm2002.codfw.wmnet with reason: host reimage [production]
14:17 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P57825 and previous config saved to /var/cache/conftool/dbconfig/20240223-141740-arnaudb.json [production]
14:12 <cmooney@cumin1002> START - Cookbook sre.hosts.reimage for host testvm2002.codfw.wmnet with OS bullseye [production]
14:02 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P57824 and previous config saved to /var/cache/conftool/dbconfig/20240223-140233-arnaudb.json [production]
13:47 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1199 (T357189)', diff saved to https://phabricator.wikimedia.org/P57823 and previous config saved to /var/cache/conftool/dbconfig/20240223-134727-arnaudb.json [production]
13:23 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cumin1001.eqiad.wmnet [production]
13:22 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:22 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cumin1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
13:20 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cumin1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
13:19 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2394.codfw.wmnet with OS bullseye [production]
13:16 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
13:11 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts cumin1001.eqiad.wmnet [production]
13:09 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2419.codfw.wmnet with OS bullseye [production]
13:08 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2428.codfw.wmnet with OS bullseye [production]
13:07 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2426.codfw.wmnet with OS bullseye [production]
13:04 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2382.codfw.wmnet with OS bullseye [production]
12:57 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2351.codfw.wmnet with OS bullseye [production]
12:55 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2444.codfw.wmnet with OS bullseye [production]
12:53 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2394.codfw.wmnet with reason: host reimage [production]
12:52 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2353.codfw.wmnet with OS bullseye [production]
12:49 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2428.codfw.wmnet with reason: host reimage [production]
12:47 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depooling db1199 (T357189)', diff saved to https://phabricator.wikimedia.org/P57822 and previous config saved to /var/cache/conftool/dbconfig/20240223-124710-arnaudb.json [production]
12:47 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1199.eqiad.wmnet with reason: Maintenance [production]
12:46 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1199.eqiad.wmnet with reason: Maintenance [production]
12:46 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1190 (T357189)', diff saved to https://phabricator.wikimedia.org/P57821 and previous config saved to /var/cache/conftool/dbconfig/20240223-124648-arnaudb.json [production]
12:46 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2419.codfw.wmnet with reason: host reimage [production]
12:43 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2426.codfw.wmnet with reason: host reimage [production]
12:41 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2382.codfw.wmnet with reason: host reimage [production]
12:39 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2351.codfw.wmnet with reason: host reimage [production]
12:36 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2444.codfw.wmnet with reason: host reimage [production]
12:34 <hnowlan@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2353.codfw.wmnet with reason: host reimage [production]
12:34 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2428.codfw.wmnet with reason: host reimage [production]
12:32 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2394.codfw.wmnet with reason: host reimage [production]
12:32 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2444.codfw.wmnet with reason: host reimage [production]
12:32 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2419.codfw.wmnet with reason: host reimage [production]
12:32 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2426.codfw.wmnet with reason: host reimage [production]
12:32 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2382.codfw.wmnet with reason: host reimage [production]
12:31 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1190', diff saved to https://phabricator.wikimedia.org/P57820 and previous config saved to /var/cache/conftool/dbconfig/20240223-123141-arnaudb.json [production]
12:31 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2351.codfw.wmnet with reason: host reimage [production]
12:31 <hnowlan@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2353.codfw.wmnet with reason: host reimage [production]
12:16 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1190', diff saved to https://phabricator.wikimedia.org/P57819 and previous config saved to /var/cache/conftool/dbconfig/20240223-121635-arnaudb.json [production]
12:16 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2444.codfw.wmnet with OS bullseye [production]
12:16 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2428.codfw.wmnet with OS bullseye [production]
12:15 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2426.codfw.wmnet with OS bullseye [production]
12:15 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2419.codfw.wmnet with OS bullseye [production]
12:15 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2394.codfw.wmnet with OS bullseye [production]
12:15 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2382.codfw.wmnet with OS bullseye [production]
12:15 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2353.codfw.wmnet with OS bullseye [production]
12:15 <hnowlan@cumin2002> START - Cookbook sre.hosts.reimage for host mw2351.codfw.wmnet with OS bullseye [production]