3851-3900 of 10000 results (62ms)
2022-07-07 ยง
20:08 <dzahn@cumin2002> START - Cookbook sre.dns.netbox [production]
20:05 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
20:04 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
20:03 <mutante> destroying former strech backend of doc.wikimedia.org, replaced by doc1002 on buster (T247653) [production]
20:02 <dzahn@cumin2002> START - Cookbook sre.hosts.decommission for hosts doc1001.eqiad.wmnet [production]
20:01 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
19:46 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcontrol1006.wikimedia.org with OS bullseye [production]
19:43 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2182.mgmt.codfw.wmnet with reboot policy FORCED [production]
19:43 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2181.mgmt.codfw.wmnet with reboot policy FORCED [production]
19:36 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2180.mgmt.codfw.wmnet with reboot policy FORCED [production]
19:36 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2179.mgmt.codfw.wmnet with reboot policy FORCED [production]
19:32 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcontrol1006.wikimedia.org with reason: host reimage [production]
19:28 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
19:28 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
19:26 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcontrol1006.wikimedia.org with reason: host reimage [production]
19:18 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
19:18 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
19:17 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcontrol1007.wikimedia.org with OS bullseye [production]
19:16 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
19:16 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
19:15 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
19:15 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
19:15 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcontrol1006.wikimedia.org with OS bullseye [production]
19:13 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:10 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
19:09 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:07 <volans@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2175.mgmt.codfw.wmnet with reboot policy FORCED [production]
19:05 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
19:05 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudnet1005.eqiad.wmnet with OS bullseye [production]
19:03 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcontrol1007.wikimedia.org with reason: host reimage [production]
19:01 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2180.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:59 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcontrol1007.wikimedia.org with reason: host reimage [production]
18:58 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:57 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2179.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:57 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2178.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:54 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
18:51 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudnet1005.eqiad.wmnet with reason: host reimage [production]
18:47 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcontrol1007.wikimedia.org with OS bullseye [production]
18:47 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudnet1005.eqiad.wmnet with reason: host reimage [production]
18:46 <cmjohnson@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudcontrol1006.wikimedia.org with OS bullseye [production]
18:42 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2177.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:39 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcontrol1006.wikimedia.org with OS bullseye [production]
18:36 <bking@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REIMAGE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic cluster reimage to bullseye - bking@cumin1001 - T309343 [production]
18:31 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1005.eqiad.wmnet with OS bullseye [production]
18:26 <brett@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:22 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2178.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:22 <brett@cumin1001> START - Cookbook sre.dns.netbox [production]
18:22 <brett@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
18:22 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:22 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2176.mgmt.codfw.wmnet with reboot policy FORCED [production]