3551-3600 of 10000 results (64ms)
2022-07-07 ยง
18:42 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2177.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:39 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcontrol1006.wikimedia.org with OS bullseye [production]
18:36 <bking@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REIMAGE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic cluster reimage to bullseye - bking@cumin1001 - T309343 [production]
18:31 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1005.eqiad.wmnet with OS bullseye [production]
18:26 <brett@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:22 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2178.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:22 <brett@cumin1001> START - Cookbook sre.dns.netbox [production]
18:22 <brett@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
18:22 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:22 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2176.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:18 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
18:16 <brett@cumin1001> START - Cookbook sre.dns.netbox [production]
18:10 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:07 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
18:06 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2177.mgmt.codfw.wmnet with reboot policy FORCED [production]
18:05 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:05 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:02 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
18:01 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
18:00 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
17:59 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2176.mgmt.codfw.wmnet with reboot policy FORCED [production]
17:58 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
17:58 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db2177.mgmt.codfw.wmnet with reboot policy FORCED [production]
17:58 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db2176.mgmt.codfw.wmnet with reboot policy FORCED [production]
17:56 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:53 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
17:51 <volans@cumin2002> START - Cookbook sre.hosts.provision for host db2175.mgmt.codfw.wmnet with reboot policy FORCED [production]
17:51 <volans@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db2175.mgmt.codfw.wmnet with reboot policy FORCED [production]
17:39 <volans@cumin2002> START - Cookbook sre.hosts.provision for host db2175.mgmt.codfw.wmnet with reboot policy FORCED [production]
17:37 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2177.mgmt.codfw.wmnet with reboot policy FORCED [production]
17:33 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2176.mgmt.codfw.wmnet with reboot policy FORCED [production]
17:31 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:27 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
17:22 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudelastic1002.wikimedia.org with OS bullseye [production]
17:22 <cmjohnson@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudcontrol1006.wikimedia.org with OS bullseye [production]
17:18 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcontrol1006.wikimedia.org with OS bullseye [production]
17:12 <bd808@deploy1002> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
17:12 <bd808@deploy1002> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
17:11 <bd808@deploy1002> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
17:11 <bd808@deploy1002> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
17:10 <bd808@deploy1002> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
17:10 <bd808@deploy1002> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
17:05 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudelastic1002.wikimedia.org with reason: host reimage [production]
17:01 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudelastic1002.wikimedia.org with reason: host reimage [production]
16:59 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudservices1005.wikimedia.org with OS bullseye [production]
16:52 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
16:52 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
16:49 <bking@cumin1001> START - Cookbook sre.hosts.reimage for host cloudelastic1002.wikimedia.org with OS bullseye [production]
16:49 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudrabbit1003.wikimedia.org with OS bullseye [production]
16:48 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.REIMAGE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic cluster reimage to bullseye - bking@cumin1001 - T309343 [production]