8101-8150 of 8776 results (21ms)
2022-09-13 §
18:47 <bking@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: elastic 6.8 -> 7.10 - bking@cumin1001 - T317686 [production]
18:46 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: elastic 6.8 -> 7.10 - bking@cumin1001 - T317686 [production]
2022-09-12 §
19:28 <bking@deploy1002> Finished deploy [wdqs/wdqs@e012d14]: 0.3.116 (duration: 02m 04s) [production]
19:26 <bking@deploy1002> Started deploy [wdqs/wdqs@e012d14]: 0.3.116 [production]
18:56 <bking@deploy1002> Finished deploy [wdqs/wdqs@e012d14] (wcqs): Deploy 0.3.116 to WCQS (duration: 08m 01s) [production]
18:48 <bking@deploy1002> Started deploy [wdqs/wdqs@e012d14] (wcqs): Deploy 0.3.116 to WCQS [production]
18:22 <bking@deploy1002> Finished deploy [wdqs/wdqs@e012d14]: 0.3.116 (duration: 07m 31s) [production]
18:14 <bking@deploy1002> Started deploy [wdqs/wdqs@e012d14]: 0.3.116 [production]
18:08 <bking@deploy1002> Finished deploy [wdqs/wdqs@e012d14]: 0.3.116 (duration: 05m 37s) [production]
18:02 <bking@deploy1002> Started deploy [wdqs/wdqs@e012d14]: 0.3.116 [production]
2022-09-06 §
20:03 <inflatador> 'bking@cumin1001 disabling puppet on elastic codfw hosts T313431' [production]
2022-08-31 §
20:08 <bking@cumin1001> conftool action : get/pooled; selector: dnsdisc=wdqs,name=codfw [production]
2022-08-25 §
21:12 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
21:02 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
20:56 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
20:33 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
20:11 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
20:07 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
19:42 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
19:41 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
18:48 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
18:47 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic elasticsearch and plugin upgrade - bking@cumin2002 - T316159 [production]
2022-08-24 §
21:48 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on 6 hosts with reason: T316159 [production]
21:48 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 3 days, 0:00:00 on 6 hosts with reason: T316159 [production]
2022-08-23 §
19:34 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on relforge[1003-1004].eqiad.wmnet with reason: T315604 [production]
19:34 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on relforge[1003-1004].eqiad.wmnet with reason: T315604 [production]
17:33 <inflatador> 'bking@cumin starting thanos-swift cleanup for wdqs T316031' [production]
2022-08-22 §
21:56 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - bking@cumin2002 - T315604 [production]
21:55 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - bking@cumin2002 - T315604 [production]
21:46 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - bking@cumin2002 - T315604 [production]
21:45 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - bking@cumin2002 - T315604 [production]
21:17 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - bking@cumin2002 - T315604 [production]
21:17 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster relforge: relforge elasticsearch and plugin upgrade - bking@cumin2002 - T315604 [production]
13:48 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for wdqs[1014-1016].eqiad.wmnet [production]
13:48 <bking@cumin1001> START - Cookbook sre.hosts.remove-downtime for wdqs[1014-1016].eqiad.wmnet [production]
13:44 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
13:39 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
13:38 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on wdqs[1014-1016].eqiad.wmnet with reason: T314890 [production]
13:37 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 3:00:00 on wdqs[1014-1016].eqiad.wmnet with reason: T314890 [production]
13:37 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
13:31 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
13:31 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
13:25 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
2022-08-18 §
21:14 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on relforge[1003-1004].eqiad.wmnet with reason: elastic 7 upgrade [production]
21:14 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on relforge[1003-1004].eqiad.wmnet with reason: elastic 7 upgrade [production]
2022-08-16 §
21:53 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts elastic1048.eqiad.wmnet [production]
21:53 <bking@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:47 <bking@cumin1001> START - Cookbook sre.dns.netbox [production]
21:42 <bking@cumin1001> START - Cookbook sre.hosts.decommission for hosts elastic1048.eqiad.wmnet [production]
21:41 <bking@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts elastic1048.eqiad.wmnet [production]