8651-8700 of 8776 results (33ms)
2022-04-11 §
16:55 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on wcqs2001.codfw.wmnet with reason: physically moving host [production]
2022-04-08 §
02:30 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_eqiad: security updates - bking@cumin1001 - T304938 [production]
2022-04-07 §
20:26 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_eqiad: security updates - bking@cumin1001 - T304938 [production]
19:02 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_codfw: codfw cluster reboot - bking@cumin1001 - T304938 [production]
16:50 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_codfw: codfw cluster reboot - bking@cumin1001 - T304938 [production]
16:49 <bking@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_codfw: codfw cluster reboot - bking@cumin1001 - T304938 [production]
14:04 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_codfw: codfw cluster reboot - bking@cumin1001 - T304938 [production]
2022-04-06 §
21:37 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: security updates - bking@cumin1001 - T304938 [production]
20:54 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: security updates - bking@cumin1001 - T304938 [production]
20:46 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: security updates - bking@cumin1001 - T304938 [production]
20:38 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: security updates - bking@cumin1001 - T304938 [production]
20:38 <bking@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: security updates - bking@cumin1001 - T304938 [production]
20:38 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: security updates - bking@cumin1001 - T304938 [production]
20:36 <bking@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: security updates - bking@cumin1001 - T304938 [production]
20:35 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: security updates - bking@cumin1001 - T304938 [production]
19:13 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
18:01 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
17:58 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.reboot (exit_code=99) [production]
17:42 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
2022-03-31 §
22:16 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
22:03 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
22:02 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
21:51 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
21:48 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
21:40 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
21:07 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
21:03 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
20:59 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
20:56 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
2022-03-29 §
21:38 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
21:04 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
20:20 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
17:00 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
16:21 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.reboot (exit_code=99) [production]
15:22 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
15:20 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.reboot (exit_code=99) [production]
15:20 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
15:19 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.reboot (exit_code=99) [production]
15:19 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
2022-03-28 §
14:46 <inflatador> 'bking@cumin1001 repooling wdqs services in IAD ref T302494' [production]
14:46 <bking@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=wdqs-internal,name=eqiad [production]
14:45 <bking@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=wdqs*,name=eqiad [production]
2022-03-24 §
21:11 <inflatador> bking@cumin1001 restarting blazegraph on wdqs[1003-1013].eqiad.wmnet for T293862 [production]
18:05 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.restart (exit_code=99) [production]
17:44 <bking@cumin1001> START - Cookbook sre.wdqs.restart [production]
17:36 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.restart (exit_code=99) [production]
17:36 <bking@cumin1001> START - Cookbook sre.wdqs.restart [production]
2022-03-23 §
21:42 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic ES 6.8 upgrade - bking@cumin1001 - T301956 [production]
20:18 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic ES 6.8 upgrade - bking@cumin1001 - T301956 [production]
20:01 <bking@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic ES 6.8 upgrade - bking@cumin1001 - T301956 [production]