8051-8100 of 8776 results (28ms)
2022-10-25 §
18:59 <inflatador> bking@elastic2070 'restarting elastic7 services to apply 838141' [production]
18:03 <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
17:20 <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer [production]
17:12 <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
17:02 <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer [production]
17:02 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
17:02 <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer [production]
16:33 <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
16:06 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for wcqs2002.codfw.wmnet [production]
16:06 <bking@cumin2002> START - Cookbook sre.hosts.remove-downtime for wcqs2002.codfw.wmnet [production]
16:04 <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer [production]
16:04 <bking@cumin2002> END (ERROR) - Cookbook sre.wdqs.data-transfer (exit_code=97) [production]
16:04 <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer [production]
15:56 <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
15:22 <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer [production]
2022-10-22 §
03:16 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
2022-10-21 §
20:20 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_codfw: apply updates - bking@cumin2002 - T321310 [production]
17:20 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_codfw: apply updates - bking@cumin2002 - T321310 [production]
17:20 <bking@cumin2002> END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_eqiad: apply updates - bking@cumin2002 - T321310 [production]
14:44 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (3 nodes at a time) for ElasticSearch cluster search_eqiad: apply updates - bking@cumin2002 - T321310 [production]
14:22 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: apply updates - bking@cumin2002 - T321310 [production]
13:31 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: apply updates - bking@cumin2002 - T321310 [production]
2022-10-20 §
21:04 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: apply updates - bking@cumin2002 - T321310 [production]
19:29 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: apply updates - bking@cumin2002 - T321310 [production]
2022-10-19 §
15:00 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
15:00 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
15:00 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
14:59 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
14:59 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
2022-10-11 §
16:55 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on elastic2052.codfw.wmnet with reason: T320482 [production]
16:54 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on elastic2052.codfw.wmnet with reason: T320482 [production]
2022-10-06 §
19:03 <inflatador> 'bking@elastic restarted elastic2025, 2031, 2061, 2084 T313431 [production]
2022-09-22 §
19:45 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
2022-09-20 §
19:05 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
18:47 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
18:47 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
02:42 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
2022-09-19 §
20:21 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
19:33 <bking@cumin2002> END (ERROR) - Cookbook sre.wdqs.data-reload (exit_code=97) [production]
19:33 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
19:33 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
19:30 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
19:30 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
19:30 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
2022-09-15 §
22:01 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on wcqs2001.codfw.wmnet with reason: T316236 [production]
22:01 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on wcqs2001.codfw.wmnet with reason: T316236 [production]
2022-09-14 §
01:18 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: elastic 6.8 -> 7.10 - bking@cumin1001 - T317686 [production]
2022-09-13 §
19:55 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: elastic 6.8 -> 7.10 - bking@cumin1001 - T317686 [production]
19:19 <bking@cumin1001> END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: elastic 6.8 -> 7.10 - bking@cumin1001 - T317686 [production]
19:01 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_eqiad: elastic 6.8 -> 7.10 - bking@cumin1001 - T317686 [production]