6951-7000 of 10000 results (16ms)
2021-01-18 §
15:39 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1130.eqiad.wmnet with reason: REIMAGE [production]
15:36 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1130.eqiad.wmnet with reason: REIMAGE [production]
15:16 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1128.eqiad.wmnet with reason: REIMAGE [production]
15:14 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1128.eqiad.wmnet with reason: REIMAGE [production]
12:33 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1127.eqiad.wmnet with reason: REIMAGE [production]
12:31 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1127.eqiad.wmnet with reason: REIMAGE [production]
12:27 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1126.eqiad.wmnet with reason: REIMAGE [production]
12:25 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1126.eqiad.wmnet with reason: REIMAGE [production]
12:22 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1125.eqiad.wmnet with reason: REIMAGE [production]
12:20 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1125.eqiad.wmnet with reason: REIMAGE [production]
12:13 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1124.eqiad.wmnet with reason: REIMAGE [production]
12:11 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1124.eqiad.wmnet with reason: REIMAGE [production]
12:03 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1123.eqiad.wmnet with reason: REIMAGE [production]
12:01 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1123.eqiad.wmnet with reason: REIMAGE [production]
11:52 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1122.eqiad.wmnet with reason: REIMAGE [production]
11:49 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1122.eqiad.wmnet with reason: REIMAGE [production]
11:37 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1121.eqiad.wmnet with reason: REIMAGE [production]
11:35 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1121.eqiad.wmnet with reason: REIMAGE [production]
11:22 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1120.eqiad.wmnet with reason: REIMAGE [production]
11:18 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1120.eqiad.wmnet with reason: REIMAGE [production]
08:13 <elukey> clean up old archiva debs and upload 2.2.4-3 to buster-wikimedia - T272082 [production]
2021-01-16 §
12:18 <elukey> elukey@cumin1001:~$ sudo cumin 'A:mw-app-canary and A:mw-eqiad' 'run-puppet-agent' -b 10 - T272215 [production]
12:10 <elukey> 'elukey@cumin1001:~$ sudo cumin 'A:mw-eqiad' 'run-puppet-agent' -b 10' T272215) [production]
2021-01-15 §
15:30 <elukey> restart archiva to apply hot-fix for T272082 [production]
11:19 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1002.eqiad.wmnet [production]
11:15 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-conf1002.eqiad.wmnet [production]
10:58 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1003.eqiad.wmnet [production]
10:53 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-conf1003.eqiad.wmnet [production]
10:51 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1001.eqiad.wmnet [production]
10:45 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-conf1001.eqiad.wmnet [production]
10:10 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-test-client1001.eqiad.wmnet [production]
10:07 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-test-client1001.eqiad.wmnet [production]
08:28 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
08:15 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
08:15 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
08:01 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
07:59 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
07:57 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
2021-01-14 §
15:11 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) [production]
14:56 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
14:30 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
14:26 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
14:07 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
13:42 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
12:29 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-presto1004.eqiad.wmnet with reason: REIMAGE [production]
12:27 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-presto1004.eqiad.wmnet with reason: REIMAGE [production]
12:14 <elukey@cumin1001> END (ERROR) - Cookbook sre.presto.reboot-workers (exit_code=97) for Presto analytics cluster: Reboot Presto nodes - elukey@cumin1001 [production]
11:22 <elukey@cumin1001> START - Cookbook sre.presto.reboot-workers for Presto analytics cluster: Reboot Presto nodes - elukey@cumin1001 [production]
2021-01-13 §
15:56 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.roll-restart-masters (exit_code=0) [production]
15:11 <elukey@cumin1001> START - Cookbook sre.hadoop.roll-restart-masters [production]