7701-7750 of 10000 results (31ms)
2020-06-25 §
06:03 <elukey> reboot an-airflow1001 for kernel upgrades [production]
2020-06-24 §
17:31 <elukey> update archiva-ci user's password in Jenkins credentials plugin [production]
16:56 <elukey> update archiva-deploy user's password in Jenkins credentials plugin [production]
16:30 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:27 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:17 <elukey> reimage db1108 to debian Buster - T234826 [production]
2020-06-20 §
07:42 <elukey> powercycle an-worker1093 - bug soft lock up CPU showed in mgmt console [production]
07:36 <elukey> powercycle an-worker1091 - bug soft lock up CPU showed in mgmt console [production]
2020-06-18 §
08:25 <elukey> change archiva-ci password in archiva [production]
2020-06-17 §
18:05 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
18:04 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
07:53 <elukey> reboot kafka-jumbo1009 for kernel upgrades [production]
06:40 <elukey> reboot krb1001 for kernel upgrades [production]
06:24 <elukey> reboot an-master100[1,2] for kernel upgrades [production]
06:03 <elukey> reboot an-conf100[1-3] for kernel upgrades [production]
05:45 <elukey> reboot stat1007/8 for kernel upgrades [production]
05:45 <elukey> clean up old systemd timer config on an-coord1001 (came up after the last reboot) [production]
2020-06-16 §
16:02 <elukey> reboot kafka-jumbo1008 for kernel upgrades [production]
15:20 <elukey> reboot kafka-jumbo1007 for kernel upgrades [production]
15:06 <elukey> reboot an-coord1001 for kernel upgrades [production]
14:31 <elukey> reboot druid100[7,8] for kernel upgrades [production]
11:35 <elukey> reboot an-druid100[1,2] for kernel upgrades [production]
06:25 <elukey> roll restart memcached on mc-gp* (gutter pools) to pick up new slab size distribution setting - T252391 [production]
2020-06-15 §
14:09 <elukey@cumin2001> END (PASS) - Cookbook sre.hadoop.roll-restart-workers (exit_code=0) [production]
13:38 <elukey@cumin2001> START - Cookbook sre.hadoop.roll-restart-workers [production]
09:29 <elukey> update analytics-in4/6 filters on cr1-cr2 eqiad to update the Druid term (new nodes added) [production]
2020-06-12 §
16:49 <elukey> restart php-fpm and pool mw1384 - T255282 [production]
16:33 <elukey> (correct) depool again mw1384 - investigation will follow up in a task [production]
16:32 <elukey> depool again mw1348 - investigation will follow up in a task [production]
14:51 <elukey> repool mw1384 as test [production]
08:51 <elukey> restart gerrit on gerrit1001 [production]
08:48 <elukey> update cr1/cr2 analyitics filters for T252767 and T252675 [production]
07:56 <elukey> depool mw1384 [production]
07:07 <elukey> depool/scap pull/pool mw1384 [production]
2020-06-11 §
12:36 <elukey> updated pcc facts [production]
09:36 <elukey> switch piwik.wikimedia.org from matomo1001 to matomo1002 (new buster node) [production]
2020-06-10 §
09:31 <elukey@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
08:45 <elukey@cumin1001> START - Cookbook sre.ganeti.makevm [production]
2020-06-09 §
14:00 <elukey> update release repository's settings on Archiva - T254849 [production]
10:49 <elukey> update pcc facts [production]
2020-06-08 §
17:50 <elukey> restart prometheus burrow exporter for kafka main on kafkamon1001 - T254498 [production]
17:14 <elukey@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-mirror-maker (exit_code=0) [production]
16:55 <elukey@cumin1001> START - Cookbook sre.kafka.roll-restart-mirror-maker [production]
16:54 <elukey@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) [production]
13:41 <elukey@cumin1001> START - Cookbook sre.kafka.roll-restart-brokers [production]
2020-06-05 §
16:45 <elukey@deploy1001> Finished deploy [analytics/turnilo/deploy@f7e4f78]: Upgrade to 1.24.0 (duration: 00m 11s) [production]
16:45 <elukey@deploy1001> Started deploy [analytics/turnilo/deploy@f7e4f78]: Upgrade to 1.24.0 [production]
13:19 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:15 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:32 <elukey@cumin1001> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) [production]