2151-2200 of 2297 results (19ms)
2016-02-15 §
13:22 <joal> Failed deploying refinery: deploy from tin failed, need ottomata help [analytics]
13:04 <joal> Deploying refinery [analytics]
2016-02-09 §
15:53 <elukey> restarted kafka1012 with 48hrs of log retention [analytics]
15:41 <elukey> kafka broker restarted - kafka1012 [analytics]
2016-02-05 §
12:41 <joal> Restart Mobile App sesion metric with manual upgrade of Spark driver memory through oozie config [analytics]
2016-02-04 §
15:13 <ottomata> restarting aqs restbase 1 node at a time [analytics]
14:57 <ottomata> stopping eventlogging to reboot eventlog1001 for kernel update [analytics]
2016-02-03 §
21:00 <joal> Manually update last_access_uniques_monthly code on HDFS (patch merged) [analytics]
2016-02-02 §
18:03 <joal> moving refined mobile files to refined text for january on HDFS [analytics]
2016-01-29 §
15:51 <ottomata> restarting eventlogging [analytics]
14:59 <elukey> analytics1027 - puppet re-enabled, camus restarted [analytics]
14:45 <elukey> disabled icinga on kafka1012 until Feb 07 [analytics]
14:39 <joal> launching manual runs of camus to try to fix state [analytics]
14:38 <elukey> stopped kafka on kafka1012 [analytics]
12:52 <elukey> analytics1027 - disabled puppet and camus for webrequest log [analytics]
2016-01-28 §
22:59 <ottomata> restoring MobileWebSectionUsage_14321266 from db1047 to dbstore1002 using mysqlimport [analytics]
20:59 <mforns> restarted eventlogging to overcome burrow alerts [analytics]
18:40 <elukey> Yarn resource manager transitioned to 1001 [analytics]
18:30 <elukey> HDFS failover from 1002 to 1001 [analytics]
18:22 <elukey> rebooting analytics1001 [analytics]
18:13 <elukey> stopped Yarn resouce manager on analytics1001 to trigger automatic failover to 1002 [analytics]
17:52 <elukey> HDFS failover from analytics1001-eqiad-wmnet to analytics1002-eqiad-wmnet [analytics]
17:52 <elukey> rebooted analytics1002-eqiad-wmnet for kernel upgrade [analytics]
15:55 <ottomata> restarting eventlogging [analytics]
13:59 <mforns> stop EventLogging until kafka is ok [analytics]
13:23 <mforns> restart EventLogging to overcome connection problems following kafka maintenance [analytics]
12:50 <elukey> stopping kafka1012 for kernel upgrade [analytics]
11:37 <joal> run camus manually to check if succesful [analytics]
11:31 <elukey> disabled puppet and camus webrequestlog in analytics1027 [analytics]
11:31 <joal> Moving faulty camus imported files to a temporary place [analytics]
11:29 <elukey> disabled puppet and # Puppet Name: camus-webrequest [analytics]
2016-01-27 §
22:29 <ottomata> starting mysqldump of MobileWebSectionUsage_14321266 from db1047 into m4-master [analytics]
2016-01-26 §
19:19 <ottomata> restarting eventlogging after *.wikmiedia.org outage [analytics]
19:08 <ottomata> stopping all of eventlogging [analytics]
18:55 <ottomata> stopping eventlogging mysql consumers to troubleshoot [analytics]
17:38 <ottomata> restarting eventlogging [analytics]
2016-01-25 §
14:54 <ottomata> restarting eventlogging mysql consumers after TokuDB conversion has finished [analytics]
13:16 <mforns> restarted EventLogging after Kafka leader reelection [analytics]
12:08 <mforns> restarted EventLogging to sync with kafka1018 restart [analytics]
10:57 <mforns> restarted EventLogging to overcome connection problems with Kafka [analytics]
2016-01-22 §
19:55 <ottomata> deleting /a/mw-log/archive/CirrusSearchRequests per request from ebernhardson (https://gerrit.wikimedia.org/r/#/c/265773/) [analytics]
2016-01-21 §
16:35 <ottomata> stopped eventlogging mysql consumers for long downtime: https://phabricator.wikimedia.org/T120187 [analytics]
16:20 <ottomata> started eventlogging mysql consumers [analytics]
15:59 <ottomata> stopping eventlogging mysql consumers for https://phabricator.wikimedia.org/T123546 [analytics]
2016-01-20 §
18:30 <mforns> deployed EL in production with removal of queue [analytics]
17:37 <mforns> restarted EventLogging because of Kafka consumption lag [analytics]
2016-01-19 §
20:08 <mforns> deployed eventlogging to deployment-eventlogging03 with removal of mysql consumer batch [analytics]
2016-01-18 §
14:49 <ottomata> restarting eventlogging to un-blacklist MobileWebSectionUsage [analytics]
01:07 <ottomata> restarted eventlogging again. A single raw client side processor consumer seemed stuck (according to burrow). seeing offset commit errors in logs. [analytics]
2016-01-17 §
08:26 <ottomata> restarting eventlogging to see if it'll help burrow reported kafka consumer lag [analytics]