601-650 of 737 results (10ms)
2016-01-29 §
14:59 <elukey> analytics1027 - puppet re-enabled, camus restarted [analytics]
14:45 <elukey> disabled icinga on kafka1012 until Feb 07 [analytics]
14:39 <joal> launching manual runs of camus to try to fix state [analytics]
14:38 <elukey> stopped kafka on kafka1012 [analytics]
12:52 <elukey> analytics1027 - disabled puppet and camus for webrequest log [analytics]
2016-01-28 §
22:59 <ottomata> restoring MobileWebSectionUsage_14321266 from db1047 to dbstore1002 using mysqlimport [analytics]
20:59 <mforns> restarted eventlogging to overcome burrow alerts [analytics]
18:40 <elukey> Yarn resource manager transitioned to 1001 [analytics]
18:30 <elukey> HDFS failover from 1002 to 1001 [analytics]
18:22 <elukey> rebooting analytics1001 [analytics]
18:13 <elukey> stopped Yarn resouce manager on analytics1001 to trigger automatic failover to 1002 [analytics]
17:52 <elukey> HDFS failover from analytics1001-eqiad-wmnet to analytics1002-eqiad-wmnet [analytics]
17:52 <elukey> rebooted analytics1002-eqiad-wmnet for kernel upgrade [analytics]
15:55 <ottomata> restarting eventlogging [analytics]
13:59 <mforns> stop EventLogging until kafka is ok [analytics]
13:23 <mforns> restart EventLogging to overcome connection problems following kafka maintenance [analytics]
12:50 <elukey> stopping kafka1012 for kernel upgrade [analytics]
11:37 <joal> run camus manually to check if succesful [analytics]
11:31 <elukey> disabled puppet and camus webrequestlog in analytics1027 [analytics]
11:31 <joal> Moving faulty camus imported files to a temporary place [analytics]
11:29 <elukey> disabled puppet and # Puppet Name: camus-webrequest [analytics]
2016-01-27 §
22:29 <ottomata> starting mysqldump of MobileWebSectionUsage_14321266 from db1047 into m4-master [analytics]
2016-01-26 §
19:19 <ottomata> restarting eventlogging after *.wikmiedia.org outage [analytics]
19:08 <ottomata> stopping all of eventlogging [analytics]
18:55 <ottomata> stopping eventlogging mysql consumers to troubleshoot [analytics]
17:38 <ottomata> restarting eventlogging [analytics]
2016-01-25 §
14:54 <ottomata> restarting eventlogging mysql consumers after TokuDB conversion has finished [analytics]
13:16 <mforns> restarted EventLogging after Kafka leader reelection [analytics]
12:08 <mforns> restarted EventLogging to sync with kafka1018 restart [analytics]
10:57 <mforns> restarted EventLogging to overcome connection problems with Kafka [analytics]
2016-01-22 §
19:55 <ottomata> deleting /a/mw-log/archive/CirrusSearchRequests per request from ebernhardson (https://gerrit.wikimedia.org/r/#/c/265773/) [analytics]
2016-01-21 §
16:35 <ottomata> stopped eventlogging mysql consumers for long downtime: https://phabricator.wikimedia.org/T120187 [analytics]
16:20 <ottomata> started eventlogging mysql consumers [analytics]
15:59 <ottomata> stopping eventlogging mysql consumers for https://phabricator.wikimedia.org/T123546 [analytics]
2016-01-20 §
18:30 <mforns> deployed EL in production with removal of queue [analytics]
17:37 <mforns> restarted EventLogging because of Kafka consumption lag [analytics]
2016-01-19 §
20:08 <mforns> deployed eventlogging to deployment-eventlogging03 with removal of mysql consumer batch [analytics]
2016-01-18 §
14:49 <ottomata> restarting eventlogging to un-blacklist MobileWebSectionUsage [analytics]
01:07 <ottomata> restarted eventlogging again. A single raw client side processor consumer seemed stuck (according to burrow). seeing offset commit errors in logs. [analytics]
2016-01-17 §
08:26 <ottomata> restarting eventlogging to see if it'll help burrow reported kafka consumer lag [analytics]
2016-01-14 §
22:29 <YuviPanda> wikimetrics <whatever> [analytics]
19:55 <ottomata> restarted eventlogging_sync script to insert batches of 1000 [analytics]
2016-01-13 §
20:01 <ottomata> dropped MobileWebSectionUsage_14321266 and MobileWebSectionUsage_15038458 from analytics-store eventlogging slave db [analytics]
19:24 <ottomata> restarting eventlogging to apply blacklist of MobileWebSectionUsage scheas [analytics]
2015-12-30 §
15:23 <ottomata> killing oozie legacy_tsv job 0102159-150605005438095-oozie-oozi-B to restart it without mobile, 5xx-mobile and zero outputs [analytics]
2015-12-22 §
21:40 <ottomata> restarting eventlogging with pykafka 2.1.1 [analytics]
20:37 <nuria> restarted event logging and removed table that was blacklisted for maintenance: https://gerrit.wikimedia.org/r/#/c/260628/ [analytics]
2015-12-15 §
10:37 <mforns> Stopped EventLogging server for database maintenance [analytics]
01:34 <ebernhardson> reverted cirrus avro schema in mediawiki back to 101446746400 due to camus not reading in the new events [analytics]
00:17 <ebernhardson> deployed new version of CirrusSearchRequestSet schema (111448028943) to mediawiki [analytics]