4551-4600 of 5770 results (32ms)
2018-03-28 §
19:20 <joal> Start Geowiki jobs (monthly and druid) starting 2018-01 [analytics]
18:36 <joal> Making hdfs://analytics-hadoop/wmf/data/wmf/mediawiki_private accessible only by analytics-privatedata-users group (and hdfs obviously) [analytics]
18:02 <joal> Kill-Restart mobile_apps-session_metrics (bundle killed, coord started) [analytics]
18:00 <joal> Kill-Restart mediawiki-history-reduced-coord after deploy [analytics]
17:44 <joal> Deploying refinery onto hadoop [analytics]
17:29 <joal> Deploy refinery using scap [analytics]
16:32 <ottomata> bouncing main -> jumbo mirror makers to increase heap size to 2G [analytics]
14:16 <ottomata> re-enabling replication of mediawiki job topics from main -> jumbo [analytics]
2018-03-27 §
14:03 <elukey> consolidate all the zookeeper definition in one 'main-eqiad' one in Horizon -> Project-Analytics [analytics]
11:16 <elukey> kill banner impression job to force a respawn (still using an old jvm) [analytics]
2018-03-26 §
15:12 <elukey> restart eventlogging mysql consumers after maintenance [analytics]
14:26 <ottomata> restarting jumbo -> eqiad mirror makers with prometheus instead of jmx [analytics]
13:28 <ottomata> restarting kafka mirror maker main -> jumbo using new consumer [analytics]
13:09 <fdans> stopped 2 mysql consumers as precaution for T174386 [analytics]
2018-03-24 §
08:13 <joal> kill failing query swamping the cluster (application_1520532368078_47226) [analytics]
2018-03-23 §
16:44 <elukey> invalidated 2018-03-12/13 for iOS data in piwik to force a re-run of the archiver [analytics]
2018-03-20 §
10:10 <elukey> removed old mysql/ssh/ganglia analytics vlan firewall rules (https://phabricator.wikimedia.org/T189408#4055749) [analytics]
2018-03-19 §
09:38 <elukey> restart hadoop daemons on analytics1070 for openjdk upgrades (canary) [analytics]
2018-03-16 §
20:23 <ottomata> bouncing main -> jumbo mirror makers to apply change-prop topic blacklist [analytics]
14:44 <ottomata> restarting eventlogging mysql eventbus consumer to consume from analytics instead of jumbo [analytics]
14:38 <elukey> temporary point pivot to druid1002 as prep step for druid1001's reboot [analytics]
14:37 <elukey> disable druid1001's middlemanager as prep step for reboot [analytics]
14:24 <elukey> changed superset druid private config from druid1002 to druid1003 [analytics]
13:43 <elukey> disable druid1002's middle manager via API as prep step for reboot [analytics]
09:57 <elukey> restart eventlogging-consumer@mysql-m4/eventbus on eventlog1002 to force the DNS resolution of m4-master (changed from dbproxy1009 -> dbproxy1004) [analytics]
2018-03-15 §
22:13 <ottomata> bounced jumbo mirror makers [analytics]
19:10 <ottomata> bouncing main -> jumbo mirror maker [analytics]
14:50 <joal> Restart clickstream-coord to pick new config including fawiki [analytics]
14:29 <elukey> disabled druid1003's middlemanager as prep step for reboot [analytics]
14:07 <ottomata> bouncing kafka jumob -> eqiad mirrormaker [analytics]
2018-03-14 §
15:27 <ottomata> bouncing main -> jumbo mirror maker instances [analytics]
14:45 <ottomata> beginning migration of eventlogging analtyics from Kafka analytics to Kafka jumbo: T183297 [analytics]
2018-03-13 §
20:47 <ottomata> restarting eventlogging processors to pick up VirtualPageView blacklist from eventlogging-valid-mixed topic [analytics]
15:13 <ottomata> bounce main -> analytics mirror maker instances [analytics]
15:07 <ottomata> bouncing MirrorMaker on kafka1020 (main -> jumbo) to re-apply acks=all [analytics]
14:55 <ottomata> bouncing MirrorMaker on kafka1022 to re-apply acks=all (main -> jumbo) [analytics]
14:32 <ottomata> bouncing MirrorMaker on kafka1023 (main -> jumbo) to re-apply acks=all [analytics]
14:22 <ottomata> bouncing mirrormaker for main -> analytics on kafka101[234] to apply roundrobin [analytics]
2018-03-12 §
19:39 <ottomata> deployed new Refine jobs (eventlogging, eventbus, etc.) with deduplication and geocoding and casting [analytics]
18:17 <ottomata> bouncing kafka mm eqiad -> jumbo witih acks=1 [analytics]
18:10 <ottomata> bouncing kafka mirrormaker for main-eqiad -> jumbo with buffer.memory=128M [analytics]
17:34 <joal> Restart mediawiki-history-reduced oozie job to add a dependency [analytics]
16:55 <joal> Restart mobile_apps_session_metrics [analytics]
16:52 <joal> Deploying refinery on HDFS for mobile_apps patch [analytics]
16:26 <joal> Deploying refinery again to provide patch for mobile_apps_session_metric job [analytics]
15:09 <joal> Deploy refinery onto hdfs [analytics]
15:07 <joal> Deploy refinery from scap [analytics]
14:32 <elukey> restart druid-broker on druid1004 - no /var/log/druid/broker.log after 2018-03-10T22:38:52 (java.io.IOException: Too many open files_ [analytics]
08:50 <elukey> fixed evenglog1002's ipv6 (https://gerrit.wikimedia.org/r/#/c/418714/) [analytics]
2018-03-10 §
09:07 <joal> Rerun clickstream-wf-2018-2 [analytics]