2151-2200 of 3200 results (22ms)
2018-01-10 §
11:51 <elukey> re-run webrequest-load-wf-upload-2018-1-10-10 (failed due to reboots) [analytics]
11:27 <elukey> re-run webrequest-load-wf-text-2018-1-10-10 (failed due to reboots) [analytics]
11:26 <elukey> reboot analytics1044->47 for kernel updates [analytics]
11:03 <elukey> reboot analytics1040->43 for kernel updates [analytics]
2018-01-09 §
16:53 <joal> Rerun pageview-druid-hourly-wf-2018-1-9-13 [analytics]
15:33 <elukey> stop mysql on dbstore1002 as prep step for shutdown (stop all slaves, mysql stop) [analytics]
15:10 <elukey> reboot analytics1028 (hadoop worker and hdfs journal node) for kernel updates [analytics]
15:00 <elukey> reboot kafka-jumbo1006 for kernel updates [analytics]
14:41 <elukey> reboot kafka-jumbo1005 for kernel updates [analytics]
14:33 <elukey> reboot kafka1023 for kernel updates [analytics]
14:04 <elukey> reboot kafka1022 for kernel updates [analytics]
13:51 <elukey> reboot kafka-jumbo1003 for kernel updates [analytics]
10:08 <elukey> reboot kafka-jumbo1002 for kernel updates [analytics]
09:35 <elukey> reboot kafka1014 for kernel updates [analytics]
2018-01-08 §
19:07 <milimetric> Deployed refinery and synced to hdfs [analytics]
15:23 <elukey> reboot kafka1013 for kernel updates [analytics]
13:40 <elukey> reboot analytics10[36-39] for kernel updates [analytics]
12:59 <elukey> reboot kafka1012 for kernel updates [analytics]
12:43 <joal> Deploy AQS from tin [analytics]
12:36 <fdans> Deploying AQS [analytics]
12:33 <joal> Update fake-data in cassandra adiing top-by-country needed row [analytics]
11:07 <elukey> re-run webrequest-load-wf-text-2018-1-8-8 (failed after some reboots due to kernel updates) [analytics]
10:07 <elukey> drain + reboot analytics1029,1031->1034 for kernel updates [analytics]
2018-01-07 §
09:01 <elukey> re-enabled puppet on db110[78] - eventlogging_sync restarted on db1108 (analytics-slave) [analytics]
2018-01-06 §
08:09 <elukey> re-enable eventlogging mysql consumers after database maintenance [analytics]
2018-01-05 §
13:18 <fdans> deploying AQS [analytics]
2018-01-04 §
19:54 <joal> Deploying refinery onto hadoop [analytics]
19:45 <joal> Deploy refinery using scap [analytics]
19:38 <joal> Deploy refinery-source using jenkins [analytics]
16:01 <ottomata> killing json_refine_eventlogging_analytics job that started yesterday and has not completed (has no executors running?) application_1512469367986_81514. I think the cluster is just too busy? mw-history job running... [analytics]
10:34 <elukey> re-run mediacounts-archive-wf-2018-01-03 [analytics]
2018-01-03 §
15:00 <ottomata> restarting kafka-jumbo brokers to enable tls version and cipher suite restrictions [analytics]
2018-01-02 §
11:13 <joal> Kill and restart cassandra loading oozie bundle to pick new pageview_top_bycountry job [analytics]
08:22 <elukey> restart druid coordinators to pick up new jvm settings (freeing up 6GB of used memory) [analytics]
2017-12-21 §
15:54 <joal> Start backfilling monthly pageview-by-country [analytics]
15:45 <joal> deploy refinery onto HDFSb [analytics]
15:38 <joal> Deploying refinery with Scap [analytics]
2017-12-20 §
15:40 <ottomata> removing some old webrequest data from hdfs [analytics]
14:56 <ottomata> dropping some old wmf.webrequest partitions and data [analytics]
2017-12-19 §
17:28 <elukey> re-enabled superset [analytics]
17:16 <joal> Initilizaing new cassandra keyspace for pageviews/top-by-country [analytics]
16:52 <elukey> temporarily stop superset to test druid's performances [analytics]
16:34 <elukey> manually started eventlogging cleaner on db1107 to purge/sanitize data up to 90 days ago (tmux is running for user eventlogcleaner) [analytics]
14:10 <elukey> temporary changed JVM Heap settings for the druid broker on druid1001 - Xmx25g Xms10g (run puppet and restart the daemon to rollback) [analytics]
2017-12-12 §
15:54 <milimetric> sieging aqs1004 with 100.000 transactions [analytics]
2017-12-11 §
21:16 <andrewbogott> updating puppetmaster p1.analytics.eqiad.wmflabs to puppet 4 [analytics]
14:07 <elukey> disable druid middlemanager on druid1003 to drain + restart to pick up new logging settings [analytics]
12:59 <elukey> disabled druid middlemanager on druid1002 to drain+restart with new logging config [analytics]
2017-12-08 §
11:15 <joal> Start mediawiki-history oozie jobs new-version [analytics]
10:49 <joal> Update wmf.mediawiki_history as explained in email (rename current table to old, create new one) [analytics]