451-500 of 2333 results (13ms)
2019-05-09 §
16:38 <elukey> restart hive-server2 on an-coord1001 due to OOMs [analytics]
16:13 <elukey> killed application_1555511316215_77583 from Yarn CLI [analytics]
11:04 <elukey> kill oozie mediawiki geoeditors coords (3 in total) + chown -R analytics /wmf/data/wmf/mediawiki_private (raw data already chowned with analytics:analytics) + restart of the coords with the analytics user [analytics]
09:17 <elukey> restart oozie wikidata coordinators (3 in total) with the analytics user [analytics]
2019-05-08 §
15:39 <mforns_> deploying refinery up to 698f2137aa965b07548ae7565aafaa784628b13c and together with refinery-source 0.0.89 [analytics]
14:55 <elukey> kill last_access_uniques-daily-asiacell-coord from hue (coord not used anymore) [analytics]
14:05 <mforns_> deployed refinery-source up to ad74c41b05d5f838df6febb379e883855abb203d [analytics]
13:09 <mforns_> started deployment train [analytics]
11:15 <elukey> kill projectview coords (2 in total) + chown analytics:analytics /wmf/data/wmf/projectview and /wmf/data/archive/projectview + restart coords with the analytics user [analytics]
09:50 <elukey> kill virtualpageviews coords (3 in total) + chown analytics:analytics /wmf/data/wmf/virtualpageview + restart of the coords with user analytics [analytics]
09:00 <elukey> kill unique_devices coords (10 in total) + chown analytics:analytics /wmf/data/wmf/unique_devices + restart of 10 coords with user analytics [analytics]
06:41 <elukey> chown /tmp/mobile_apps to analytics:analytics [analytics]
2019-05-07 §
14:37 <elukey> kill pageview oozie coord (4 in total) + chown analytics:analytics /wmf/data/wmf/pageview /wmf/data/archive/pageview + restart of the coordinators with the analytics user [analytics]
11:46 <elukey> kill mobile apps coordinators + chown analytics:analytics /wmf/data/archive/mobile_apps, /wmf/data/wmf/mobile_apps + restart of the coordinators with user analytics [analytics]
11:23 <joal> Updating /wmf/data/raw/mediawiki_private/tables to be owned by analytics:analytics [analytics]
11:19 <joal> Updating /wmf/data/raw/mediawiki/xmldumps to be owned by analytics:analytics [analytics]
11:19 <joal> Updating /wmf/data/raw/mediawiki/project_namespace_map to be owned by analytics:analytics [analytics]
11:19 <joal> Updating /wmf/data/raw/mediawiki/tables to be owned by analytics:analytics [analytics]
09:38 <elukey> kill clickstream-coord, chown /wmf/data/archive/clickstream to analytics:analytics, restart the job with the analytics user override [analytics]
09:24 <elukey> kill ores-revision-scores-public-coord via hue (not used anymore) [analytics]
07:46 <elukey> temporary override of oozie/util/druid/load/workflow.xml in HDFS's refinery to allow the analytics user to push data to druid from oozie [analytics]
2019-05-06 §
14:22 <elukey> kill apis-coord and relaunch it with user analytics [analytics]
13:51 <elukey> kill mediacounts-load-coor, chown analytics:analytics /wmf/data/wmf/mediacounts, restart coordinator with user 'analytics' [analytics]
12:52 <elukey> kill interlanguage-coord, chown analytics:analytics /wmf/data/wmf/interlanguage, restart coordinator with user 'analytics' [analytics]
12:15 <elukey> kill browser-general-coor, chown analytics:analytics /wmf/data/wmf/browser, restart coordinator with user 'analytics' [analytics]
09:32 <joal> manually touching success files to start banner_activity-druid-monthly-coord between 2018-06-01/2018-12-31 [analytics]
09:28 <joal> Launch new banner_activity-druid-monthly-coord between 2018-06-01/2018-12-31 to cover for timedout past actions [analytics]
09:13 <elukey> kill banner impression coordinators, chown /wmf/data/wmf/banner_impressions to analyits:analytics and start coordinators again [analytics]
07:42 <elukey> chown -R /wmf/data/wmf/aqs/* to analytics:analytics (was: analytics:hdfs) [analytics]
2019-05-05 §
07:31 <joal> Manually laumch druid indexation of mediawiki_history_reduced_2019_04 [analytics]
07:29 <joal> Manually add 2019-04 hive partition to mediawiki_history_reduced after automated job failed (expected failure after refactor) [analytics]
2019-05-03 §
07:14 <joal> Restarting mediawiki-history-check_denormalize-coord with missing parameter (patch provided to prevent the coord to start without it) [analytics]
2019-05-02 §
13:30 <joal> Restarting AQS oozie job with -Duser=analytics parameter [analytics]
13:10 <joal> Kill oozie aqs-hourly-coord [analytics]
08:57 <elukey> manual start of refinery-sqoop-mediawiki-production.service [analytics]
2019-05-01 §
20:02 <ottomata> sudo systemctl stop refinery-sqoop-mediawiki-production [analytics]
19:58 <ottomata> sudo systemctl disable refinery-sqoop-mediawiki-production [analytics]
18:25 <joal> restarted oozie jobs mediawiki-history-denormalize-coord, mediawiki-history-check_denormalize-coord and mediawiki-history-reduced-coord [analytics]
18:22 <joal> Confirming that sqoop-private (cu_changes) will run automatically tonight (2nd of the month at 00:00) - nothing needed [analytics]
18:08 <joal> Manually killed sqoop-production (comment and actor) to have it done after the current manual labs run [analytics]
17:59 <joal> Starting a manual run of sqoop [analytics]
17:55 <joal> deploying refinery onto HDFS [analytics]
17:40 <joal> deploy refinery using scap after failed attemp [analytics]
17:37 <joal> Recreate wmf.mediawiki_history (+page and user) and wmf.mediawiki_history_archive (with old data) [analytics]
17:12 <joal> Moving exisiting mediawiki-history to /wmf/data/wmf/mediawiki/archive folder [analytics]
17:08 <joal> Killing oozie jobs for new deploy: mediawiki-history-denormalize-coord, mediawiki-history-check_denormalize-coord, mediawiki-history-reduced-coord [analytics]
17:02 <joal> Deploying refinery using scap [analytics]
16:48 <joal> Kill oozie mediawiki-history-druid-coord for true (replaced by edit_hourly job) [analytics]
16:08 <joal> refinery-source v0.0.88 released on archiva [analytics]
2019-04-30 §
13:25 <ottomata> restarting eventlogging processes to upgrade to python-kafka 1.4.6 - T221848 [analytics]