2801-2850 of 4882 results (24ms)
2019-08-22 §
09:34 <elukey> clean up on the oozie db loop_* workflows (oozie stuck for some reason, most of the coords not processing anything since hours) [analytics]
08:35 <joal> Restart webrequest bundle [analytics]
08:32 <joal> Manually kill all leftover workflows from mediawiki-history-dumps [analytics]
08:29 <joal> Kill webrequest-load bundle [analytics]
08:18 <moritzm> restarted oozie on an-coord1001 [analytics]
07:32 <joal> Rerun webrequest-load for text and upload, hours 21 and 22 [analytics]
07:28 <joal> Suspend/resume stalled coordinators in hue [analytics]
2019-08-21 §
14:27 <elukey> swap turnilo backend in varnish from analytics-tool1002 to an-tool1007 [analytics]
2019-08-20 §
06:57 <elukey> drop wmf_netflow from Analytics druid and restart the job with more dimensions [analytics]
2019-08-14 §
17:58 <fdans> backfilling mediarequests from 2019-5-16 to 2019-8-14 [analytics]
2019-08-13 §
08:47 <elukey> kill/restart mediawiki geoeditors|history load, history wikitext to pick up chances to the repair workflow (hive2 actions) [analytics]
08:40 <elukey> kill/restart mediawiki geoeditors druid/monthly to pick up hive2 actions [analytics]
08:40 <elukey> kill/restart mediawiki history metrics/reduced to pick up hive2 actions [analytics]
06:23 <elukey> kill/restart oozie coord unique_devices per_project_family daily due to missing jdbc_url in coordinator.properties (for hive2 actions) [analytics]
2019-08-12 §
22:00 <mforns> restarted projectview geo coordinator in oozie [analytics]
21:55 <mforns> restarted all Unique Devices coordinators (except cassandra ones) in oozie [analytics]
21:28 <mforns> restarted all Virtualpageview coordinators in oozie [analytics]
21:14 <mforns> restarted Webrequest druid coordinators in oozie [analytics]
21:06 <mforns> restarted Webrequest bundle in oozie [analytics]
19:32 <mforns> Finished deployment of analytics-refinery up to 5418d3be5f65f7325324d0c15c51b3ca722dde1c [analytics]
18:33 <mforns> Starting deployment of analytics-refinery up to 5418d3be5f65f7325324d0c15c51b3ca722dde1c [analytics]
2019-08-09 §
06:36 <elukey> restart oozie coords to pick up new hive2 actions (edit hourly, pageview druid daily/hourly/monthly, mobile apps uniques daily/monthly) [analytics]
2019-08-08 §
17:47 <fdans> refinery deploy successful [analytics]
17:33 <fdans> scap deploy of refinery done [analytics]
16:40 <fdans> deploying refinery [analytics]
16:38 <fdans> updating jars [analytics]
16:25 <fdans> releasing refinery-source 0.0.97 to Maven [analytics]
16:15 <fdans> restarting oozie coordinator pageview-druid-monthly-coord [analytics]
16:14 <fdans> restarting oozie coordinator pageview-druid-daily-coord [analytics]
16:13 <fdans> restarting oozie coordinator pageview-druid-hourly-coord [analytics]
16:09 <fdans> restarting oozie coordinator mobile_apps-uniques-daily-coord [analytics]
16:08 <fdans> restarting oozie coordinator mobile_apps-uniques-monthly-coord [analytics]
16:02 <fdans> restarting edit_hourly [analytics]
2019-08-02 §
14:28 <mforns> restarting oozie bundle for cassandra and oozie coordinator for edit_hourly [analytics]
14:27 <mforns> finished deploying refinery [analytics]
13:57 <mforns> deploying refinery up to b50a93955952ed863d5ef7703a91ab59f5d979cf (rollback of cassandra and edit_hourly hive2 actions to unbreak production) [analytics]
13:26 <elukey> kill/start edit hourly oozie coordinator as attempt to fix a recurrent failure [analytics]
08:52 <elukey> manually created /tmp/hive/operation_logs on an-coord1001 [analytics]
2019-07-31 §
18:06 <mforns> deployed Wikistats2 version 2.6.5 [analytics]
16:04 <mforns> finished deployment of analytics-refinery up to eb2d9b005b26f6dddab2b59f1ba591f1758ec99f [analytics]
15:37 <mforns> starting deployment of analytics-refinery up to eb2d9b005b26f6dddab2b59f1ba591f1758ec99f [analytics]
12:58 <elukey> roll restart zookeeper on druid clusters with spicerack cookbook [analytics]
08:06 <elukey> increase heap size on HDFS Namenodes (an-master100[12]) to 16G [analytics]
2019-07-30 §
08:14 <mforns> restarted hive-server2 [analytics]
08:14 <mforns> restarted hive-metastore [analytics]
07:59 <mforns> restarted oozie in an-coord1001.eqiad.wmnwt [analytics]
2019-07-29 §
15:34 <elukey> roll restart kafka brokers on Jumbo with spicerack [analytics]
13:01 <elukey> roll restart druid jvms on druid100[4-6] via spicerack cookbook [analytics]
08:56 <elukey> roll restart druid jvms on druid100[1-3] via spicerack cookbook [analytics]
06:31 <elukey> restart the hadoop workers' jvms via spicerack cookbook [analytics]