551-600 of 2850 results (8ms)
2019-11-19 §
13:46 <joal> Deleting 100 heavier log-folders from analytics user (cassandra backfilling logs) -- T238648 [analytics]
07:51 <elukey> restart hdfs-cleaner on an-coord1001 [analytics]
2019-11-18 §
20:03 <joal> Rerun failed mediawiki_wikitext_history oozie job (2019-10) [analytics]
2019-11-16 §
09:44 <elukey> systemctl restart hadoop-* on analytics1077 after oom killer [analytics]
2019-11-15 §
17:05 <elukey> restart hdfs-cleaner (failed due to tmp hive files not present when deleting) [analytics]
2019-11-14 §
16:09 <elukey> roll restart presto-server on an-presto* to pick up new openjdk [analytics]
08:47 <joal> starting hdfs-cleaner manually after after failure earlier this night [analytics]
08:37 <fdans> initiating bacfilling of daily top mediarequests from the mediacounts database - May 2018 to May 2019 [analytics]
2019-11-12 §
16:52 <elukey> forced a purge in Varnish for the stats.wikimedia.org front page to pick up the new deprecation banner [analytics]
15:42 <fdans> manually overwriting index.html in Wikistats 1 to apply patch https://gerrit.wikimedia.org/r/#/c/analytics/wikistats/+/550338/ [analytics]
2019-11-08 §
12:34 <elukey> roll restart cassandra on aqs to pick up new openjdk upgrades [analytics]
12:22 <elukey> restart oozie and hive daemons on an-coord1001 [analytics]
09:05 <elukey> roll restart druid daemons on druid public to pick up the new jvm [analytics]
08:34 <elukey> roll restart druid daemons on druid analytics to pick up the new jvm [analytics]
08:34 <elukey> restart kafka on kafka-jumbo1001 to test opendjk [analytics]
2019-11-07 §
17:33 <elukey> restart zookeeper on druid nodes for jvm upgrades [analytics]
17:33 <elukey> restart all jvms on hadoop test workers [analytics]
15:41 <elukey> roll restart all jvms on Hadoop Analytics Workers to pick up the new jvm [analytics]
12:18 <joal> Deleting stat1007:/srv/reportupdater/output/metrics/reference-previews/baseline.tsv as asked by awight [analytics]
2019-11-06 §
22:36 <milimetric> successfully restarted webrequest bundle, webrequest druid daily, and webrequest druid hourly [analytics]
21:21 <milimetric> restarting webrequest load bundle and druid loading jobs [analytics]
21:21 <milimetric> refinery deployed, hdfs cleaner and tls ready to be restarted [analytics]
20:16 <joal> Kill-rerun pageview-hourly-wf-2019-11-6-13 for being stuck in whitelist-check [analytics]
18:13 <joal> restart refinery-import-page-current-dumps.service to test after yestardays failure [analytics]
2019-11-05 §
21:06 <joal> restarting oozie jobs after spark 2.4.4 upgrade [analytics]
21:04 <ottomata> re-enabling refine jobs after spark 2.4.4 upgrade [analytics]
20:57 <joal> Starting denoramlize-check one month in advance to enforce a running job with new spark [analytics]
20:37 <ottomata> roll restarting hadoop-yarn-nodemanagers to pick up spark 2.4.4 shuffle lib [analytics]
20:21 <ottomata> install spark 2.4.4-bin-hadoop2.6-1 cluster wide using debdeploy - T222253 [analytics]
20:18 <joal> Deploying refinery onto HDFS [analytics]
20:12 <ottomata> stopped refine jobs for Spark 2.4 upgrade - T222253 [analytics]
20:09 <joal> Deploying refinery using scap with missing patch [analytics]
20:00 <joal> Deploying refinery using scap [analytics]
18:49 <joal> Make Jenkins release refinery-source v0.0.105 to archiva [analytics]
17:12 <ottomata> 2019-11-05T17:11:50.239 INFO HDFSCleaner Deleted 872360 files and directories in tmp [analytics]
17:01 <ottomata> first run of HDFSCleaner on /tmp, should delete files older than 31 days [analytics]
11:00 <fdans> testing load of top metric from mediarequests with corrected quotemarks escaping [analytics]
2019-11-04 §
23:28 <milimetric> deployed refinery [analytics]
14:58 <joal> restarting AQS using scap after snapshot bump (2019-10) [analytics]
2019-10-31 §
19:45 <fdans> (actually no, no need) [analytics]
19:43 <fdans> (changing jar version first) [analytics]
19:43 <fdans> restarting mediawiki-history-wikitext [analytics]
19:42 <fdans> refinery deployment complete [analytics]
19:17 <fdans> updating jar symlinks to 0.0.104 [analytics]
17:59 <fdans> deploying refinery [analytics]
17:49 <fdans> deplying refinery-source 0.0.104 [analytics]
16:36 <elukey> restart oozie and hive-server2 on an-coord1001 to pick up new new TLS mapreduce settings [analytics]
15:31 <joal> Rerun webrequest jobs for hour 2019-10-31T14:00 after failure [analytics]
14:53 <elukey> enabled encrypted shuffle option in all Hadoop Analytics Yarn Node Managers [analytics]
10:17 <elukey> deploy TLS certificates for MapReduce Shufflers on Hadoop worker nodes (no-op change, no yarn-site config) [analytics]