1-50 of 2311 results (13ms)
2019-11-27 §
09:16 <elukey> apply systemd user limits to stat1005 [analytics]
07:10 <elukey> apply systemd user limits to stat1006,stat1007 and notebook100* [analytics]
2019-11-26 §
17:19 <elukey> add systemd user limits to stat1004 [analytics]
2019-11-25 §
13:27 <elukey> set global read_only=1 on db1108's log database [analytics]
2019-11-21 §
20:07 <mforns> deploying refinery to add pageview whitelist changes and stop alerts [analytics]
15:50 <mforns> deployed refinery (with v0.0.107) [analytics]
15:10 <mforns> deployed refinery-source v0.0.107 [analytics]
06:59 <elukey> restart hdfs-cleaner on an-coord1001 [analytics]
2019-11-19 §
19:00 <elukey> regenerate TLS cert for yarn.wikimedia.org (containing SANs for all analytics UIs) to add datasets.w.o SAN (site was failing due to ATS not being able to contact thorium) [analytics]
13:54 <joal> Deleting 600 more log-folders from analytics user (cassandra backfilling logs) -- T238648 [analytics]
13:46 <joal> Deleting old parquet wikitext data (new data is stored in Avro) -- T238648 [analytics]
13:46 <joal> Deleting 100 heavier log-folders from analytics user (cassandra backfilling logs) -- T238648 [analytics]
07:51 <elukey> restart hdfs-cleaner on an-coord1001 [analytics]
2019-11-18 §
20:03 <joal> Rerun failed mediawiki_wikitext_history oozie job (2019-10) [analytics]
2019-11-16 §
09:44 <elukey> systemctl restart hadoop-* on analytics1077 after oom killer [analytics]
2019-11-15 §
17:05 <elukey> restart hdfs-cleaner (failed due to tmp hive files not present when deleting) [analytics]
2019-11-14 §
16:09 <elukey> roll restart presto-server on an-presto* to pick up new openjdk [analytics]
08:47 <joal> starting hdfs-cleaner manually after after failure earlier this night [analytics]
08:37 <fdans> initiating bacfilling of daily top mediarequests from the mediacounts database - May 2018 to May 2019 [analytics]
2019-11-12 §
16:52 <elukey> forced a purge in Varnish for the stats.wikimedia.org front page to pick up the new deprecation banner [analytics]
15:42 <fdans> manually overwriting index.html in Wikistats 1 to apply patch https://gerrit.wikimedia.org/r/#/c/analytics/wikistats/+/550338/ [analytics]
2019-11-08 §
12:34 <elukey> roll restart cassandra on aqs to pick up new openjdk upgrades [analytics]
12:22 <elukey> restart oozie and hive daemons on an-coord1001 [analytics]
09:05 <elukey> roll restart druid daemons on druid public to pick up the new jvm [analytics]
08:34 <elukey> roll restart druid daemons on druid analytics to pick up the new jvm [analytics]
08:34 <elukey> restart kafka on kafka-jumbo1001 to test opendjk [analytics]
2019-11-07 §
17:33 <elukey> restart zookeeper on druid nodes for jvm upgrades [analytics]
17:33 <elukey> restart all jvms on hadoop test workers [analytics]
15:41 <elukey> roll restart all jvms on Hadoop Analytics Workers to pick up the new jvm [analytics]
12:18 <joal> Deleting stat1007:/srv/reportupdater/output/metrics/reference-previews/baseline.tsv as asked by awight [analytics]
2019-11-06 §
22:36 <milimetric> successfully restarted webrequest bundle, webrequest druid daily, and webrequest druid hourly [analytics]
21:21 <milimetric> restarting webrequest load bundle and druid loading jobs [analytics]
21:21 <milimetric> refinery deployed, hdfs cleaner and tls ready to be restarted [analytics]
20:16 <joal> Kill-rerun pageview-hourly-wf-2019-11-6-13 for being stuck in whitelist-check [analytics]
18:13 <joal> restart refinery-import-page-current-dumps.service to test after yestardays failure [analytics]
2019-11-05 §
21:06 <joal> restarting oozie jobs after spark 2.4.4 upgrade [analytics]
21:04 <ottomata> re-enabling refine jobs after spark 2.4.4 upgrade [analytics]
20:57 <joal> Starting denoramlize-check one month in advance to enforce a running job with new spark [analytics]
20:37 <ottomata> roll restarting hadoop-yarn-nodemanagers to pick up spark 2.4.4 shuffle lib [analytics]
20:21 <ottomata> install spark 2.4.4-bin-hadoop2.6-1 cluster wide using debdeploy - T222253 [analytics]
20:18 <joal> Deploying refinery onto HDFS [analytics]
20:12 <ottomata> stopped refine jobs for Spark 2.4 upgrade - T222253 [analytics]
20:09 <joal> Deploying refinery using scap with missing patch [analytics]
20:00 <joal> Deploying refinery using scap [analytics]
18:49 <joal> Make Jenkins release refinery-source v0.0.105 to archiva [analytics]
17:12 <ottomata> 2019-11-05T17:11:50.239 INFO HDFSCleaner Deleted 872360 files and directories in tmp [analytics]
17:01 <ottomata> first run of HDFSCleaner on /tmp, should delete files older than 31 days [analytics]
11:00 <fdans> testing load of top metric from mediarequests with corrected quotemarks escaping [analytics]
2019-11-04 §
23:28 <milimetric> deployed refinery [analytics]
14:58 <joal> restarting AQS using scap after snapshot bump (2019-10) [analytics]