2301-2350 of 4807 results (29ms)
2020-03-05 §
19:39 <elukey> mv /srv/reportupdater to /srv/reportupdater-backup05032020 on stat100[6,7] [analytics]
16:34 <mforns> restart turnilo to refresh deleted datasources [analytics]
14:16 <elukey> restart hdfs/yarn master daemons to pick up new core-site changes for Superset [analytics]
06:48 <elukey> restart yarn on analytics1074 (GC overhead, traces of network errors with datanodes) [analytics]
2020-03-04 §
08:41 <joal> Kill-restart mediawiki-history-reduced-coord [analytics]
08:38 <joal> Kill-restart mediawiki-history-dumps-coord [analytics]
2020-03-03 §
21:19 <joal> Kill-restart actor jobs [analytics]
21:17 <joal> kill-restart mediawiki-history-check_denormalize-coord [analytics]
21:16 <joal> Kill-restart mediawiki-history job [analytics]
21:10 <joal> Kill Wikidataplaceholder failling coord [analytics]
21:08 <joal> Kill restart wikidata-specialentitydata_metrics-coord [analytics]
21:07 <joal> Start Wikidataplaceholder job [analytics]
21:06 <joal> Kill/restart edit_hourly job [analytics]
21:04 <joal> Start wikidata_item_page_link coordinator [analytics]
20:46 <joal> Deploy refinery onto HDFS [analytics]
20:34 <joal> Deploy refinery using scap [analytics]
20:28 <joal> Add new jars to refinery using Jenkins [analytics]
20:01 <joal> Release refinery-source v0.0.117 with Jenkins [analytics]
16:37 <mforns> restarted turnilo to refresh deleted test datasource [analytics]
11:56 <joal> Kill actor-hourly oozie test jobs (precision of previous message) [analytics]
11:55 <joal> Kill actor-hourly tests [analytics]
10:50 <elukey> restarted kafka jumbo (kafka + mirror maker) for openjdk upgrades [analytics]
09:22 <joal> Rerunning failed mediawiki-history jobs for 2020-02 after mediawiki-history-denormalize issue [analytics]
09:16 <joal> Manually restarting mediawiki-history-denormalize with new patch to try [analytics]
08:36 <elukey> roll restart kafka-jumbo for openjdk upgrades [analytics]
08:34 <elukey> re-enable timers on an-coord1001 after maintenance [analytics]
08:30 <joal> Correct previsou message: Kill mediawiki-history (not mediawiki-history-reduced) as it is failing [analytics]
08:30 <joal> Kill mediawiki-history-reduced as it is failing [analytics]
08:22 <elukey> hive metastore/server2 now running without zookeeper settings and without DBTokenStore (in memory one used instead, the default) [analytics]
08:19 <elukey> restart oozie/hive daemons on an-coord1001 for openjdk upgrades [analytics]
06:41 <elukey> roll restart druid daemons for openjdk upgrades [analytics]
06:39 <elukey> sto timers on an-coord1001 to facilitate daemon restarts (hive/oozie) [analytics]
2020-03-02 §
19:58 <joal> Remove faulty _REFINED file at /wmf/data/event/mediawiki_revision_score/datacenter=eqiad/year=2020/month=3/day=2/hour=10/_REFINED [analytics]
15:38 <elukey> apply new settings to all stat/notebooks [analytics]
15:31 <elukey> setting new user.slice global memory/cpu settings on notebook1003 [analytics]
15:25 <elukey> setting new user-slice global memory/cpu settings on stat1007 [analytics]
2020-02-28 §
19:10 <milimetric> deployed 0.0.116 and restarted webrequest load bundle at 2020-02-28T14 [analytics]
14:49 <joal> Drop test keyspaces in cassandra cluster [analytics]
2020-02-27 §
21:16 <milimetric> tried to deploy AQS but it failed with the same integration test on mediarequests, sending email [analytics]
2020-02-26 §
15:06 <ottomata> dropped and re-added backfilled partitions on event.CentralNoticeImpression table to propogate schema alter on main table - T244771 [analytics]
09:50 <joal> Force delete old api/cirrus events from HDFS trash to free some space [analytics]
2020-02-24 §
18:20 <elukey> move report updater jobs from stat1007 to an-launcher1001 [analytics]
2020-02-22 §
14:21 <elukey> restart hadoop-yarn-nodemanager on analytics1044 - broken disk, apply hiera overrides to exclude it [analytics]
14:11 <elukey> restart hadoop-yarn-nodemanager on analytics1073 - process died, logs saved in /home/elukey [analytics]
2020-02-21 §
16:04 <ottomata> altered event.CentralNoticeImpression table column event.campaignStatuses to type string, will backfill data - T244771 [analytics]
11:49 <elukey> restart varnishkafka on various cp30xx nodes [analytics]
11:41 <elukey> restart varnishkafka on cp3057 (stuck in timeouts to kafka, analytics alarms raised) [analytics]
08:19 <fdans> deploying refinery [analytics]
00:11 <joal> Rerun failed wikidata-json_entity-weekly-coord instances after having created the missing hive table [analytics]
2020-02-20 §
16:57 <fdans> refinery source jars updated [analytics]