351-400 of 3826 results (13ms)
2021-02-16 §
06:58 <elukey> restart hdfs/yarn daemons on an-worker1097 to exclude a failed disk [analytics]
2021-02-15 §
20:38 <mforns> running hdfs fsck to troubleshoot corrupt blocks [analytics]
17:28 <elukey> restart hdfs namenodes on the main cluster to pick up new racking changes (worker nodes from the backup cluster) [analytics]
2021-02-14 §
09:38 <joal> Restart and backfill mediacount and mediarequest, and backfill mediarequest-AQS and mediacount archive [analytics]
09:38 <joal> deploy refinery onto hdfs [analytics]
09:14 <joal> Deploy hotfix for mediarequest and mediacount [analytics]
2021-02-12 §
19:19 <milimetric> deployed refinery with query syntax fix for the last broken cassandra job and an updated EL whitelist [analytics]
18:34 <razzi> rebalance kafka partitions for atskafka_test_webrequest_text [analytics]
18:31 <razzi> rebalance kafka partitions for __consumer_offsets [analytics]
17:48 <joal> Rerun wikidata-articleplaceholder_metrics-wf-2021-2-10 [analytics]
17:47 <joal> Rerun wikidata-specialentitydata_metrics-wf-2021-2-10 [analytics]
17:43 <joal> Rerun wikidata-json_entity-weekly-wf-2021-02-01 [analytics]
17:08 <elukey> reboot presto workers for kernel upgrade [analytics]
16:32 <mforns> finished deployment of analytics-refinery [analytics]
15:26 <mforns> started deployment of analytics-refinery [analytics]
15:16 <elukey> roll restart druid broker on druid-public to pick up new settings [analytics]
07:54 <elukey> roll restart of druid brokers on druid-public - locked after scheduled datasource deletion [analytics]
07:46 <elukey> force a manual run of refinery-druid-drop-public-snapshots on an-launcher1002 (3d before its natural start) - controlled execution to see how druid + 3xdataset replication reacts [analytics]
2021-02-11 §
14:26 <joal> Restart oozie API job after spark sharelib fix (start: 2021-02-10T18:00) [analytics]
14:20 <joal> Rerun failed clicstream instance 2021-01 after sharelib fix [analytics]
14:16 <joal> Restart oozie after having fixed the spark-2.4.4 sharelib [analytics]
14:12 <joal> Fix oozie sharelib for spark-2.4.4 by copying oozie-sharelib-spark-4.3.0.jar onto the spark folder [analytics]
02:19 <milimetric> deployed again to fix old spelling error :) referererererer [analytics]
00:05 <milimetric> deployed refinery and synced to hdfs, restarting cassandra jobs gently [analytics]
2021-02-10 §
21:46 <razzi> rebalance kafka partitions for eqiad.mediawiki.cirrussearch-request [analytics]
21:10 <razzi> rebalance kafka partitions for codfw.mediawiki.cirrussearch-request [analytics]
19:11 <elukey> drop /user/oozie/share + chown o+rx -R /user/oozie/share + restart oozie [analytics]
17:56 <razzi> rebalance kafka partitions for eventlogging-client-side [analytics]
01:07 <milimetric> deployed refinery with some fixes after BigTop upgrade, will restart three coordinators right now [analytics]
2021-02-09 §
22:04 <razzi> rebalance kafka partitions for eqiad.resource-purge [analytics]
20:51 <joal> Rerun webrequest-load-coord-[text|upload] for 2021-02-09T07:00 after data was imported to camus [analytics]
20:50 <razzi> rebalance kafka partitions for codfw.resource-purge [analytics]
20:31 <joal> Rerun webrequest-load-coord-[text|upload] for 2021-02-09T06:00 after data was imported to camus [analytics]
16:30 <elukey> restart datanode on ana-worker1100 [analytics]
16:14 <ottomata> restart datanode on analytics1059 with 16g heap [analytics]
16:08 <ottomata> restart datanode on an-worker1080 withh 16g heap [analytics]
15:58 <ottomata> restart datanode on analytics1058 [analytics]
15:55 <ottomata> restart datenode on an-worker1115 [analytics]
15:38 <elukey> restart namenode on an-master1002 [analytics]
15:01 <elukey> restart an-worker1104 with 16g heap size to allow bootstrap [analytics]
15:01 <elukey> restart an-worker1103 with 16g heap size to allow bootstrap [analytics]
14:57 <elukey> restart an-worker1102 with 16g heap size to allow bootstrap [analytics]
14:54 <elukey> restart an-worker1090 with 16g heap size to allow bootstrap [analytics]
14:50 <elukey> restart analytics1072 with 16g heap size to allow bootstrap [analytics]
14:50 <elukey> restart analytics1069 with 16g heap size to allow bootstrap [analytics]
14:08 <elukey> restart analytics1069's datanode with bigger heap size [analytics]
13:39 <elukey> restart hdfs-datanode on analytics10[65,69] - failed to bootstrap due to issues reading datanode dirs [analytics]
13:38 <elukey> restart hdfs-datanode on an-worker1080 (test canary - not showing up in block report) [analytics]
10:04 <elukey> stop mysql replication an-coord1001 -> an-coord1002, an-coord1001 -> db1108 [analytics]
08:29 <elukey> leave hdfs safemode to let distcp do its job [analytics]