| 
      
        2019-11-05
      
      §
     | 
  
    
  | 21:06 | 
  <joal> | 
  restarting oozie jobs after spark 2.4.4 upgrade | 
  [analytics] | 
            
  | 21:04 | 
  <ottomata> | 
  re-enabling refine jobs after spark 2.4.4 upgrade | 
  [analytics] | 
            
  | 20:57 | 
  <joal> | 
  Starting denoramlize-check one month in advance to enforce a running job with new spark | 
  [analytics] | 
            
  | 20:37 | 
  <ottomata> | 
  roll restarting hadoop-yarn-nodemanagers to pick up spark 2.4.4 shuffle lib | 
  [analytics] | 
            
  | 20:21 | 
  <ottomata> | 
  install spark 2.4.4-bin-hadoop2.6-1 cluster wide using debdeploy - T222253 | 
  [analytics] | 
            
  | 20:18 | 
  <joal> | 
  Deploying refinery onto HDFS | 
  [analytics] | 
            
  | 20:12 | 
  <ottomata> | 
  stopped refine jobs for Spark 2.4 upgrade - T222253 | 
  [analytics] | 
            
  | 20:09 | 
  <joal> | 
  Deploying refinery using scap with missing patch | 
  [analytics] | 
            
  | 20:00 | 
  <joal> | 
  Deploying refinery using scap | 
  [analytics] | 
            
  | 18:49 | 
  <joal> | 
  Make Jenkins release refinery-source v0.0.105 to archiva | 
  [analytics] | 
            
  | 17:12 | 
  <ottomata> | 
  2019-11-05T17:11:50.239 INFO HDFSCleaner Deleted 872360 files and directories in tmp | 
  [analytics] | 
            
  | 17:01 | 
  <ottomata> | 
  first run of HDFSCleaner on /tmp, should delete files older than 31 days | 
  [analytics] | 
            
  | 11:00 | 
  <fdans> | 
  testing load of top metric from mediarequests with corrected quotemarks escaping | 
  [analytics] | 
            
  
    | 
      
        2019-10-31
      
      §
     | 
  
    
  | 19:45 | 
  <fdans> | 
  (actually no, no need) | 
  [analytics] | 
            
  | 19:43 | 
  <fdans> | 
  (changing jar version first) | 
  [analytics] | 
            
  | 19:43 | 
  <fdans> | 
  restarting mediawiki-history-wikitext | 
  [analytics] | 
            
  | 19:42 | 
  <fdans> | 
  refinery deployment complete | 
  [analytics] | 
            
  | 19:17 | 
  <fdans> | 
  updating jar symlinks to 0.0.104 | 
  [analytics] | 
            
  | 17:59 | 
  <fdans> | 
  deploying refinery | 
  [analytics] | 
            
  | 17:49 | 
  <fdans> | 
  deplying refinery-source 0.0.104 | 
  [analytics] | 
            
  | 16:36 | 
  <elukey> | 
  restart oozie and hive-server2 on an-coord1001 to pick up new new TLS mapreduce settings | 
  [analytics] | 
            
  | 15:31 | 
  <joal> | 
  Rerun webrequest jobs for hour 2019-10-31T14:00 after failure | 
  [analytics] | 
            
  | 14:53 | 
  <elukey> | 
  enabled encrypted shuffle option in all Hadoop Analytics Yarn Node Managers | 
  [analytics] | 
            
  | 10:17 | 
  <elukey> | 
  deploy TLS certificates for MapReduce Shufflers on Hadoop worker nodes (no-op change, no yarn-site config) | 
  [analytics] |