| 
      
        2015-06-03
      
      §
     | 
  
    
  | 20:47 | 
  <marxarelli> | 
  Reloading Zuul to deploy I96649bc92a387021a32d354c374ad844e1680db2  | 
  [releng] | 
            
  | 20:28 | 
  <hashar> | 
  Restarting Jenkins to release a deadlock | 
  [releng] | 
            
  | 20:22 | 
  <hashar> | 
  deployment-bastion Jenkins slave is stalled again :-(  No code update happening on beta cluster | 
  [releng] | 
            
  | 18:50 | 
  <thcipriani> | 
  change use_dnsmasq: false for deployment-prep | 
  [releng] | 
            
  | 18:24 | 
  <thcipriani> | 
  updating deployment-salt puppet in prep for use_dnsmasq=false | 
  [releng] | 
            
  | 11:58 | 
  <kart_> | 
  Cherry-picked 213840 to test logstash | 
  [releng] | 
            
  | 10:08 | 
  <hashar> | 
  Update JJB fork again f966521..4135e14 . Will remove the http notification to zuul {{bug:T93321}}. REFRESHING ALL JOBS! | 
  [releng] | 
            
  | 10:03 | 
  <hashar> | 
  Further updated JJB fork  c7231fe..f966521 | 
  [releng] | 
            
  | 09:10 | 
  <hashar> | 
  Refershing almost all jenkins jobs to take in account the Jenkins Git plugin upgrade https://phabricator.wikimedia.org/T101105 | 
  [releng] | 
            
  | 03:07 | 
  <Krinkle> | 
  Reloading Zuul to deploy  https://gerrit.wikimedia.org/r/215571 | 
  [releng] | 
            
  
    | 
      
        2015-05-27
      
      §
     | 
  
    
  | 21:15 | 
  <AaronSchulz> | 
  populated jobqueue:aggregator:s-wikis:v2 with 1000 fake wiki keys for load testing | 
  [releng] | 
            
  | 21:07 | 
  <AaronSchulz> | 
  Deployed https://gerrit.wikimedia.org/r/#/c/208852/ | 
  [releng] | 
            
  | 21:07 | 
  <AaronSchulz> | 
  Deleted 4G of logs on jobrunner01 | 
  [releng] | 
            
  | 15:09 | 
  <hashar> | 
  Jenkins slaves are all back up. Root cause was some ssh algorithm in their sshd which is not supported by Jenkins jsch embedded lib. | 
  [releng] | 
            
  | 14:30 | 
  <hashar> | 
  manually rebasing puppet git on deployment-salt (stalled) | 
  [releng] | 
            
  | 14:27 | 
  <hashar> | 
  restarting deployment-salt / some process is 100% wa/IO | 
  [releng] | 
            
  | 13:38 | 
  <hashar> | 
  restarted integration puppetmaster (memory leak) | 
  [releng] | 
            
  | 13:35 | 
  <hashar> | 
  integration-puppetmaster apparently out of memory  | 
  [releng] | 
            
  | 13:30 | 
  <hashar> | 
  All Jenkins slaves are disconnected due to some ssh error. CI is down. | 
  [releng] |