| 
      
        2016-09-07
      
      §
     | 
  
    
  | 20:35 | 
  <hashar> | 
  Updated security group for deployment-prep labs project.  Allow ssh port 22 from contint1001.wikimedia.org (matching rules for gallium). T137323 | 
  [releng] | 
            
  | 20:30 | 
  <hashar> | 
  Updated security group for contintcloud and integration labs project.  Allow ssh port 22 from contint1001.wikimedia.org (matching rules for gallium). T137323 | 
  [releng] | 
            
  | 20:14 | 
  <matt_flaschen> | 
  Temporarily disabled https://integration.wikimedia.org/ci/view/Beta/job/beta-scap-eqiad/ to test live revert of aa0f6ea | 
  [releng] | 
            
  | 16:09 | 
  <hashar> | 
  Nodepool back in action. Had to manually delete some instances in labs  | 
  [releng] | 
            
  | 15:58 | 
  <hashar> | 
  Restarting Nodepool . Lost state when labnet got moved T144945 | 
  [releng] | 
            
  | 13:13 | 
  <hashar> | 
  Image ci-jessie-wikimedia-1473253681 in wmflabs-eqiad is ready  , has php7 packages. T144872 | 
  [releng] | 
            
  | 11:53 | 
  <hashar> | 
  Force refreshing Nodepool jessie snapshot to get PHP7 included T144872 | 
  [releng] | 
            
  | 11:03 | 
  <hashar> | 
  integration: cherry pick https://gerrit.wikimedia.org/r/#/c/308955/ "contint: prefer our bin/php alternative"  T144872 | 
  [releng] | 
            
  | 10:55 | 
  <hashar> | 
  integration: dropped PHP7 cherry pick from puppet master. https://gerrit.wikimedia.org/r/#/c/308918/ has been merged.   Pushing it to the fleet of permanent Jessie slaves. T144872 | 
  [releng] | 
            
  | 10:37 | 
  <hashar> | 
  beta: cleaning up salt-keys on deployment-salt02 . Bunch of instances got deleted | 
  [releng] | 
            
  | 09:41 | 
  <hashar> | 
  Moving rake jobs back to Nodepool ( T143938 ) with https://gerrit.wikimedia.org/r/#/c/306723/ and https://gerrit.wikimedia.org/r/#/c/306724/ | 
  [releng] | 
            
  | 05:57 | 
  <legoktm> | 
  deploying https://gerrit.wikimedia.org/r/308932 https://gerrit.wikimedia.org/r/299697 | 
  [releng] | 
            
  | 05:25 | 
  <legoktm> | 
  cherry-picked https://gerrit.wikimedia.org/r/#/c/308918/ onto integration-puppetmaster with a hack that has it only apply to integration-slave-jessie-1005 | 
  [releng] | 
            
  | 04:59 | 
  <legoktm> | 
  added Krenair to integration project to help debug puppet stuff | 
  [releng] | 
            
  | 04:35 | 
  <legoktm> | 
  depooled integration-slave-jessie-1005 in jenkins so I can test puppet stuff on it | 
  [releng] | 
            
  
    | 
      
        2016-08-31
      
      §
     | 
  
    
  | 23:40 | 
  <bd808> | 
  forced puppet run on deployment-salt02. Had not run automatically for 8 hours | 
  [releng] | 
            
  | 23:36 | 
  <bd808> | 
  Deleted /data/scratch on integration-slave-trusty-1016 to fix puppet | 
  [releng] | 
            
  | 23:32 | 
  <bd808> | 
  Deleted /data/scratch on integration-slave-trusty-1013 to fix puppet | 
  [releng] | 
            
  | 23:22 | 
  <bd808> | 
  Deleted /data/scratch on integration-slave-trusty-1012 to fix puppet | 
  [releng] | 
            
  | 23:19 | 
  <bd808> | 
  Deleted /data/scratch on integration-slave-trusty-1011 to fix puppet | 
  [releng] | 
            
  | 23:15 | 
  <bd808> | 
  Deleted /data/scratch on integration-slave-precise-1012 to fix puppet | 
  [releng] | 
            
  | 23:11 | 
  <bd808> | 
  Deleted /data on integration-slave-precise-1011 to fix puppet | 
  [releng] | 
            
  | 23:08 | 
  <bd808> | 
  Deleted /data on integration-slave-jessie-1001 to fix puppet | 
  [releng] | 
            
  | 23:04 | 
  <bd808> | 
  Deleted empty /data, /data/project, and /data/scratch on integration-puppetmaster to fix puppet | 
  [releng] | 
            
  | 22:59 | 
  <bd808> | 
  Deleted empty /data, /data/project, and /data/scratch on integration-publisher to fix puppet | 
  [releng] | 
            
  | 01:44 | 
  <Krinkle> | 
  Reloading Zuul to deploy  https://gerrit.wikimedia.org/r/307670  | 
  [releng] | 
            
  
    | 
      
        2016-08-30
      
      §
     | 
  
    
  | 23:31 | 
  <yuvipanda> | 
  cherry-picking https://gerrit.wikimedia.org/r/#/c/307656/ fixed puppet on the elasticsearch machines! | 
  [releng] | 
            
  | 23:20 | 
  <Krenair> | 
  removed 'project_id' key from deployment-restbase02's metadata to fix compatibility with the new labsprojectfrommetadata code | 
  [releng] | 
            
  | 22:29 | 
  <yuvipanda> | 
  in lieu of blood sacrifice, restart puppetmaster on deployment-pupetmaster | 
  [releng] | 
            
  | 21:43 | 
  <yuvipanda> | 
  use clush to fix puppet.conf of all clients, realize also accidentally set a client's puppet.conf for the server, recover server's old conf file from a cat in shell history, restore, breathe sigh of relief | 
  [releng] | 
            
  | 21:37 | 
  <yuvipanda> | 
  sudo takes like 15s each time, is there no god? | 
  [releng] | 
            
  | 21:36 | 
  <yuvipanda> | 
  managed to get vim into a state where I can not quit it, probably recording a macro. I hate computers | 
  [releng] | 
            
  | 21:16 | 
  <yuvipanda> | 
  deployment-pdf01 fixed manually | 
  [releng] |