| 
      
        2018-11-20
      
      §
     | 
  
    
  | 23:45 | 
  <mutante> | 
  deployment-deploy01 edited /srv/deployment/iegreview/iegreview/.git/DEPLOY_HEAD - - replaced deployment-tin with deployment-deploy1 to fix scap cloning / puppet | 
  [releng] | 
            
  | 23:01 | 
  <mutante> | 
  deployment-deploy01 edited /srv/deployment/scholarships/scholarships/.git - replaced deployment-tin with deployment-deploy1 to fix scap / cloning of scholarships app | 
  [releng] | 
            
  | 22:42 | 
  <thcipriani> | 
  repooling integration-slave-jessie-1003 after cleaning mvn and gradle cache | 
  [releng] | 
            
  | 20:23 | 
  <Krenair> | 
  Changed deployment-prep mysql repl password in attempt to get replication working again, have stored it at deployment-puppetmaster03:/var/lib/git/labs/private/modules/secret/secrets/mysql/repl_password | 
  [releng] | 
            
  | 18:18 | 
  <mdholloway> | 
  deployment-mcs01 deployed [mobileapps/deploy@7553087] | 
  [releng] | 
            
  | 14:59 | 
  <hashar> | 
  created integration-castor03.integration.eqiad.wmflabs intended as a replacement for castor02 | T208803 | 
  [releng] | 
            
  | 14:34 | 
  <hashar> | 
  beta-scap job fixed by deleting a file on deployment-mediawiki-07 | 
  [releng] | 
            
  | 14:27 | 
  <hashar> | 
  deployment-mediawiki-07 :  sudo rm -fR /srv/mediawiki/.~tmp~/ | 
  [releng] | 
            
  | 13:55 | 
  <andrewbogott> | 
  deleting deployment-redis05 and deployment-redis06 as per Giuseppe, "we're not using the old jobqueue, we should remove those vms" | 
  [releng] | 
            
  | 13:08 | 
  <twentyafterfour> | 
  removed local unix user mwdeploy from deployment-mediawiki-07 because it was shadowing the real mwdeploy user in ldap | 
  [releng] | 
            
  | 13:01 | 
  <twentyafterfour> | 
  PHP Startup: Unable to load dynamic library '/usr/lib/php/20151012/luasandbox.so' - /usr/lib/php/20151012/luasandbox.so: cannot open shared object file: No such file or directory T208101 | 
  [releng] | 
            
  | 12:11 | 
  <twentyafterfour> | 
  scap failures on deployment-mediawiki-07 are related to uid/gid mismatch of the mwdeploy user, specifically the owner of that user's home dir is uid 603 but /etc/passwd|group have a different uid/gid for the same username. T208101 | 
  [releng] | 
            
  | 11:47 | 
  <hashar> | 
  Armed keyholder on deployment-deploy01 Got shutdown while being migrated a new cloud region # T208101 | 
  [releng] | 
            
  | 11:00 | 
  <hashar> | 
  deployment-deploy01 got migrated to a new region but the Jenkins configuration had not been updated. Adjusting IP address from 10.68.23.38 to 172.16.4.18 | T208101 | 
  [releng] | 
            
  | 10:58 | 
  <hashar> | 
  Clearing out deployment-deploy01 disk space. Went offline due to disk space consumption | 
  [releng] | 
            
  | 10:04 | 
  <Krenair> | 
  manually fixed deployment-mediawiki-09:/srv/mediawiki/wmf-config/db-labs.php to match deployment copy, not sure why it didn't deploy properly yet | 
  [releng] | 
            
  
    | 
      
        2018-11-19
      
      §
     | 
  
    
  | 22:40 | 
  <Krenair> | 
  manually sorted certs for deployment-puppetdb02 | 
  [releng] | 
            
  | 22:23 | 
  <Krenair> | 
  duplicated wiki(user|admin) mysql users on deployment-db0[34] - previous hosts 10.%, new hosts 172.16.% | 
  [releng] | 
            
  | 18:32 | 
  <Krenair> | 
  creating deployment-cache-text05 to replace deployment-cache-text04 | 
  [releng] | 
            
  | 15:53 | 
  <Amir1> | 
  cherry-picking gerrit:474694/1 in beta puppetmaster | 
  [releng] | 
            
  | 15:06 | 
  <Amir1> | 
  ores:e957b24 is going beta | 
  [releng] | 
            
  | 13:47 | 
  <hashar> | 
  Shutdown integration-publishing , replaced by integration-publishing02 # T208803 | 
  [releng] | 
            
  | 13:21 | 
  <hashar> | 
  Created integration-publishing02 172.16.4.5 for WMCS region migration # T208803 | 
  [releng] | 
            
  | 11:13 | 
  <hashar> | 
  updating jobs  wikidata-query-rdf-maven-java8-docker wikidata-query-rdf-maven-java8-docker-site-publish for https://gerrit.wikimedia.org/r/#/c/integration/config/+/474660/ | 
  [releng] | 
            
  | 10:23 | 
  <gehel> | 
  Updating docker-pkg files on contint1001 for wikdiata-query-rdf image | 
  [releng] |