| 2018-04-20
      
      § | 
    
  | 21:32 | <eddiegp> | deployment-kafka04: full disk, deleted /var/log/syslog.1 (3G) to make interactive sessions work again | [releng] | 
            
  | 17:30 | <thcipriani> | rebase integration-puppetmaster01:/var/lib/puppet/git conflicting on https://gerrit.wikimedia.org/r/#/c/348236/ | [releng] | 
            
  | 08:38 | <hashar> | Cleaned integration-slave-docker-1005  disk (deleting workspace and all docker images) | [releng] | 
            
  | 08:27 | <hashar> | Created integration-slave-docker-1016 and integration-slave-docker-1017 (2G RAM / 2 executors ) | [releng] | 
            
  | 08:26 | <hashar> | replaced integration-slave-docker-1010 and integration-slave-docker-1011 with bigger instances (4GB RAM) | [releng] | 
            
  | 07:03 | <hashar> | Replaced integration-slave-docker-1001 to get 4GB of RAM | [releng] | 
            
  | 00:46 | <awight> | roll back ORES beta to master | [releng] | 
            
  | 00:08 | <awight> | Push ORES git-lfs to look at stuff | [releng] | 
            
  
    | 2018-04-19
      
      § | 
    
  | 21:23 | <hashar> | Pooling in the new integration-slave-docker-1002 and integration-slave-docker-1003 | [releng] | 
            
  | 21:08 | <hashar> | rebuilding integration-slave-docker-1002 and integration-slave-docker-1003 ci1.medium > m1.medium (+2G RAM) | [releng] | 
            
  | 21:01 | <hashar> | Bringing back quibble (0.0.9), this time with COMPOSER_PROCESS_TIMEOUT=600 | T192576 | [releng] | 
            
  | 19:22 | <hashar> | integration-slave-docker-1004 : wiping all jenkins workspace and all docker images | [releng] | 
            
  | 18:00 | <thcipriani> | cleared a bunch of old docker images from integration-slave-docker-1004, freed 4.4GB of space | [releng] | 
            
  | 17:43 | <thcipriani> | Reloading Zuul to deploy https://gerrit.wikimedia.org/r/#/c/427717/ | [releng] | 
            
  | 10:34 | <Hauskatze> | fixStuckGlobalRename.php ran to unblock rename jobs never arriving to jobqueue | [releng] | 
            
  | 09:41 | <hashar> | building releng/quibble-stretch:0.0.8-2 | [releng] | 
            
  | 08:19 | <eddiegp> | eddie@deployment-tin:~$ for wiki in deploymentwiki enwiki enwikinews loginwiki metawiki simplewiki; do mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=$wiki --logwiki=loginwiki 'Samtar' "There'sNoTime"; done T192476 | [releng] | 
            
  
    | 2018-04-18
      
      § | 
    
  | 22:53 | <eddiegp> | started nutcracker on deployment-jobrunner03 | [releng] | 
            
  | 22:53 | <eddiegp> | root@deployment-jobrunner03:/var/run# mkdir nutcracker && chown nutcracker.nutcracker nutcracker ref T178457 | [releng] | 
            
  | 21:16 | <Hauskatze> | (addition to previous message) Cmd ran on deployment-jobrunner03; zillions of messages complaining nutcracker was down | [releng] | 
            
  | 21:15 | <Hauskatze> | Ran sudo puppet agent -tv to restart nutcracker, which was "Notice: /Stage[main]/Nutcracker/Service[nutcracker]/ensure: ensure changed 'stopped' to 'running'" | [releng] | 
            
  | 20:32 | <hashar> | reloaded zuul for https://gerrit.wikimedia.org/r/427534 | [releng] | 
            
  | 20:29 | <Reedy> | reloaded zuul for 427469 | [releng] | 
            
  | 20:11 | <mdholloway> | deployed to BC: [mobileapps/deploy@9328a7d]: Update mobileapps to fb161d7 | [releng] | 
            
  | 18:03 | <hauskatze> | maurelio@deployment-tin:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=wikidatawiki --logwiki=loginwiki 'Artix Kreiger 2' 'Artix Krieger 2' - T192471 | [releng] | 
            
  | 17:34 | <legoktm> | deployed https://gerrit.wikimedia.org/r/427421 https://gerrit.wikimedia.org/r/427422 https://gerrit.wikimedia.org/r/427423 a while back | [releng] | 
            
  | 13:23 | <addshore> | added Thiemo Kreuz (WMDE) to deployment-prep | [releng] | 
            
  | 13:18 | <addshore> | added WMDE-Fisch to deployment-prep | [releng] | 
            
  | 09:41 | <hashar> | Triggered https://integration.wikimedia.org/ci/job/quibble-integration/ for REL1_31 | [releng] | 
            
  | 09:40 | <hashar> | Buiding quibble jobs with (master, mysql, php5.5) https://integration.wikimedia.org/ci/job/quibble-integration/7/  T192432 | [releng] | 
            
  | 07:17 | <legoktm> | deploying https://gerrit.wikimedia.org/r/426115 | [releng] | 
            
  | 04:52 | <legoktm> | live hacked /etc/nodepool/wikimedia, trying some things to get rid of mod_php5 | [releng] | 
            
  | 04:26 | <legoktm> | try once more to refresh nodepool snapshot | [releng] | 
            
  | 03:22 | <legoktm> | manually refreshing nodepool ci-jessie image for https://gerrit.wikimedia.org/r/427309 | [releng] | 
            
  
    | 2018-04-17
      
      § | 
    
  | 23:40 | <Krinkle> | Rebuilding Nodepool snapshot for https://gerrit.wikimedia.org/r/415312 | [releng] | 
            
  | 21:10 | <hasharAway> | Running https://integration.wikimedia.org/ci/job/quibble-integration/6/ overnight | [releng] | 
            
  | 20:28 | <hasharAway> | building releng/quibble.*:0.0.8 images | [releng] | 
            
  | 18:16 | <Krinkle> | Deleted performance-webpagetest-wmf job (removed from config.git) | [releng] | 
            
  | 14:32 | <hashar> | Added integration-slave-docker-1008 and integration-slave-docker-1009  (m4executor label) | [releng] | 
            
  | 13:33 | <moritzm> | removed role::mediawiki::imagescaler from deployment-mediawiki05, per watroles the only  use of that role in WMCS | [releng] | 
            
  | 13:32 | <moritzm> | removed role::mediawiki::imagescaler from deployment-prep, per watroles the only  use of that role in WMCS | [releng] | 
            
  | 02:41 | <Krinkle> | Fix Jenkins config for console section "Composer" end pattern (rm mandatory .+ match from end) | [releng] |