| 2017-02-07
      
      § | 
    
  | 11:37 | <elukey> | restarting hhvm on mw1226 (hhvm dump debug in /tmp/hhvm.33183.bt.) | [production] | 
            
  | 11:32 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1036 (duration: 00m 40s) | [production] | 
            
  | 11:27 | <moritzm> | installing libgd security updates | [production] | 
            
  | 11:13 | <moritzm> | installing libpng security updates | [production] | 
            
  | 10:34 | <jynus> | preparing db2046 for reimage T152188 | [production] | 
            
  | 10:02 | <_joe_> | uploaded etcd-mirror 0.0.1 to jessie-wikimedia (T156009) | [production] | 
            
  | 09:48 | <moritzm> | installing cairo security updates | [production] | 
            
  | 09:46 | <elukey> | stopped and masked cassandra-{a,b} - T157425 | [production] | 
            
  | 08:40 | <marostegui> | Transferring commonswiki tables from db1064 to db1095 - T153743 | [production] | 
            
  | 07:31 | <elukey> | added "> /dev/null" manually to the carbon's root crontab (rsync job) to avoid cronspam. The change was already merged in https://gerrit.wikimedia.org/r/#/c/336218 but puppet is disabled on carbon. | [production] | 
            
  | 07:08 | <marostegui> | Transferring commonswiki tables from db1064 to labsdb1009 - T153743 | [production] | 
            
  | 07:06 | <marostegui> | Importing commonswiki tables on labsdb1010 - T153743 | [production] | 
            
  | 06:58 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1072 - T156226 (duration: 00m 50s) | [production] | 
            
  | 05:41 | <volans> | ms-be1012 running out of space on /, manually compressed /var/log/swift/server.log.1 and cleaned up apt cache T157237 | [production] | 
            
  | 02:37 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Tue Feb  7 02:37:35 UTC 2017 (duration 5m 16s) | [production] | 
            
  | 02:35 | <cwd> | imported triggers into staging civi | [production] | 
            
  | 02:32 | <l10nupdate@tin> | scap sync-l10n completed (1.29.0-wmf.10) (duration: 13m 23s) | [production] | 
            
  | 01:31 | <mutante> | prometheus1004 - installed OS, signing puppet cert, initial run.. (T152504) | [production] | 
            
  | 00:49 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Fix $wmgVisualEditorAvailableNamespaces code style ([[Gerrit:336346]]) (no-op) (duration: 00m 40s) | [production] | 
            
  | 00:31 | <mutante> | install1001 - re-enabled puppet, start DHCP service | [production] | 
            
  | 00:26 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Show again svwiki logo between 1.5x and 2x zoom (T157387) (duration: 00m 40s) | [production] | 
            
  
    | 2017-02-06
      
      § | 
    
  | 23:45 | <mutante> | prometheus1003 - installed OS, signing puppet cert, initial run (T152504) | [production] | 
            
  | 22:57 | <Krinkle> | Purged https://en.wikipedia.org/static/apple-touch/wikipedia.png (mwscript purgeList.php) for T152538 | [production] | 
            
  | 21:39 | <bsitzmann@tin> | Finished deploy [mobileapps/deploy@9b42448]: Update mobileapps to 034a391 (duration: 03m 59s) | [production] | 
            
  | 21:37 | <otto@tin> | Finished deploy [eventstreams/deploy@c938a57]: (no justification provided) (duration: 01m 47s) | [production] | 
            
  | 21:35 | <otto@tin> | Started deploy [eventstreams/deploy@c938a57]: (no justification provided) | [production] | 
            
  | 21:35 | <bsitzmann@tin> | Started deploy [mobileapps/deploy@9b42448]: Update mobileapps to 034a391 | [production] | 
            
  | 20:49 | <mutante> | cp3011 thru cp3022 - shutdown / poweroff  (T130883) | [production] | 
            
  | 20:39 | <tgr@tin> | Synchronized php-1.29.0-wmf.10/extensions/JsonConfig/includes/JCUtils.php: T155532: Update JsonConfig login API call (duration: 01m 00s) | [production] | 
            
  | 20:27 | <mutante> | cp3011 thru cp3022 - revoke puppet certs, puppet node deactivate (T130883) | [production] | 
            
  | 19:37 | <jynus> | restarting db2060 after kernel upgrade | [production] | 
            
  | 19:30 | <ebernhardson@tin> | Synchronized wmf-config/InitialiseSettings.php: Second half of changing project logo for hi.wikibooks.org (duration: 00m 39s) | [production] | 
            
  | 19:29 | <ebernhardson@tin> | Synchronized static/images/project-logos/hiwikibooks.png: First part of Changing project logo for hi.wikibooks.org (duration: 00m 39s) | [production] | 
            
  | 19:25 | <ebernhardson> | re-pulled 336242 to mwdebug1002 | [production] | 
            
  | 19:16 | <ebernhardson> | pulled 336242 to mwdebug1002 | [production] | 
            
  | 19:13 | <jynus> | preparing to reimage db2045 T152188 | [production] | 
            
  | 19:10 | <ebernhardson@tin> | Synchronized wmf-config/InitialiseSettings.php: Configure A/B test for CrossProject search results sidebar (duration: 00m 49s) | [production] | 
            
  | 19:08 | <ebernhardson> | pulled 334673 to mwdebug1002 | [production] | 
            
  | 18:16 | <jynus> | preparing to reimage db2050 T152188 | [production] | 
            
  | 18:06 | <marostegui> | Start to transfer commonswiki ibd and cfg from db1064 to labsdb1010 -  https://phabricator.wikimedia.org/T153743 | [production] | 
            
  | 17:41 | <mobrovac> | restbase end deploy of ea980cc5 | [production] | 
            
  | 17:10 | <mobrovac> | restbase start deploy of ea980cc5 | [production] | 
            
  | 17:03 | <hashar> | Nodepool/CI back up | [production] | 
            
  | 16:51 | <marostegui> | Stop MySQL and shutdown db1072 for raid and BBU replacement - T156226 | [production] | 
            
  | 16:51 | <marostegui> | Stop MySQL and shutdown db1072 for raid | [production] | 
            
  | 16:35 | <hashar> | Nodepool Jessie images are back up.  Trusty one is being rebuild.. | [production] | 
            
  | 15:55 | <elukey> | mc2029 shutdown for DC ops | [production] | 
            
  | 15:46 | <hashar> | Stopping Nodepool for maintenance | [production] | 
            
  | 15:42 | <oblivian@tin> | Finished deploy [changeprop/deploy@5f932a3]: Revert ORES throttling (duration: 03m 49s) | [production] | 
            
  | 15:39 | <oblivian@tin> | Started deploy [changeprop/deploy@5f932a3]: Revert ORES throttling | [production] |