| 2014-12-11
      
      § | 
    
  | 15:59 | <ottomata> | starting trusty upgrade of analytics1033 | [production] | 
            
  | 15:04 | <hashar> | @damons we love you! | [production] | 
            
  | 15:01 | <hashar> | saved Jenkins configuration via the web interface to reset the interface language from Chinese to English | [production] | 
            
  | 13:31 | <springle> | Synchronized wmf-config/db-eqiad.php: pool db1004 in s7, warm up (duration: 00m 06s) | [production] | 
            
  | 06:03 | <ori> | restarted apache on palladium and strontium | [production] | 
            
  | 04:08 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Dec 11 04:08:50 UTC 2014 (duration 8m 49s) | [production] | 
            
  | 04:08 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Dec 11 04:08:33 UTC 2014 (duration 30m 22s) | [production] | 
            
  | 03:34 | <ori> | Synchronized php-1.25wmf11/extensions/Math: Ic438b307a3b46: Fix for fatal caused by static call to MathRenderer::getError (duration: 00m 06s) | [production] | 
            
  | 02:57 | <Krinkle> | git-deploy: Deploying integration/mediawiki-tools-codesniffer I602cb6cfe910fc0a | [production] | 
            
  | 02:45 | <springle> | xtrabackup clone db1007 to db1004 | [production] | 
            
  | 02:12 | <LocalisationUpdate> | completed (1.25wmf12) at 2014-12-11 02:12:04+00:00 | [production] | 
            
  | 02:12 | <l10nupdate> | Synchronized php-1.25wmf12/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 02:10 | <springle> | Synchronized wmf-config/db-eqiad.php: repool db1015, warm up (duration: 00m 08s) | [production] | 
            
  | 02:09 | <LocalisationUpdate> | completed (1.25wmf12) at 2014-12-11 02:09:43+00:00 | [production] | 
            
  | 02:09 | <yurik> | Synchronized php-1.25wmf12/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 02:08 | <LocalisationUpdate> | completed (1.25wmf11) at 2014-12-11 02:08:34+00:00 | [production] | 
            
  | 02:08 | <l10nupdate> | Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 01:57 | <springle> | upgrade db1015 trusty | [production] | 
            
  | 01:56 | <LocalisationUpdate> | completed (1.25wmf11) at 2014-12-11 01:56:51+00:00 | [production] | 
            
  | 01:56 | <yurik> | Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 01:41 | <maxsem> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/179036 (duration: 00m 06s) | [production] | 
            
  | 01:38 | <csteipp> | redeploy core fixes for wmf12 | [production] | 
            
  | 01:34 | <maxsem> | Finished scap: Noop, regenerating l18n cache for ZeroBanner (duration: 33m 57s) | [production] | 
            
  | 01:02 | <awight> | update crm from 3d657972029ea221b321470102c99ad74027b6f7 to 28b68e23b670fe52a401659bde800b64d05e25bf | [production] | 
            
  | 01:00 | <maxsem> | Started scap: Noop, regenerating l18n cache for ZeroBanner | [production] | 
            
  | 00:46 | <maxsem> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/179028/ (duration: 00m 05s) | [production] | 
            
  | 00:41 | <maxsem> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/178990/ (duration: 00m 05s) | [production] | 
            
  | 00:38 | <maxsem> | Synchronized php-1.25wmf11/extensions/WikimediaEvents/: (no message) (duration: 00m 06s) | [production] | 
            
  | 00:35 | <maxsem> | Synchronized php-1.25wmf11/resources/Resources.php: https://gerrit.wikimedia.org/r/#/c/179014/ (duration: 00m 06s) | [production] | 
            
  | 00:34 | <maxsem> | Synchronized php-1.25wmf11/extensions/Flow/: https://gerrit.wikimedia.org/r/#q,179018,n,z (duration: 00m 07s) | [production] | 
            
  | 00:33 | <maxsem> | Synchronized php-1.25wmf11/extensions/Flow/: https://gerrit.wikimedia.org/r/#q,179020,n,z (duration: 00m 07s) | [production] | 
            
  | 00:31 | <maxsem> | Synchronized php-1.25wmf12/extensions/WikimediaEvents/: https://gerrit.wikimedia.org/r/#q,179018,n,z (duration: 00m 05s) | [production] | 
            
  | 00:15 | <maxsem> | Synchronized php-1.25wmf11/extensions/MobileFrontend/: (no message) (duration: 00m 06s) | [production] | 
            
  | 00:13 | <maxsem> | Synchronized php-1.25wmf12/extensions/MobileFrontend/: (no message) (duration: 00m 08s) | [production] | 
            
  | 00:00 | <yurik> | Finished scap: ZeroBanner had some i18n changes, plus bits seems to be out of sync for it (duration: 20m 01s) | [production] | 
            
  
    | 2014-12-10
      
      § | 
    
  | 23:40 | <yurik> | Started scap: ZeroBanner had some i18n changes, plus bits seems to be out of sync for it | [production] | 
            
  | 23:19 | <yurik> | Synchronized php-1.25wmf12/extensions/ZeroPortal/: updatidng ZeroPortal to master (duration: 00m 06s) | [production] | 
            
  | 23:19 | <yurik> | Synchronized php-1.25wmf12/extensions/ZeroBanner/: updatidng ZeroBanner to master (duration: 00m 05s) | [production] | 
            
  | 23:14 | <yurik> | Synchronized php-1.25wmf11/extensions/ZeroBanner/: updatidng ZeroBanner to master (duration: 00m 06s) | [production] | 
            
  | 22:38 | <bd808> | Synchronized wmf-config/logging-labs.php: Beta monolog config (I76d9953) (duration: 00m 05s) | [production] | 
            
  | 21:20 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf12 | [production] | 
            
  | 21:16 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf11 | [production] | 
            
  | 21:15 | <Reedy> | manually ran scap-rebuild-cdbs on mw1176 | [production] | 
            
  | 21:10 | <reedy> | Finished scap: testwiki to 1.25wmf12 (duration: 43m 21s) | [production] | 
            
  | 21:07 | <Reedy> | got 21:05:27 sudo -u mwdeploy -n -- /srv/deployment/scap/scap/bin/scap-rebuild-cdbs on mw1176 returned [255]: Error reading response length from authentication socket. Permission denied (publickey). from mw1176 | [production] | 
            
  | 20:27 | <reedy> | Started scap: testwiki to 1.25wmf12 | [production] | 
            
  | 18:32 | <cmjohnson> | replacing disk slot 4 db1015 | [production] | 
            
  | 18:26 | <cmjohnson> | replacing disk 0 db1010 | [production] | 
            
  | 16:53 | <godog> | reinstalling graphite1001 as graphite1002 | [production] | 
            
  | 16:28 | <Coren> | authdns-update to merge in https://gerrit.wikimedia.org/r/178860 | [production] |