| 2014-12-11
      
      § | 
    
  | 01:34 | <maxsem> | Finished scap: Noop, regenerating l18n cache for ZeroBanner (duration: 33m 57s) | [production] | 
            
  | 01:02 | <awight> | update crm from 3d657972029ea221b321470102c99ad74027b6f7 to 28b68e23b670fe52a401659bde800b64d05e25bf | [production] | 
            
  | 01:00 | <maxsem> | Started scap: Noop, regenerating l18n cache for ZeroBanner | [production] | 
            
  | 00:46 | <maxsem> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/179028/ (duration: 00m 05s) | [production] | 
            
  | 00:41 | <maxsem> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/178990/ (duration: 00m 05s) | [production] | 
            
  | 00:38 | <maxsem> | Synchronized php-1.25wmf11/extensions/WikimediaEvents/: (no message) (duration: 00m 06s) | [production] | 
            
  | 00:35 | <maxsem> | Synchronized php-1.25wmf11/resources/Resources.php: https://gerrit.wikimedia.org/r/#/c/179014/ (duration: 00m 06s) | [production] | 
            
  | 00:34 | <maxsem> | Synchronized php-1.25wmf11/extensions/Flow/: https://gerrit.wikimedia.org/r/#q,179018,n,z (duration: 00m 07s) | [production] | 
            
  | 00:33 | <maxsem> | Synchronized php-1.25wmf11/extensions/Flow/: https://gerrit.wikimedia.org/r/#q,179020,n,z (duration: 00m 07s) | [production] | 
            
  | 00:31 | <maxsem> | Synchronized php-1.25wmf12/extensions/WikimediaEvents/: https://gerrit.wikimedia.org/r/#q,179018,n,z (duration: 00m 05s) | [production] | 
            
  | 00:15 | <maxsem> | Synchronized php-1.25wmf11/extensions/MobileFrontend/: (no message) (duration: 00m 06s) | [production] | 
            
  | 00:13 | <maxsem> | Synchronized php-1.25wmf12/extensions/MobileFrontend/: (no message) (duration: 00m 08s) | [production] | 
            
  | 00:00 | <yurik> | Finished scap: ZeroBanner had some i18n changes, plus bits seems to be out of sync for it (duration: 20m 01s) | [production] | 
            
  
    | 2014-12-10
      
      § | 
    
  | 23:40 | <yurik> | Started scap: ZeroBanner had some i18n changes, plus bits seems to be out of sync for it | [production] | 
            
  | 23:19 | <yurik> | Synchronized php-1.25wmf12/extensions/ZeroPortal/: updatidng ZeroPortal to master (duration: 00m 06s) | [production] | 
            
  | 23:19 | <yurik> | Synchronized php-1.25wmf12/extensions/ZeroBanner/: updatidng ZeroBanner to master (duration: 00m 05s) | [production] | 
            
  | 23:14 | <yurik> | Synchronized php-1.25wmf11/extensions/ZeroBanner/: updatidng ZeroBanner to master (duration: 00m 06s) | [production] | 
            
  | 22:38 | <bd808> | Synchronized wmf-config/logging-labs.php: Beta monolog config (I76d9953) (duration: 00m 05s) | [production] | 
            
  | 21:20 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf12 | [production] | 
            
  | 21:16 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf11 | [production] | 
            
  | 21:15 | <Reedy> | manually ran scap-rebuild-cdbs on mw1176 | [production] | 
            
  | 21:10 | <reedy> | Finished scap: testwiki to 1.25wmf12 (duration: 43m 21s) | [production] | 
            
  | 21:07 | <Reedy> | got 21:05:27 sudo -u mwdeploy -n -- /srv/deployment/scap/scap/bin/scap-rebuild-cdbs on mw1176 returned [255]: Error reading response length from authentication socket. Permission denied (publickey). from mw1176 | [production] | 
            
  | 20:27 | <reedy> | Started scap: testwiki to 1.25wmf12 | [production] | 
            
  | 18:32 | <cmjohnson> | replacing disk slot 4 db1015 | [production] | 
            
  | 18:26 | <cmjohnson> | replacing disk 0 db1010 | [production] | 
            
  | 16:53 | <godog> | reinstalling graphite1001 as graphite1002 | [production] | 
            
  | 16:28 | <Coren> | authdns-update to merge in https://gerrit.wikimedia.org/r/178860 | [production] | 
            
  | 16:23 | <godog> | swapping sdm on ms-be2013 / ms-be2014 / ms-be2015 | [production] | 
            
  | 15:28 | <ottomata> | initiated replica election since analytics1021 timed out zk connection again (I had hoped we were done with this :( ) | [production] | 
            
  | 15:05 | <springle> | Synchronized wmf-config/db-eqiad.php: repool db1037, warm up (duration: 00m 09s) | [production] | 
            
  | 14:00 | <paravoid> | running dpkg --remove-architecture i386 (trusty); rm /etc/dpkg/dpkg.cfg.d/multiarch (precise) across the whole fleet with the exception of gallium/lanthanum | [production] | 
            
  | 11:46 | <_joe_> | cleaning and vacuuming the HHVM cache on a few hosts | [production] | 
            
  | 09:00 | <_joe_> | cleaning and vacuuming the hhvm repo on mw1030 | [production] | 
            
  | 08:38 | <ori> | Synchronized php-1.25wmf11/extensions/CommonsMetadata: (no message) (duration: 00m 07s) | [production] | 
            
  | 08:10 | <ori> | Synchronized php-1.25wmf11/extensions/CommonsMetadata/TemplateParser.php: Update CommonsMetadata for cherry-picks (duration: 00m 05s) | [production] | 
            
  | 07:49 | <springle> | Synchronized wmf-config/db-eqiad.php: repool db1007 (duration: 00m 05s) | [production] | 
            
  | 07:18 | <springle> | upgrade db1007 trusty | [production] | 
            
  | 05:19 | <springle> | s6 xtrabackup clone db1015 to db1037 | [production] | 
            
  | 05:09 | <springle> | Synchronized wmf-config/db-eqiad.php: depool db1037 (duration: 00m 06s) | [production] | 
            
  | 04:06 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed Dec 10 04:06:39 UTC 2014 (duration 6m 38s) | [production] | 
            
  | 02:26 | <LocalisationUpdate> | completed (1.25wmf11) at 2014-12-10 02:26:38+00:00 | [production] | 
            
  | 02:26 | <l10nupdate> | Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 02:19 | <LocalisationUpdate> | completed (1.25wmf10) at 2014-12-10 02:19:10+00:00 | [production] | 
            
  | 02:19 | <l10nupdate> | Synchronized php-1.25wmf10/cache/l10n: (no message) (duration: 00m 03s) | [production] | 
            
  | 01:59 | <ori> | manually ran /etc/cron.daily/logrotate on fluorine | [production] | 
            
  | 01:58 | <springle> | Synchronized wmf-config/db-eqiad.php: depool db1015 RT 9027 (duration: 00m 06s) | [production] | 
            
  | 01:46 | <awight> | update crm from d22dce0a375be3c5f32afc472fff550a5edf6a1e to 3d657972029ea221b321470102c99ad74027b6f7 | [production] | 
            
  | 01:31 | <springle> | Synchronized wmf-config/db-eqiad.php: repool db1039, warm up (duration: 00m 05s) | [production] | 
            
  | 01:12 | <ori> | Synchronized php-1.25wmf11/extensions/WikimediaEvents: Ie9ca5d3: Update WikimediaEvents for cherry-picks (duration: 00m 07s) | [production] |