| 2013-01-03
      
      § | 
    
  | 21:30 | <RobH> | reinstalling tarin to internal ip for secondary poolcounter server in tampa | [production] | 
            
  | 21:13 | <paravoid> | powercycling cp1026, load spike, unresponsive | [production] | 
            
  | 20:38 | <reedy> | synchronized php-1.21wmf7/cache/interwiki.cdb  'Updating interwiki cache' | [production] | 
            
  | 20:38 | <reedy> | synchronized php-1.21wmf6/cache/interwiki.cdb  'Updating interwiki cache' | [production] | 
            
  | 20:02 | <RobH> | authdns-update for iodine | [production] | 
            
  | 20:01 | <bsitu> | synchronized wmf-config/InitialiseSettings.php  'Enable email batch for Echo' | [production] | 
            
  | 19:49 | <notpeter> | temp stopping puppet on brewster | [production] | 
            
  | 19:19 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: and aswikisource back again | [production] | 
            
  | 19:18 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: remove aswikisource temporarily | [production] | 
            
  | 19:16 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 19:13 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 19:12 | <LeslieCarr> | restarting puppetmasterd on stafford | [production] | 
            
  | 19:04 | <reedy> | synchronized php-1.21wmf7/extensions/WikimediaMaintenance/ | [production] | 
            
  | 18:59 | <reedy> | synchronized wmf-config/db.php | [production] | 
            
  | 18:54 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 18:53 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 18:51 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 18:49 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 18:47 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 18:35 | <mutante> | restarting nagios on spence | [production] | 
            
  | 18:34 | <reedy> | synchronized php-1.21wmf6/extensions/WikimediaMaintenance/ | [production] | 
            
  | 18:05 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 02:46 | <LocalisationUpdate> | completed (1.21wmf7) at Thu Jan  3 02:46:37 UTC 2013 | [production] | 
            
  | 02:26 | <LocalisationUpdate> | completed (1.21wmf6) at Thu Jan  3 02:26:45 UTC 2013 | [production] | 
            
  | 01:02 | <binasher> | restarting all bits varnish instances with a 180s stagger between each (applying shm_reclen change) | [production] | 
            
  | 01:01 | <RobH> | dns update to move tarin to internal ip | [production] | 
            
  | 00:54 | <RobH> | poolcounter test shows numbers rising on ersch | [production] | 
            
  | 00:54 | <robh> | synchronized wmf-config/PoolCounterSettings.php | [production] | 
            
  | 00:32 | <olivneh> | synchronized php-1.21wmf6/extensions/EventLogging/includes/JsonSchemaHooks.php | [production] | 
            
  
    | 2013-01-02
      
      § | 
    
  | 23:20 | <maxsem> | synchronized php-1.21wmf7/extensions/MobileFrontend  'Revert MobileFrontend to the same revision as 1.21wmf6' | [production] | 
            
  | 22:20 | <paravoid> | starting nginx on ssl3003 | [production] | 
            
  | 22:13 | <paravoid> | deploying squid config for Accept-Language/X-Carrier, RT 2745 & 3158 | [production] | 
            
  | 22:03 | <paravoid> | downgrading squid from 3.1 to 2.7 on fenari | [production] | 
            
  | 22:03 | <paravoid> | reprepro copysrc precise-wikimedia lucid-wikimedia squid | [production] | 
            
  | 21:39 | <Ryan_Lane> | powercycled ssl3001 | [production] | 
            
  | 21:34 | <paravoid> | starting nginx on ssl3002 | [production] | 
            
  | 20:33 | <Reedy> | Modified user_groups.ug_group to varbinary(255) | [production] | 
            
  | 20:29 | <Reedy> | Modified user_former_groups.ufg_group to varbinary(255) | [production] | 
            
  | 20:24 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikidatawiki back to 1.21wmf6 | [production] | 
            
  | 20:03 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: test2wiki, wikidatawiki and mediawikiwiki to 1.21wmf7 | [production] | 
            
  | 19:53 | <reedy> | synchronized php-1.21wmf7/extensions/ | [production] | 
            
  | 19:48 | <aaron> | synchronized php-1.21wmf7/extensions/ConfirmEdit  'deployed 8fddb4a805ee3e79ef07ef3ca78a7ae7df5f4bba' | [production] | 
            
  | 19:26 | <Ryan_Lane> | make that labs. | [production] | 
            
  | 19:26 | <Ryan_Lane> | changing novaadmin password in labvs | [production] | 
            
  | 19:21 | <reedy> | Finished syncing Wikimedia installation... : Rebuild message cache for 1.21wmf7 | [production] | 
            
  | 18:26 | <reedy> | Started syncing Wikimedia installation... : Rebuild message cache for 1.21wmf7 | [production] | 
            
  | 18:23 | <aaron> | synchronized php-1.21wmf6/extensions/ConfirmEdit  'deployed 74c5543fead84a8460be51ffa0b16104cfc3abd1' | [production] | 
            
  | 18:17 | <Reedy> | Running sync-common on srv191 | [production] | 
            
  | 18:16 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki to 1.21wmf7 before rebuilding message cache | [production] | 
            
  | 18:14 | <reedy> | synchronized live-1.5/ | [production] |