| 2013-01-29
      
      § | 
    
  | 14:14 | <mark> | powercycled sodium | [production] | 
            
  | 08:20 | <pgehres> | synchronized php-1.21wmf8/extensions/CentralNotice/  'Updating CentralNotice to master' | [production] | 
            
  | 04:58 | <tstarling> | synchronized php-1.21wmf6/cache/trusted-xff.cdb | [production] | 
            
  | 04:57 | <tstarling> | synchronized php-1.21wmf7/cache/trusted-xff.cdb | [production] | 
            
  | 04:53 | <tstarling> | synchronized php-1.21wmf8/cache/trusted-xff.cdb | [production] | 
            
  | 04:51 | <tstarling> | synchronized php-1.21wmf8/cache/trusted-xff.cdb | [production] | 
            
  | 04:47 | <tstarling> | synchronized php-1.21wmf8/cache/trusted-xff.cdb | [production] | 
            
  | 04:36 | <tstarling> | synchronized php-1.21wmf8/cache/trusted-xff.cdb  'fixing corrupted CDB file' | [production] | 
            
  | 04:36 | <tstarling> | synchronized php-1.21wmf7/cache/trusted-xff.cdb  'fixing corrupted CDB file' | [production] | 
            
  | 02:55 | <LocalisationUpdate> | completed (1.21wmf7) at Tue Jan 29 02:55:44 UTC 2013 | [production] | 
            
  | 02:30 | <LocalisationUpdate> | completed (1.21wmf8) at Tue Jan 29 02:30:42 UTC 2013 | [production] | 
            
  | 02:17 | <Ryan_Lane> | deleting sysadmin and netadmin roles from ldap | [production] | 
            
  | 01:55 | <Ryan_Lane> | adding ldap entries for combined sysadmin/netadmin role, projectadmin | [production] | 
            
  | 01:29 | <K4-713> | updated payments cluster to ec4d3f24862559 | [production] | 
            
  | 00:44 | <RobH> | typo, knsq18 | [production] | 
            
  | 00:44 | <RobH> | squid backend on knsq48 rebuilding | [production] | 
            
  | 00:36 | <RobH> | crazy memory and cpu spike on knsq18 for no apparent reason, restarting process (memory leak?) | [production] | 
            
  
    | 2013-01-28
      
      § | 
    
  | 23:27 | <K4-713> | synchronized payments cluster to 1948266b33e905b | [production] | 
            
  | 22:40 | <pgehres> | synchronized wmf-config/CommonSettings.php  'Enabling CN:Translate on testwiki' | [production] | 
            
  | 22:37 | <hashar> | jenkins: applied pep8 and pyflakes jobs to sartoris repository. | [production] | 
            
  | 22:35 | <pgehres> | Finished syncing Wikimedia installation... : Dark deploying Translate integration with CentralNotice | [production] | 
            
  | 22:20 | <pgehres> | Started syncing Wikimedia installation... : Dark deploying Translate integration with CentralNotice | [production] | 
            
  | 21:26 | <pgehres> | synchronized php-1.21wmf8/extensions/LandingCheck  'Updating LandingCheck to master' | [production] | 
            
  | 20:42 | <LeslieCarr> | cleared a lot of 0 size badly named logs on flourine:/a/mw-log | [production] | 
            
  | 20:41 | <sbernardin1> | taking down osm-web1 for h/w installation | [production] | 
            
  | 19:25 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 19:09 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: enwiki to 1.21wmf8 | [production] | 
            
  | 19:05 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 18:31 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 18:08 | <paravoid> | upgrading ffmpeg/libav for USN-1705-1/USN-1706-1 on all image/video scalers in eqiad/pmtpa | [production] | 
            
  | 18:00 | <sbernardin1> | shutting down ms-be11 for h/w replacement | [production] | 
            
  | 15:29 | <paravoid> | upgraded & rebooting emery, 208 days bug | [production] | 
            
  | 15:06 | <mark> | Pooled cp3009 and cp3010 in the esams upload pool | [production] | 
            
  | 02:52 | <LocalisationUpdate> | completed (1.21wmf7) at Mon Jan 28 02:52:53 UTC 2013 | [production] | 
            
  | 02:30 | <LocalisationUpdate> | completed (1.21wmf8) at Mon Jan 28 02:29:55 UTC 2013 | [production] | 
            
  
    | 2013-01-27
      
      § | 
    
  | 23:50 | <reedy> | synchronized php-1.21wmf7/extensions/CentralAuth/ | [production] | 
            
  | 23:24 | <reedy> | synchronized php-1.21wmf8/extensions/CentralAuth/ | [production] | 
            
  | 23:11 | <drdee> | enabled sampling on Thank_You_Main and a country filter on Emery | [production] | 
            
  | 07:16 | <aaron> | synchronized php-1.21wmf8/maintenance/nextJobDB.php  'deployed f0f869dfabc1cedcedd5df972fbe6c279789a498 ' | [production] | 
            
  | 04:48 | <aaron> | synchronized php-1.21wmf8/maintenance/nextJobDB.php  'removed live hack' | [production] | 
            
  | 04:47 | <aaron> | synchronized php-1.21wmf8/maintenance/runJobs.php | [production] | 
            
  | 02:55 | <aaron> | synchronized php-1.21wmf8/maintenance/runJobs.php | [production] | 
            
  | 02:51 | <LocalisationUpdate> | completed (1.21wmf7) at Sun Jan 27 02:51:05 UTC 2013 | [production] | 
            
  | 02:48 | <aaron> | synchronized php-1.21wmf8/maintenance/nextJobDB.php  'quick debugging' | [production] | 
            
  | 02:27 | <LocalisationUpdate> | completed (1.21wmf8) at Sun Jan 27 02:26:57 UTC 2013 | [production] | 
            
  | 01:31 | <aaron> | synchronized php-1.21wmf8/maintenance/nextJobDB.php  'deployed 93869b8d37b6b7999190b378cb6813f6317b0b10' | [production] | 
            
  | 01:02 | <LeslieCarr> | rpd core caused bgp to restart (even though it wasn't supposed to) - causing routing churn | [production] | 
            
  | 00:55 | <LeslieCarr> | core dumping cr1-sdtpa - 1% chance of minor network issue | [production] |