| 2012-08-23
      
      § | 
    
  | 23:56 | <kaldari> | synchronized php-1.20wmf10/extensions/UploadWizard | [production] | 
            
  | 23:49 | <K4-713> | updated paypal IPN to [[rev:2028|r2028]] | [production] | 
            
  | 22:40 | <maplebed> | putting ms-fe3 and 4 into rotation running swift v1.5.0-3 | [production] | 
            
  | 22:40 | <K4-713> | updated production civicrm to [[rev:2024|r2024]] | [production] | 
            
  | 22:06 | <kaldari> | Finished syncing Wikimedia installation... : | [production] | 
            
  | 21:53 | <kaldari> | Started syncing Wikimedia installation... : | [production] | 
            
  | 21:33 | <aaron> | synchronized php-1.20wmf10/extensions/SwiftCloudFiles  'deployed de4a83af7750750fcaa49e81b7faa771c8601546' | [production] | 
            
  | 21:32 | <aaron> | synchronized php-1.20wmf9/extensions/SwiftCloudFiles  'deployed de4a83af7750750fcaa49e81b7faa771c8601546' | [production] | 
            
  | 20:42 | <olivneh> | synchronized php-1.20wmf9/extensions/E3Experiments/experiments/trackEdits.js | [production] | 
            
  | 20:40 | <olivneh> | synchronized php-1.20wmf9/extensions/E3Experiments/lib/e3.js | [production] | 
            
  | 20:35 | <kaldari> | Finished syncing Wikimedia installation... : | [production] | 
            
  | 20:12 | <kaldari> | Started syncing Wikimedia installation... : | [production] | 
            
  | 18:44 | <maplebed> | rebooting ms-be3 | [production] | 
            
  | 18:34 | <apergos> | deleting about 200k thumb dirs and their contents from ms5, unused on any project, covering june and july uploads | [production] | 
            
  | 18:06 | <aaron> | synchronized wmf-config/filebackend.php  'Disable auth caching for testwiki' | [production] | 
            
  | 17:40 | <aaron> | synchronized php-1.20wmf10/includes/filebackend/FSFileBackend.php  'debug logging.' | [production] | 
            
  | 17:21 | <aaron> | synchronized wmf-config/PrivateSettings.php  'Make testwiki use ms-fe4' | [production] | 
            
  | 17:10 | <aaron> | synchronized wmf-config/filebackend.php | [production] | 
            
  | 16:54 | <aaron> | synchronized wmf-config/filebackend.php  'Only write thumbnails to the master backend.' | [production] | 
            
  | 16:41 | <aaron> | synchronized php-1.20wmf10/includes/filebackend/FileBackendMultiWrite.php  'deployed 36c0c1edb6e713a797e7fde52f716ca17f548866' | [production] | 
            
  | 16:40 | <aaron> | synchronized php-1.20wmf9/includes/filerepo/backend/FileBackendMultiWrite.php  'deployed 36c0c1edb6e713a797e7fde52f716ca17f548866' | [production] | 
            
  | 11:46 | <paravoid> | depooling ms-fe3 to stage 1.5 upgrade | [production] | 
            
  | 11:27 | <paravoid> | depooling ms-fe4 to stage 1.5 upgrade | [production] | 
            
  | 04:21 | <aaron> | synchronized php-1.20wmf9/includes/media/MediaTransformOutput.php  'deployed ed9d124c37f57ab7d7c9678908af54363290b1f4' | [production] | 
            
  | 04:20 | <aaron> | synchronized php-1.20wmf10/includes/media/MediaTransformOutput.php  'deployed ed9d124c37f57ab7d7c9678908af54363290b1f4' | [production] | 
            
  | 04:12 | <aaron> | synchronized php-1.20wmf10/includes/media/MediaTransformOutput.php | [production] | 
            
  | 03:49 | <aaron> | synchronized php-1.20wmf10/includes/StreamFile.php | [production] | 
            
  | 03:38 | <aaron> | synchronized php-1.20wmf10/includes/StreamFile.php  'debug logging' | [production] | 
            
  | 02:53 | <LocalisationUpdate> | completed (1.20wmf9) at Thu Aug 23 02:53:10 UTC 2012 | [production] | 
            
  | 02:27 | <LocalisationUpdate> | completed (1.20wmf10) at Thu Aug 23 02:27:31 UTC 2012 | [production] | 
            
  | 00:04 | <asher> | synchronized wmf-config/db.php  'returning db35 to s5' | [production] | 
            
  
    | 2012-08-22
      
      § | 
    
  | 23:54 | <binasher> | rebooting db35 for kernel upgrade | [production] | 
            
  | 23:50 | <binasher> | new s5 master repl pos - MASTER_LOG_FILE='db45-bin.000187', MASTER_LOG_POS=807116168 | [production] | 
            
  | 23:49 | <asher> | synchronized wmf-config/db.php  'setting s5 to writeable' | [production] | 
            
  | 23:47 | <asher> | synchronized wmf-config/db.php  'setting s5 to read-only and switching master to db45, return db39 to s3' | [production] | 
            
  | 23:47 | <binasher> | preparing to rotate the s5 master to db45 (last of these for now) | [production] | 
            
  | 23:36 | <mutante> | check_job_queue check fixed after Tim synced spence. zhwiki has large queue: zhwiki (118614). Nagios did not talk because it was a transition from one critical to another | [production] | 
            
  | 23:26 | <Tim> | added spence to the mediawiki-installation dsh group | [production] | 
            
  | 23:25 | <binasher> | rebooting db39 for kernel upgrade | [production] | 
            
  | 23:19 | <binasher> | new s3 master repl pos: MASTER_LOG_FILE='db34-bin.000864', MASTER_LOG_POS=466194762 | [production] | 
            
  | 23:18 | <asher> | synchronized wmf-config/db.php  'setting s3 to writeable' | [production] | 
            
  | 23:16 | <asher> | synchronized wmf-config/db.php  'setting s3 to read-only, switching master to db34' | [production] | 
            
  | 23:15 | <binasher> | preparing to rotate the s3 master to db34 | [production] | 
            
  | 23:14 | <aaron> | synchronized wmf-config/CommonSettings.php  'Restored math directory to its intended value.' | [production] | 
            
  | 23:13 | <aaron> | synchronized wmf-config/InitialiseSettings.php  'Restored math directory to its intended value.' | [production] | 
            
  | 23:06 | <K4-713> | updated production civicrm to [[rev:2013|r2013]] | [production] | 
            
  | 22:42 | <mutante> | rebooting srv208,srv238 | [production] |