| 2012-08-06
      
      § | 
    
  | 23:49 | <mutante> | wikitech back to old version after failed upgrade attempt | [production] | 
            
  | 23:48 | <mutante> | test | [production] | 
            
  | 22:27 | <mutante> | dist-upgrading wikitech instance | [production] | 
            
  | 22:19 | <aaron> | synchronized php-1.20wmf8/includes/filerepo/backend/SwiftFileBackend.php | [production] | 
            
  | 22:14 | <binasher> | rebooting db1028, upgrading | [production] | 
            
  | 22:13 | <binasher> | rebooting db1027, upgrade to precise | [production] | 
            
  | 22:10 | <aaron> | synchronized php-1.20wmf9/includes/filerepo/backend/SwiftFileBackend.php  'deployed 0a5c71d4dd6405502b1d1d0a02b5d0927d519986' | [production] | 
            
  | 21:59 | <binasher> | rebooting db1026, upgrading to precise | [production] | 
            
  | 21:54 | <mutante> | saving space on wikitech linode - gzipping old .sql dumps and stuff | [production] | 
            
  | 21:32 | <catrope> | synchronized php-1.20wmf9/extensions/VisualEditor/  'Updating VisualEditor' | [production] | 
            
  | 21:18 | <catrope> | synchronized wmf-config/CommonSettings.php  'Fix Parsoid URL' | [production] | 
            
  | 21:09 | <catrope> | synchronized php-1.20wmf9/extensions/VisualEditor  'Updating VisualEditor' | [production] | 
            
  | 20:23 | <catrope> | synchronized php-1.20wmf9/cache/l10n/  'Sync out l10n cache again now that it is properly rebuilt' | [production] | 
            
  | 19:47 | <aaron> | rebuilt wikiversions.cdb and synchronized wikiversions files: mediawikiwiki to 1.20wmf9 | [production] | 
            
  | 19:46 | <RoanKattouw> | Rebuilt ExtensionMessages-1.20wmf9.php and then l10n cache for wmf9 to pick up addition of FundraiserLandingPage.i18n.magic.php , somehow wasn't picked up during initial scap | [production] | 
            
  | 19:44 | <RobH> | asw-c8-eqiad PEM1 power reseated, cleared alarm rt 3204 | [production] | 
            
  | 19:39 | <catrope> | synchronized wmf-config/ExtensionMessages-1.20wmf9.php  'Updated' | [production] | 
            
  | 19:30 | <RobH> | db1047 back online | [production] | 
            
  | 19:18 | <RobH> | db1047 shutting down | [production] | 
            
  | 19:15 | <RobH> | db1047 mysql and system shutdown per rt 3084 for bad memory swap | [production] | 
            
  | 19:14 | <aaron> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 19:12 | <aaron> | rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki and mediawikiwiki to 1.20wmf9 | [production] | 
            
  | 19:11 | <reedy> | Finished syncing Wikimedia installation... : test2wiki to 1.20wmf9 and scap to rebuild message cache | [production] | 
            
  | 18:20 | <reedy> | Started syncing Wikimedia installation... : test2wiki to 1.20wmf9 and scap to rebuild message cache | [production] | 
            
  | 18:12 | <reedy> | Started syncing Wikimedia installation... : test2wiki to 1.20wmf9 and scap to rebuild message cache | [production] | 
            
  | 18:06 | <aaron> | synchronized php-1.20wmf9/includes/filerepo/backend/FileBackendMultiWrite.php  'deployed b55e9652fce3051d621356c5c87c47f44515a367' | [production] | 
            
  | 18:02 | <aaron> | synchronized wmf-config/filebackend.php | [production] | 
            
  | 17:59 | <aaron> | synchronized php-1.20wmf8/includes/filerepo/backend/FileBackendMultiWrite.php  'deployed b55e9652fce3051d621356c5c87c47f44515a367' | [production] | 
            
  | 17:11 | <aaron> | synchronized wmf-config/filebackend.php  'Adding Swift to local multiwrite backend for testwikis+mw.org' | [production] | 
            
  | 16:57 | <cmjohnson1> | powering down mc1 to reseat DIMM | [production] | 
            
  | 16:51 | <reedy> | synchronized . | [production] | 
            
  | 16:33 | <reedy> | synchronized php-1.20wmf9/ | [production] | 
            
  | 15:08 | <paravoid> | switched European bits traffic back to esams | [production] | 
            
  | 14:50 | <Tim> | on cp3002: temporarily set net.ipv4.tcp_tw_recycle=1 | [production] | 
            
  | 14:41 | <Tim> | on cp3002 increasing tcp_max_tw_buckets | [production] | 
            
  | 14:33 | <Tim> | on cp3001: date -s `"date"` to fix leap second issue | [production] | 
            
  | 13:26 | <Nemo_bis> | Reedy says: Status: Down - routing issues to Tampa !Wikipedia !Wikimedia | [production] | 
            
  | 13:17 | <Nemo_bis> | more or less everything at !Wikimedia / !Wikipedia seems down | [production] | 
            
  | 02:27 | <LocalisationUpdate> | completed (1.20wmf8) at Mon Aug  6 02:27:00 UTC 2012 | [production] |