| 2011-11-08
      
      § | 
    
  | 23:52 | <aaron> | synchronized php-1.18/includes/api/ApiUpload.php  'removed live hack' | [production] | 
            
  | 23:11 | <aaron> | synchronized php-1.18/includes/upload/UploadFromStash.php | [production] | 
            
  | 22:46 | <aaron> | synchronized php-1.18/includes/upload/UploadFromStash.php | [production] | 
            
  | 22:43 | <AaronSchulz> | Doing some api upload debugging via error log | [production] | 
            
  | 22:37 | <aaron> | synchronized php-1.18/includes/api/ApiUpload.php | [production] | 
            
  | 22:33 | <aaron> | synchronized php-1.18/includes/api/ApiUpload.php | [production] | 
            
  | 22:30 | <aaron> | synchronized php-1.18/includes/api/ApiUpload.php | [production] | 
            
  | 22:08 | <aaron> | synchronized php-1.18/includes/api/ApiUpload.php | [production] | 
            
  | 22:03 | <aaron> | synchronized php-1.18/includes/api/ApiUpload.php  'Made performStash() $stashFile check stronger' | [production] | 
            
  | 21:56 | <tfinc> | synchronized wmf-config/InitialiseSettings.php  'updating aspect ratios for wmf wiki logo' | [production] | 
            
  | 21:33 | <preilly> | synchronized php-1.18/extensions/MobileFrontend/views/layout/application.html.php  'weekly update to mobile frontend' | [production] | 
            
  | 21:22 | <preilly> | synchronized php-1.18/extensions/MobileFrontend/views/layout/application.html.php  'weekly update to mobile frontend' | [production] | 
            
  | 21:21 | <preilly> | synchronized php-1.18/extensions/MobileFrontend/views/layout/_search_webkit.html.php  'weekly update to mobile frontend' | [production] | 
            
  | 21:12 | <preilly> | synchronized php-1.18/extensions/MobileFrontend/views/layout/application.html.php  'weekly update to mobile frontend' | [production] | 
            
  | 21:07 | <preilly> | synchronized php-1.18/extensions/MobileFrontend/MobileFrontend.php  'weekly update to mobile frontend' | [production] | 
            
  | 21:07 | <preilly> | synchronized php-1.18/extensions/MobileFrontend/stylesheets/common.css  'weekly update to mobile frontend' | [production] | 
            
  | 20:50 | <aaron> | synchronized php-1.18/includes  'deployed [[rev:102434|r102434]]' | [production] | 
            
  | 20:03 | <maplebed> | changed replication topology for external store cluster; new ES hosts are all now replicating off es3, which is still replicating off ms3. | [production] | 
            
  | 19:52 | <AaronSchulz> | ran fixBug32198.php and confirmed that there are no more affected rows atm | [production] | 
            
  | 19:49 | <tfinc> | synchronized wmf-config/InitialiseSettings.php  'Upping resolution of wmf wiki logo to 35px' | [production] | 
            
  | 19:46 | <tfinc> | synchronized wmf-config/InitialiseSettings.php  'Pushing config change again due to missing ssh agent' | [production] | 
            
  | 19:01 | <ben> | synchronized wmf-config/db.php  'switching external store cluster6 from srv hosts to new ES hardware es3 and es4.' | [production] | 
            
  | 19:00 | <maplebed> | switching external store cluster6 to new ES hardware. | [production] | 
            
  | 18:14 | <mark> | Converted eth0 on sq67 to an aggregated interface of eth0-4 | [production] | 
            
  | 17:25 | <mark> | Converted eth0 on sq68 to an aggregated interface of eth0-4 | [production] | 
            
  | 15:15 | <catrope> | synchronized wmf-config/CommonSettings.php  '[[bugzilla:28026|bug 28026]] trial - Enable $wgEnotifUserTalk on all wikis, but keep $wgShowUpdatedMarker disabled where it was disabled before' | [production] | 
            
  | 15:07 | <RoanKattouw> | ...after fixing permissions on cache/l10n AGAIN | [production] | 
            
  | 15:07 | <RoanKattouw> | Ran sync-l10nupdate | [production] | 
            
  | 12:22 | <mutante> | arsenic - alright known kernel issue with bonding, ack | [production] | 
            
  | 12:17 | <mutante> | arsenic - power cycling | [production] | 
            
  | 12:15 | <mutante> | arsenic - not reachable via ssh, mgmt shows BUG: soft lockup - CPU#6 stuck for 61s! | [production] | 
            
  | 11:08 | <catrope> | synchronized php-1.18/cache/interwiki-pr.cdb  'Update interwiki cache for [[bugzilla:29591|bug 29591]]' | [production] | 
            
  | 11:08 | <catrope> | synchronized php-1.18/cache/interwiki.cdb  'Update interwiki cache for [[bugzilla:29591|bug 29591]]' | [production] | 
            
  | 11:06 | <catrope> | synchronized special.dblist  'Remove sourceswiki from special.dblist to make [[rev:102388|r102388]] work' | [production] | 
            
  | 05:45 | <Tim> | on fenari: svn up finished, started puppet and xinetd | [production] | 
            
  | 04:46 | <Tim> | increased read timeout on formey apache from 300 to 600 to increase the chances of a successful svn up on fenari extdist | [production] | 
            
  | 02:28 | <LocalisationUpdate> | completed (1.18) at Tue Nov  8 02:31:23 UTC 2011 | [production] | 
            
  
    | 2011-11-07
      
      § | 
    
  | 23:18 | <awjrichards> | synchronized wmf-config/CommonSettings.php  'Removing AU from list of priority countries for LandingCheck' | [production] | 
            
  | 21:30 | <awjr> | reenabling donations queue consumption job in Jenkins on aluminium | [production] | 
            
  | 21:10 | <mark> | Reenabled BGP session to AS1299 on br1-knams | [production] | 
            
  | 20:22 | <awjr> | disabling donations queue consumption in jenkins on aluminium | [production] | 
            
  | 20:17 | <maplebed> | full snapshot of external store data now resides on es1001 | [production] | 
            
  | 19:38 | <awjr> | syncing payments cluster to [[rev:102314|r102314]] | [production] | 
            
  | 18:37 | <nikerabbit> | synchronized php-1.18/languages/messages/  'i18ndeploy [[rev:102305|r102305]]' | [production] | 
            
  | 18:36 | <nikerabbit> | synchronized php-1.18/skins/common/shared.css  'i18ndeploy [[rev:102305|r102305]]' | [production] |