| 2011-09-19
      
      § | 
    
  | 22:55 | <aaron> | synchronizing Wikimedia installation... : switching test2wiki to 1.18 | [production] | 
            
  | 22:54 | <binasher> | test2wiki on s3 has been migrated by hand | [production] | 
            
  | 22:53 | <binasher> | 1.18 schema migrations completed on all s1 slaves, starting s2 | [production] | 
            
  | 22:04 | <aaron> | synchronized wmf-config/InitialiseSettings.php  'Pre-emptively disable file movers for "user" group (for 1.18, [[rev:93871|r93871]])' | [production] | 
            
  | 19:48 | <binasher> | 1.18 schema migrations completed against enwiki on the first slave (db36) | [production] | 
            
  | 19:04 | <neilk> | synchronizing Wikimedia installation... : regular UploadWizard update, a few changes to make JS message parser throw less fatals, other misc small fixes | [production] | 
            
  | 19:02 | <binasher> | begin run of /home/w/common/php-1.18/maintenance/upgrade-1.18wmf1-1.php | [production] | 
            
  | 18:39 | <LocalisationUpdate> | failed | [production] | 
            
  | 18:38 | <preilly> | removing show/hide from blackberry for now | [production] | 
            
  | 18:38 | <preilly> | synchronized php/extensions/MobileFrontend/DeviceDetection.php  'remove show/hide for now from blackberry' | [production] | 
            
  | 18:05 | <catrope> | synchronizing Wikimedia installation... : Deploy Narayam changes | [production] | 
            
  | 17:50 | <RoanKattouw-BSc> | Moved /home/wikipedia/common/php-1.17-test/includes/.swp to /home/midom/php-1.17-test-includes-.swp , was causing sync errors due to restrictive perms | [production] | 
            
  | 17:47 | <aaron> | ran sync-common-all  'pushing 1.18 files out to apaches' | [production] | 
            
  | 17:40 | <aaron> | ran sync-common-all  'pushing 1.18 files out to apaches' | [production] | 
            
  | 17:37 | <AaronSchulz> | created php-1.18/cache/trusted-xff.cdb | [production] | 
            
  | 17:28 | <AaronSchulz> | Ran checkoutMediaWiki script just add php-1.18 non-svn files/symlinks (reedy checked out already) | [production] | 
            
  | 16:54 | <reedy> | synchronizing Wikimedia installation... : Deployment of 1.18 files to apaches | [production] | 
            
  | 16:51 | <Reedy> | Copy of php-1.18 to /home/wikipedia/common/php-1.18 finished, taking just under 46 minutes | [production] | 
            
  | 16:03 | <Reedy> | copying /tmp/php-1.18 to /home/wikipedia/common/php-1.18 in a screen session on fenari as reedy | [production] | 
            
  | 16:02 | <Reedy> | svn co done | [production] | 
            
  | 16:01 | <Reedy> | Running svn co svn+ssh://svn.wikimedia.org/svnroot/mediawiki/branches/wmf/1.18wmf1 on fenari to /tmp/php-1.18 in a screen session as reedy | [production] | 
            
  | 14:24 | <mark> | Upgraded asw-a4-dtpa and asw-a5-sdtpa to 2.7.02d to resolve memory corruption issues (RT #1113) | [production] | 
            
  | 13:55 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Bug 30984 - Filemover group in ruwiki, allow sysop to remove filemover' | [production] | 
            
  | 12:27 | <mark> | Fixed Puppet on amslvs* [I4a710a8d] (RT #1448) | [production] | 
            
  | 12:01 | <mark> | Corrected wrong LVS service ip of search_pool3 [Icd27ac04] | [production] | 
            
  | 11:49 | <mark> | Changed depool thresholds for search servers LVS services [Ib58b6178] | [production] | 
            
  | 11:07 | <mutante> | owa2 - power up,run puppet,dist-upgrade,reboot - RT #1510 | [production] | 
            
  | 09:02 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Bug 30984 - Filemover group in ruwiki' | [production] | 
            
  | 02:28 | <LocalisationUpdate> | completed (1.17-test) at Mon Sep 19 02:31:18 UTC 2011 | [production] | 
            
  | 02:23 | <LocalisationUpdate> | completed (1.17) at Mon Sep 19 02:25:34 UTC 2011 | [production] | 
            
  
    | 2011-09-17
      
      § | 
    
  | 17:43 | <AaronSchulz> | fixed 10update script, same bug with $mwVerDbSets | [production] | 
            
  | 13:00 | <domas> | manually placed /etc/php5/conf.d/apc-aux.conf on lucid apaches, apparently working APC cache helps a lot with request processing | [production] | 
            
  | 11:26 | <mark> | PyBal on lvs1-3 was in a BGP colliding loop with cr2-pmtpa, restarted PyBal on all three hosts | [production] | 
            
  | 10:44 | <domas> | made profile hitrate collection less crashy, restarted it (from ~tstarling/src/udpprofile/, not sure where else it should've been) | [production] | 
            
  | 10:44 | <mark> | Upgrade of cr2-eqiad complete | [production] | 
            
  | 10:34 | <mark> | Upgrading re1.cr2-eqiad to junos 10.4R7.5 | [production] | 
            
  | 10:28 | <mark> | Performing failover from cr2-eqiad re1 to re0 | [production] | 
            
  | 10:18 | <mark> | Upgrade of cr1-eqiad complete | [production] | 
            
  | 10:08 | <mark> | Upgrading re0.cr1-eqiad to junos 10.4R7.5 | [production] | 
            
  | 09:55 | <mark> | Upgrading re0.cr2-eqiad to junos 10.4R7.5 | [production] | 
            
  | 09:46 | <mark> | Performing failover from cr1-eqiad re0 to re1 | [production] | 
            
  | 09:46 | <mark> | Performing failover from cr1-eqiad re1 to re2 | [production] | 
            
  | 09:33 | <mark_> | Upgrading re1.cr1-eqiad to junos 10.4R7.5 | [production] |