| 2011-09-19
      
      § | 
    
  | 17:37 | <AaronSchulz> | created php-1.18/cache/trusted-xff.cdb | [production] | 
            
  | 17:28 | <AaronSchulz> | Ran checkoutMediaWiki script just add php-1.18 non-svn files/symlinks (reedy checked out already) | [production] | 
            
  | 16:54 | <reedy> | synchronizing Wikimedia installation... : Deployment of 1.18 files to apaches | [production] | 
            
  | 16:51 | <Reedy> | Copy of php-1.18 to /home/wikipedia/common/php-1.18 finished, taking just under 46 minutes | [production] | 
            
  | 16:03 | <Reedy> | copying /tmp/php-1.18 to /home/wikipedia/common/php-1.18 in a screen session on fenari as reedy | [production] | 
            
  | 16:02 | <Reedy> | svn co done | [production] | 
            
  | 16:01 | <Reedy> | Running svn co svn+ssh://svn.wikimedia.org/svnroot/mediawiki/branches/wmf/1.18wmf1 on fenari to /tmp/php-1.18 in a screen session as reedy | [production] | 
            
  | 14:24 | <mark> | Upgraded asw-a4-dtpa and asw-a5-sdtpa to 2.7.02d to resolve memory corruption issues (RT #1113) | [production] | 
            
  | 13:55 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Bug 30984 - Filemover group in ruwiki, allow sysop to remove filemover' | [production] | 
            
  | 12:27 | <mark> | Fixed Puppet on amslvs* [I4a710a8d] (RT #1448) | [production] | 
            
  | 12:01 | <mark> | Corrected wrong LVS service ip of search_pool3 [Icd27ac04] | [production] | 
            
  | 11:49 | <mark> | Changed depool thresholds for search servers LVS services [Ib58b6178] | [production] | 
            
  | 11:07 | <mutante> | owa2 - power up,run puppet,dist-upgrade,reboot - RT #1510 | [production] | 
            
  | 09:02 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Bug 30984 - Filemover group in ruwiki' | [production] | 
            
  | 02:28 | <LocalisationUpdate> | completed (1.17-test) at Mon Sep 19 02:31:18 UTC 2011 | [production] | 
            
  | 02:23 | <LocalisationUpdate> | completed (1.17) at Mon Sep 19 02:25:34 UTC 2011 | [production] | 
            
  
    | 2011-09-17
      
      § | 
    
  | 17:43 | <AaronSchulz> | fixed 10update script, same bug with $mwVerDbSets | [production] | 
            
  | 13:00 | <domas> | manually placed /etc/php5/conf.d/apc-aux.conf on lucid apaches, apparently working APC cache helps a lot with request processing | [production] | 
            
  | 11:26 | <mark> | PyBal on lvs1-3 was in a BGP colliding loop with cr2-pmtpa, restarted PyBal on all three hosts | [production] | 
            
  | 10:44 | <domas> | made profile hitrate collection less crashy, restarted it (from ~tstarling/src/udpprofile/, not sure where else it should've been) | [production] | 
            
  | 10:44 | <mark> | Upgrade of cr2-eqiad complete | [production] | 
            
  | 10:34 | <mark> | Upgrading re1.cr2-eqiad to junos 10.4R7.5 | [production] | 
            
  | 10:28 | <mark> | Performing failover from cr2-eqiad re1 to re0 | [production] | 
            
  | 10:18 | <mark> | Upgrade of cr1-eqiad complete | [production] | 
            
  | 10:08 | <mark> | Upgrading re0.cr1-eqiad to junos 10.4R7.5 | [production] | 
            
  | 09:55 | <mark> | Upgrading re0.cr2-eqiad to junos 10.4R7.5 | [production] | 
            
  | 09:46 | <mark> | Performing failover from cr1-eqiad re0 to re1 | [production] | 
            
  | 09:46 | <mark> | Performing failover from cr1-eqiad re1 to re2 | [production] | 
            
  | 09:33 | <mark_> | Upgrading re1.cr1-eqiad to junos 10.4R7.5 | [production] | 
            
  | 02:22 | <LocalisationUpdate> | completed (1.17=aawiki 1.17-test) at Sat Sep 17 02:25:20 UTC 2011 | [production] | 
            
  | 00:00 | <notpeter> | removing srv288 from the apaches pool for upgrade to lucid | [production] | 
            
  
    | 2011-09-16
      
      § | 
    
  | 23:48 | <maplebed> | started copying data from all srv hosts with external storage databases to es1001.  I expect it to run all weekend. | [production] | 
            
  | 23:39 | <notpeter> | putting srv289 back in the apache pool | [production] | 
            
  | 23:12 | <aaron> | synchronized wmf-config/CommonSettings.php  'added require for Math extension, checks $wmgUseMath and version compare with $wmfVersionNumber so it does nothing yet' | [production] | 
            
  | 22:50 | <aaron> | synchronized wmf-config/InitialiseSettings.php  'added wmgUseMath setting (on by default); not yet used' | [production] | 
            
  | 21:27 | <AaronSchulz> | fixed usage of $mwVersionNums in set-group-write2 (same double quotes bug the sync scripts had before) | [production] | 
            
  | 20:51 | <aaron> | synchronized php-1.17/extensions/FlaggedRevs/specialpages/ReviewedVersions_body.php  'deployed [[rev:97331|r97331]]' | [production] | 
            
  | 20:51 | <Jeff_Green> | putting http redirect back in front of donate.wikimedia.org b/c fundraisers aren't ready for it | [production] | 
            
  | 20:51 | <aaron> | synchronized php-1.17/extensions/FlaggedRevs/api/FlaggedRevsApi.hooks.php  'deployed [[rev:97331|r97331]]' | [production] | 
            
  | 20:29 | <AaronSchulz> | fixed geshi on test2 & secure testwiki | [production] | 
            
  | 20:25 | <aaron> | ran sync-common-all | [production] | 
            
  | 20:22 | <AaronSchulz> | changed mwscript & mwscriptwikiset to use the /home version of scripts (people usually did this before and some things like TrustedXFF expect it) | [production] | 
            
  | 20:07 | <aaron> | synchronized wmf-config/InitialiseSettings.php  'Set wgAutopromoteOnceLogInRC for plwiki,plwikisource ahead of time - no effect yet - [[bugzilla:29655|bug 29655]]' | [production] |