| 2012-08-06
      
      § | 
    
  | 16:57 | <cmjohnson1> | powering down mc1 to reseat DIMM | [production] | 
            
  | 16:51 | <reedy> | synchronized . | [production] | 
            
  | 16:33 | <reedy> | synchronized php-1.20wmf9/ | [production] | 
            
  | 15:08 | <paravoid> | switched European bits traffic back to esams | [production] | 
            
  | 14:50 | <Tim> | on cp3002: temporarily set net.ipv4.tcp_tw_recycle=1 | [production] | 
            
  | 14:41 | <Tim> | on cp3002 increasing tcp_max_tw_buckets | [production] | 
            
  | 14:33 | <Tim> | on cp3001: date -s `"date"` to fix leap second issue | [production] | 
            
  | 13:26 | <Nemo_bis> | Reedy says: Status: Down - routing issues to Tampa !Wikipedia !Wikimedia | [production] | 
            
  | 13:17 | <Nemo_bis> | more or less everything at !Wikimedia / !Wikipedia seems down | [production] | 
            
  | 02:27 | <LocalisationUpdate> | completed (1.20wmf8) at Mon Aug  6 02:27:00 UTC 2012 | [production] | 
            
  
    | 2012-08-03
      
      § | 
    
  | 23:50 | <reedy> | synchronized wmf-config/secure.php  'fix bits usages' | [production] | 
            
  | 21:53 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Bug 38988 - Enable Extension:Collection for Wikimedia Sverige' | [production] | 
            
  | 18:58 | <maplebed> | updated DNS to fix *.svc.{esams,eqiad}.wmnet forward resolution | [production] | 
            
  | 18:49 | <andrewbogott> | turned off nova-compute on virt1, virt2, virt3, virt4 | [production] | 
            
  | 18:44 | <maplebed> | updating DNS adding swift eqiad LVS address | [production] | 
            
  | 17:42 | <aaron> | synchronized php-1.20wmf8/extensions/TimedMediaHandler  'Updated to master (0207962155b810b11100bc6d05c3562949e7c1a9)' | [production] | 
            
  | 07:58 | <hashar> | GlusterFS upgrade of labs project storage seems to have been completed. Fixed the issues I had with it on 'beta' project, yeah!!!!! | [production] | 
            
  | 02:25 | <LocalisationUpdate> | completed (1.20wmf8) at Fri Aug  3 02:25:37 UTC 2012 | [production] | 
            
  | 01:54 | <domas> | bumped memcached timeout to be slightly above min_rto, 200ms->250ms, should eliminate most of stupid memcached errors because of datacenter network failures | [production] | 
            
  | 01:53 | <midom> | synchronized wmf-config/mc.php | [production] | 
            
  
    | 2012-08-02
      
      § | 
    
  | 22:48 | <Ryan_Lane> | upgrading glusterfs for project storage to 3.3 | [production] | 
            
  | 22:05 | <aaron> | synchronized wmf-config/filebackend.php  'Moved all wikis to multiwrite backend' | [production] | 
            
  | 22:05 | <mutante> | dist-upgrading sodium | [production] | 
            
  | 21:47 | <hashar> | added Dsc to the Gerrit 'integration' group. David now got access to the various integration/* repositories. | [production] | 
            
  | 20:34 | <andrew> | synchronized php-1.20wmf8/extensions/Echo/modules/base/ext.echo.base.css | [production] | 
            
  | 20:30 | <asher> | synchronized wmf-config/mc.php  'setting wgMemCachedPersistent back to false, no change observed to current issue' | [production] | 
            
  | 20:12 | <asher> | synchronized wmf-config/mc.php  'setting wgMemCachedPersistent = true as an experiment' | [production] | 
            
  | 20:06 | <Andrew> | Leaving Echo deployment there for now. | [production] | 
            
  | 20:04 | <Andrew> | Rolled back LQT updates, they seem to break other notifications. We'll figure out the bugs with that in another window. | [production] | 
            
  | 20:02 | <andrew> | synchronized php-1.20wmf8/extensions/LiquidThreads | [production] | 
            
  | 19:56 | <Andrew> | deployed Echo to mediawiki.org | [production] | 
            
  | 19:56 | <andrew> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 19:55 | <andrew> | synchronized wmf-config/CommonSettings.php | [production] | 
            
  | 19:55 | <andrew> | synchronized php-1.20wmf8/extensions/Echo | [production] | 
            
  | 19:54 | <andrew> | synchronized php-1.20wmf8/extensions/LiquidThreads | [production] | 
            
  | 19:44 | <andrew> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 19:44 | <andrew> | synchronized php-1.20wmf8/extensions/Echo | [production] | 
            
  | 19:43 | <andrew> | synchronized php-1.20wmf8/extensions/LiquidThreads | [production] | 
            
  | 19:43 | <Andrew> | Deploying Echo to test2wiki instead | [production] | 
            
  | 18:38 | <Andrew> | Turned Echo back on on testwiki | [production] | 
            
  | 18:35 | <Andrew> | Stealing E2's deployment window to have another crack at Echo | [production] | 
            
  | 16:44 | <paravoid> | sync-apache/apache-gracefull-all for BZ #38905 (ShortUrl on !Wikipedia) | [production] | 
            
  | 16:20 | <RobH> | authdns-update for smokeping | [production] | 
            
  | 13:05 | <nikerabbit> | synchronized php-1.20wmf8/extensions/Translate/specials/  'Translate bug fixes' | [production] | 
            
  | 04:45 | <tstarling> | synchronized php-1.20wmf8/skins/common/commonElements.css | [production] |