| 2012-05-16
      
      § | 
    
  | 17:35 | <awjrichards> | synchronized php-1.20wmf2/extensions/MobileFrontend  'Picking up fix for fatal in api in MobileFrontend at 9936e7a' | [production] | 
            
  | 17:34 | <awjrichards> | synchronized php-1.20wmf3/extensions/MobileFrontend  'Picking up fix for fatal in api in MobileFrontend at 9936e7a' | [production] | 
            
  | 17:17 | <maplebed> | deploying change to swift to make which containers write thumbs configurable | [production] | 
            
  | 17:11 | <preilly> | synchronized php-1.20wmf3/extensions/MobileFrontend/  'zero and mobile changes' | [production] | 
            
  | 17:10 | <preilly> | synchronized php-1.20wmf2/extensions/MobileFrontend/  'zero and mobile changes' | [production] | 
            
  | 17:08 | <RobH> | aluminum back online | [production] | 
            
  | 17:00 | <binasher> | running ipblocks schema migration on all s3 (819) dbs via os������c | [production] | 
            
  | 16:59 | <binasher> | running ipblocks schema migration on all s4 dbs via os������c | [production] | 
            
  | 16:58 | <binasher> | running ipblocks schema migration on s5/dewiki via osc | [production] | 
            
  | 16:57 | <RobH> | aluminum shut down for hard disk additions | [production] | 
            
  | 16:56 | <binasher> | running ipblocks schema migration on all s6 dbs via osc | [production] | 
            
  | 16:51 | <RobH> | udpating dns for osm web servers | [production] | 
            
  | 16:50 | <binasher> | running ipblocks schema migration on all s7 dbs via osc | [production] | 
            
  | 16:49 | <preilly> | synchronized php-1.20wmf2/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php  'changes for zero needed for carrier testing' | [production] | 
            
  | 16:41 | <aaron> | synchronized php-1.20wmf3/includes/filerepo/backend/SwiftFileBackend.php  'deployed 634c3be2bba6a46e28aa997d7ab388ebf90b36a6' | [production] | 
            
  | 16:31 | <maplebed> | clearing the mobile varnish cache | [production] | 
            
  | 16:29 | <maplebed> | deploying gerrit change 7798 to the mobile varnish servers | [production] | 
            
  | 07:41 | <raindrift> | synchronized php-1.20wmf3/extensions/PageTriage/api/ApiPageTriageTemplate.php  'fixing exception bug that makes lots of logspam' | [production] | 
            
  | 07:41 | <raindrift> | synchronized php-1.20wmf2/extensions/PageTriage/api/ApiPageTriageTemplate.php  'fixing exception bug that makes lots of logspam' | [production] | 
            
  | 06:20 | <Ryan_Lane> | restarted lucene on search1015 | [production] | 
            
  | 05:58 | <Tim> | setting net.ipv4.tcp_tw_recycle=1 on cp1005 seems to have fixed it, doing it on cp1004 as well now | [production] | 
            
  | 05:52 | <Tim> | on cp1005 setting tcp_tw_recycle=1 | [production] | 
            
  | 05:29 | <Tim> | experimentally started squid on cp1004 | [production] | 
            
  | 04:05 | <hashar> | updating a few plugins on Jenkins (host: gallium ) | [production] | 
            
  | 03:34 | <Ryan_Lane> | stopped the squid process on cp1004 and stopped puppet to avoid it being restarted. it's having issues and I can't debug it right now. | [production] | 
            
  | 03:22 | <Ryan_Lane> | repooling squid frontend on cp1004 | [production] | 
            
  | 03:14 | <Ryan_Lane> | depooling cp1004 and stopping the squid backend service to let some connections close | [production] | 
            
  | 02:43 | <LocalisationUpdate> | completed (1.20wmf3) at Wed May 16 02:43:51 UTC 2012 | [production] | 
            
  | 01:10 | <reedy> | synchronized php-1.20wmf3/extensions/RandomRootPage  'dark deploy randomrootpage extension (I'll enable it later)' | [production] | 
            
  
    | 2012-05-15
      
      § | 
    
  | 23:53 | <aaron> | synchronized php-1.20wmf3/includes/Block.php  'deployed 7694faf68f975ea9c4888d575b33dabb84e90083' | [production] | 
            
  | 23:42 | <awjrichards> | synchronized wmf-config/CommonSettings.php | [production] | 
            
  | 23:27 | <ssmollett> | upgraded ganglia-monitor and gmetad from 3.1.2-2.1 to 3.3.5-2 | [production] | 
            
  | 23:26 | <awjrichards> | synchronizing Wikimedia installation... : | [production] | 
            
  | 23:24 | <K4-713> | upgraded minfraud version on the payments account | [production] | 
            
  | 23:22 | <K4-713> | updated and synchronized the payments cluster to DonationInterface d997e7ea1c | [production] | 
            
  | 23:06 | <awjrichards> | synchronized wmf-config/CommonSettings.php  'Bumping MobileFrontend resource version' | [production] | 
            
  | 22:50 | <reedy> | synchronized wmf-config/CommonSettings.php  'Disable CentralAuth logging to file' | [production] | 
            
  | 22:50 | <awjrichards> | synchronizing Wikimedia installation... : Updating MobileFrontend to 0880467 | [production] | 
            
  | 22:34 | <reedy> | synchronized wmf-config/CommonSettings.php  'Enable CentralAuth logging to file' | [production] | 
            
  | 22:30 | <angryblackman> | snowolf is gay and autistic | [production] | 
            
  | 22:13 | <awjrichards> | synchronized wmf-config/CommonSettings.php | [production] | 
            
  | 21:09 | <raindrift> | synchronizing Wikimedia installation... : PageTriage update | [production] | 
            
  | 21:05 | <raindrift> | synchronizing Wikimedia installation... : PageTriage update | [production] | 
            
  | 19:40 | <aaron> | synchronized wmf-config/swift.php  'disabled new hook for now.' | [production] | 
            
  | 19:35 | <reedy> | synchronized php-1.20wmf3/extensions/Translate/tag/PageTranslationHooks.php  'Add wfDebugLog call' | [production] | 
            
  | 19:31 | <reedy> | synchronized php-1.20wmf3/extensions/Translate/tag/PageTranslationHooks.php  'Add wfDebugLog call' | [production] | 
            
  | 19:30 | <reedy> | synchronized wmf-config/CommonSettings.php  '$wgDebugLogGroups[updateTranstagOnNullRevisions] = udp://10.0.5.8:8420/updateTranstagOnNullRevisions' | [production] | 
            
  | 19:26 | <reedy> | synchronized php-1.20wmf3/extensions/Translate/tag/PageTranslationHooks.php  'Only conditionally disable updateTranstagOnNullRevisions hook. Debugging to come' | [production] | 
            
  | 17:45 | <aaron> | synchronized php-1.20wmf3/includes/filerepo/backend/SwiftFileBackend.php | [production] | 
            
  | 17:41 | <aaron> | synchronized php-1.20wmf3/includes/filerepo/backend/SwiftFileBackend.php | [production] |