| 2011-08-17
      
      § | 
    
  | 13:24 | <catrope> | synchronized wmf-config/CommonSettings.php  'Fix stupid mistake in debugging hack' | [production] | 
            
  | 13:23 | <catrope> | synchronized wmf-config/CommonSettings.php  'Add temp debugging hack for $wgInternalServer' | [production] | 
            
  | 13:14 | <catrope> | synchronized wmf-config/secure.php  'Remove debugging hack' | [production] | 
            
  | 13:12 | <catrope> | synchronized wmf-config/secure.php  'tweak hack' | [production] | 
            
  | 13:12 | <reedy> | synchronized wmf-config/InitialiseSettings.php  '[[bugzilla:30417|bug 30417]] Enable WikiLove on huwiki' | [production] | 
            
  | 13:10 | <catrope> | synchronized wmf-config/secure.php  'Debugging code so I can figure out what $wgInternalServer is on commons via secure' | [production] | 
            
  | 12:56 | <reedy> | synchronized wmf-config/InitialiseSettings.php  '[[bugzilla:30362|bug 30362]] Enable newusermessage and wikilove on zhwiki' | [production] | 
            
  | 12:22 | <mark> | restarted etherpad on hooper | [production] | 
            
  | 02:27 | <LocalisationUpdate> | completed (1.17) at Wed Aug 17 02:29:32 UTC 2011 | [production] | 
            
  
    | 2011-08-16
      
      § | 
    
  | 22:31 | <notpeter> | pulling srv155 from pybal so I can take it down and upgrade to 10.04 | [production] | 
            
  | 22:10 | <notpeter> | upgrading squid and squid-frontend on sq45 and sq46 | [production] | 
            
  | 21:55 | <mutante> | resolved RT 1274 - we now get mail incl. the diff and comment after every svn commit on sockpuppet | [production] | 
            
  | 21:34 | <reedy> | synchronized wmf-config/CommonSettings.php  'For [[bugzilla:26304|bug 26304]] set oaiChunkSize to 40' | [production] | 
            
  | 21:32 | <reedy> | synchronized php-1.17/languages/messages/MessagesEn.php  'Push [[rev:94698|r94698]]' | [production] | 
            
  | 18:48 | <mutante> | sq61,sq73 - power back up, clean squid, dist-upgrade, rebootb | [production] | 
            
  | 18:12 | <mutante> | sq40,sq56 - power back up, clean squid, dist-upgrade, reboot | [production] | 
            
  | 18:10 | <preilly> | pushing updates to Mobile Frontend extension to allow for search page to work | [production] | 
            
  | 18:10 | <preilly> | synchronizing Wikimedia installation... Revision: 94562: | [production] | 
            
  | 18:08 | <binasher> | deploying frontend.conf to all squids - change to mobile acl to support opt-in trial | [production] | 
            
  | 17:53 | <mutante> | amssq42,amssq61 - power back up, clean squid, dist-upgrade, reboot | [production] | 
            
  | 17:38 | <mutante> | added new class svn::server:notify which installed libsvn-notify-perl on sockpuppet (to get svn commit mails in the future) | [production] | 
            
  | 17:29 | <demon> | synchronized php/extensions/CodeReview/backend/CodeRevision.php  '[[rev:94664|r94664]]' | [production] | 
            
  | 16:23 | <mark> | Increased prefix limit on BGP session between br1-knams and csw2-esams from 10 to 50 prefixes | [production] | 
            
  | 16:00 | <RobH> | lvs1004, lvs1005, lvs1006 both network patches attached | [production] | 
            
  | 15:57 | <mark> | Added Nagios purge script on 'reload' action in its init script | [production] | 
            
  | 15:44 | <mark> | Setup switchports for cross rack row connections from lvs1001-1006 on asw-a-eqiad and asw-b-eqiad | [production] | 
            
  | 15:40 | <Jeff_Green> | package upgrade on payments4, no reboot | [production] | 
            
  | 14:21 | <mark> | Noticed the mobile LVS service had a depool-threshold set at '1.5', preventing it from depooling any hosts, ever. Corrected it by setting it to .6 | [production] | 
            
  | 14:07 | <mark> | Setup 'new-mobile' LVS service on lvs1001 and lvs1004 | [production] | 
            
  | 14:07 | <mark> | Setup eqiad LVS cluster (classes 'high-traffic' and 'testing') consisting of lvs1001 (A4) and lvs1004 (B4); still awaiting cross-row connections | [production] | 
            
  | 13:54 | <mark> | Increased bgp group PyBal multihop ttl from 1 to 2 on all core routers | [production] | 
            
  | 13:54 | <mark> | Configured PyBal bgp group and policy statements on cr1/cr2-eqiad | [production] | 
            
  | 13:14 | <RobH> | reviewed exim paniclog on lily and williams, both from a refusal in spam acl, over 24 hours ago, and no issues since.  cleared each paniclog back to 0 | [production] | 
            
  | 11:16 | <catrope> | synchronized wmf-config/InitialiseSettings.php  '[[bugzilla:30392|bug 30392]]: Add Wikipedia_talk and MediaWiki_talk aliases on zh-yuewiki' | [production] | 
            
  | 10:42 | <mark> | Corrected DNS for lvs1004-1006 | [production] | 
            
  | 10:03 | <mark> | Setup switchports for lvs1001-1006 | [production] | 
            
  | 02:17 | <LocalisationUpdate> | completed (1.17) at Tue Aug 16 02:19:43 UTC 2011 | [production] | 
            
  | 00:37 | <mutante> | gmond.conf was an empty file on search12. copied it in place and restarted gmond | [production] | 
            
  
    | 2011-08-15
      
      § | 
    
  | 23:45 | <reedy> | synchronized wmf-config/InitialiseSettings.php  '[[bugzilla:30320|bug 30320]] Enable AbuseFilter for cswiki' | [production] | 
            
  | 23:34 | <Reedy> | Testwiki job queue is now empty | [production] | 
            
  | 22:57 | <preilly> | pushing Mobile Frontend updates for mobile friendly main page | [production] | 
            
  | 22:57 | <preilly> | synchronizing Wikimedia installation... Revision: 94562: | [production] | 
            
  | 21:59 | <reedy> | synchronized wmf-config/codereview.php  'Auto defer semantic tags' | [production] | 
            
  | 21:35 | <notpeter> | upgrading squid and squid-frontend on sq43 and sq44 | [production] | 
            
  | 21:15 | <notpeter> | upgrading squid and squid-frontend on sq41 and sq42 | [production] | 
            
  | 21:15 | <RoanKattouw> | Fixed scap so mergeExtensionMessages didn't fail anymore. Was broken due to het deploy changes | [production] | 
            
  | 21:14 | <catrope> | synchronizing Wikimedia installation... Revision: 94562: | [production] | 
            
  | 21:12 | <catrope> | synchronizing Wikimedia installation... Revision: 94562: | [production] | 
            
  | 21:12 | <RoanKattouw> | Ended up moving extensions/SecurePoll/auth-api.php.save to /home/catrope . I could do that because I have write access to the parent directory, even though I don't have read access to the file | [production] | 
            
  | 21:07 | <RoanKattouw> | Permissions for extensions/SecurePoll/auth-api.php.save are messed up, breaking scap. Running set-group-write in an attempt to fix it | [production] |