| 2011-08-16
      
      § | 
    
  | 16:23 | <mark> | Increased prefix limit on BGP session between br1-knams and csw2-esams from 10 to 50 prefixes | [production] | 
            
  | 16:00 | <RobH> | lvs1004, lvs1005, lvs1006 both network patches attached | [production] | 
            
  | 15:57 | <mark> | Added Nagios purge script on 'reload' action in its init script | [production] | 
            
  | 15:44 | <mark> | Setup switchports for cross rack row connections from lvs1001-1006 on asw-a-eqiad and asw-b-eqiad | [production] | 
            
  | 15:40 | <Jeff_Green> | package upgrade on payments4, no reboot | [production] | 
            
  | 14:21 | <mark> | Noticed the mobile LVS service had a depool-threshold set at '1.5', preventing it from depooling any hosts, ever. Corrected it by setting it to .6 | [production] | 
            
  | 14:07 | <mark> | Setup 'new-mobile' LVS service on lvs1001 and lvs1004 | [production] | 
            
  | 14:07 | <mark> | Setup eqiad LVS cluster (classes 'high-traffic' and 'testing') consisting of lvs1001 (A4) and lvs1004 (B4); still awaiting cross-row connections | [production] | 
            
  | 13:54 | <mark> | Increased bgp group PyBal multihop ttl from 1 to 2 on all core routers | [production] | 
            
  | 13:54 | <mark> | Configured PyBal bgp group and policy statements on cr1/cr2-eqiad | [production] | 
            
  | 13:14 | <RobH> | reviewed exim paniclog on lily and williams, both from a refusal in spam acl, over 24 hours ago, and no issues since.  cleared each paniclog back to 0 | [production] | 
            
  | 11:16 | <catrope> | synchronized wmf-config/InitialiseSettings.php  '[[bugzilla:30392|bug 30392]]: Add Wikipedia_talk and MediaWiki_talk aliases on zh-yuewiki' | [production] | 
            
  | 10:42 | <mark> | Corrected DNS for lvs1004-1006 | [production] | 
            
  | 10:03 | <mark> | Setup switchports for lvs1001-1006 | [production] | 
            
  | 02:17 | <LocalisationUpdate> | completed (1.17) at Tue Aug 16 02:19:43 UTC 2011 | [production] | 
            
  | 00:37 | <mutante> | gmond.conf was an empty file on search12. copied it in place and restarted gmond | [production] | 
            
  
    | 2011-08-15
      
      § | 
    
  | 23:45 | <reedy> | synchronized wmf-config/InitialiseSettings.php  '[[bugzilla:30320|bug 30320]] Enable AbuseFilter for cswiki' | [production] | 
            
  | 23:34 | <Reedy> | Testwiki job queue is now empty | [production] | 
            
  | 22:57 | <preilly> | pushing Mobile Frontend updates for mobile friendly main page | [production] | 
            
  | 22:57 | <preilly> | synchronizing Wikimedia installation... Revision: 94562: | [production] | 
            
  | 21:59 | <reedy> | synchronized wmf-config/codereview.php  'Auto defer semantic tags' | [production] | 
            
  | 21:35 | <notpeter> | upgrading squid and squid-frontend on sq43 and sq44 | [production] | 
            
  | 21:15 | <notpeter> | upgrading squid and squid-frontend on sq41 and sq42 | [production] | 
            
  | 21:15 | <RoanKattouw> | Fixed scap so mergeExtensionMessages didn't fail anymore. Was broken due to het deploy changes | [production] | 
            
  | 21:14 | <catrope> | synchronizing Wikimedia installation... Revision: 94562: | [production] | 
            
  | 21:12 | <catrope> | synchronizing Wikimedia installation... Revision: 94562: | [production] | 
            
  | 21:12 | <RoanKattouw> | Ended up moving extensions/SecurePoll/auth-api.php.save to /home/catrope . I could do that because I have write access to the parent directory, even though I don't have read access to the file | [production] | 
            
  | 21:07 | <RoanKattouw> | Permissions for extensions/SecurePoll/auth-api.php.save are messed up, breaking scap. Running set-group-write in an attempt to fix it | [production] | 
            
  | 21:01 | <catrope> | synchronizing Wikimedia installation... Revision: 94562: | [production] | 
            
  | 21:01 | <RoanKattouw> | Running scap to push my latest 1.17wmf1 commits plus Patrick's MobileFrontend changes site-wide | [production] | 
            
  | 20:31 | <RoanKattouw> | Running svn up on fenari to deploy my recent 1.17wmf1 revisions to testwiki | [production] | 
            
  | 19:19 | <Ryan_Lane> | assigning svc ips for bits, upload, and text in 10.2.2.x range for eqiad | [production] | 
            
  | 18:25 | <notpeter> | upgrading squid and squid-frontend on knsq20 and knsq21 and knsq22 | [production] | 
            
  | 18:10 | <notpeter> | upgrading squid and squid-frontend on knsq18 and knsq19 | [production] | 
            
  | 18:04 | <preilly> | pushing mobile fronted changes for image enable disable | [production] | 
            
  | 18:04 | <preilly> | synchronizing Wikimedia installation... Revision: 94253: | [production] | 
            
  | 17:53 | <mutante> | added libnet-stomp-perl to puppet to be installed on spence | [production] | 
            
  | 17:49 | <notpeter> | upgrading squid and squid-frontend on knsq16 and knsq17 | [production] | 
            
  | 17:04 | <RobH> | updating dns with lvs1001-1006 mgmt info | [production] | 
            
  | 16:58 | <Ryan_Lane> | pushing varnish changes to allow XFF from HTTPS cluster | [production] | 
            
  | 15:39 | <andrew> | synchronized php-1.17/extensions/SecurePoll/auth-api.php | [production] | 
            
  | 15:38 | <andrew> | synchronized php-1.17/extensions/SecurePoll/auth-api.php | [production] | 
            
  | 15:36 | <andrew> | synchronized php-1.17/extensions/SecurePoll/auth-api.php | [production] | 
            
  | 15:34 | <andrew> | synchronized php-1.17/extensions/SecurePoll/auth-api.php | [production] | 
            
  | 15:25 | <RobH> | updating dns for lvs1001-lvs1006 | [production] | 
            
  | 15:19 | <RobH> | restarted dns on ns2 | [production] | 
            
  | 15:04 | <andrew> | synchronized php-1.17/extensions/SecurePoll/includes/ballots/Ballot.php  'Deploy [[rev:94343|r94343]]' | [production] | 
            
  | 15:04 | <andrew> | synchronized php-1.17/extensions/SecurePoll/SecurePoll.php  'Deploy [[rev:94343|r94343]]' | [production] | 
            
  | 15:03 | <andrew> | synchronized php-1.17/extensions/SecurePoll/includes/ballots/RadioRangeCommentBallot.php  'Deploy [[rev:94343|r94343]]' | [production] | 
            
  | 14:37 | <mark> | Enabled NAT on the pmtpa management LAN | [production] |