| 2011-06-08
      
      § | 
    
  | 19:56 | <binasher> | upgrade mobile4 to natty | [production] | 
            
  | 19:53 | <mark> | Shutdown ekrem's switch port and null routed the ip for a while | [production] | 
            
  | 19:53 | <Ryan_Lane> | deleting vmdev1 and vmdev2, and moving the controller.labs.wikimedia.org entry into the public services subnet | [production] | 
            
  | 19:45 | <binasher> | upgrading mobile4 to maverick on its way to natty | [production] | 
            
  | 19:31 | <Ryan_Lane> | reclaiming sandbox ips for owa.tesla, owa1.tesla, owa2.tesla, lvs1.tesla, and grid.tesla | [production] | 
            
  | 18:10 | <Ryan_Lane> | depooling mobile5 | [production] | 
            
  | 18:05 | <Ryan_Lane> | changing weight for mobile5 | [production] | 
            
  | 17:42 | <Ryan_Lane> | upping the weight of mobile5 to 24 | [production] | 
            
  | 17:27 | <Ryan_Lane> | upping weight of mobile5 to 16 | [production] | 
            
  | 17:18 | <Ryan_Lane> | depooling mobile4 | [production] | 
            
  | 17:16 | <Ryan_Lane> | reducing weight of mobile4/5 to 8 | [production] | 
            
  | 17:13 | <Ryan_Lane> | repooling mobile4/5 with a weight of 16 | [production] | 
            
  | 16:29 | <^demon|away> | irc feeds are down, somebody who has access should investigate. | [production] | 
            
  | 15:39 | <mark> | Rebooting sq71 to remove old temp eqiad tunnel config | [production] | 
            
  | 14:49 | <mark> | Setup PIM-SM on eqiad core routers and joined the pmtpa domain | [production] | 
            
  | 14:49 | <mark> | Changed pmtpa PIM-DM to PIM-SM | [production] | 
            
  | 11:31 | <mark> | Added A records for cr1-eqiad and cr2-eqiad loopback interfaces | [production] | 
            
  | 10:47 | <mark> | Set local-pref value for private peers on cr1-eqiad and cr2-eqiad | [production] | 
            
  | 10:43 | <mark> | Removed cr1-eqiad:ae1.666 configuration to remove the temporary tunneled link | [production] | 
            
  | 10:39 | <mark> | Configured OSPF and OSPFv3 on csw1-sdtpa:e16/1 and cr2-eqiad:xe-5/2/1 | [production] | 
            
  | 10:39 | <mark> | Assigned IP addresses to csw1-sdtpa:e16/1 and cr2-eqiad:xe-5/2/1 to bring up the second 10G wave | [production] | 
            
  | 00:37 | <awjrichards> | synchronized php-1.17/wmf-config/InitialiseSettings.php  'Enabling CustomUserSignup on testwiki' | [production] | 
            
  
    | 2011-06-07
      
      § | 
    
  | 23:51 | <Ryan_Lane> | rebooting virt1/2 | [production] | 
            
  | 23:21 | <Ryan_Lane> | rebooting virt1 | [production] | 
            
  | 23:21 | <Ryan_Lane> | moving nova-network to virt2, as it was causing issues accessing the public IP on virt1 | [production] | 
            
  | 23:12 | <Ryan_Lane> | rebooting virt1 | [production] | 
            
  | 22:33 | <Ryan_Lane> | removed nova-network from virt2-4, since multiple network nodes isn't supported. Added to virt1. Rebooting virt2-4. | [production] | 
            
  | 22:11 | <hcatlin> | deploying to mobile cluster | [production] | 
            
  | 21:55 | <Ryan_Lane> | restarting opendj on nfs2 | [production] | 
            
  | 19:56 | <tfinc> | synchronized php-1.17/wmf-config/InitialiseSettings.php  'enabling collections extension on wikinews' | [production] | 
            
  | 19:39 | <andrewS> | ms4 ticket 729 updated, system is in testing | [production] | 
            
  | 17:46 | <Ryan_Lane> | rebooting virt1 to enable virtualization in the bios | [production] | 
            
  | 17:42 | <Ryan_Lane> | rebooting virt2 to enable virtualization in the bios | [production] | 
            
  | 17:39 | <Ryan_Lane> | rebooting virt3 to enable virtualization in the bios | [production] | 
            
  | 17:35 | <Ryan_Lane> | rebooting virt4 to enable virtualization in the bios | [production] | 
            
  | 17:01 | <awjrichards> | synchronized php-1.17/wmf-config/CommonSettings.php  'Disabling Tidy on collabwiki per bug 29295' | [production] | 
            
  | 16:50 | <mark> | Adjusted BGP filters on cr1-eqiad to allow advertisement of pmtpa aggregates to BGP peers | [production] | 
            
  | 16:29 | <mark> | Removed static routes from cr1-eqiad and cr2-eqiad | [production] | 
            
  | 16:18 | <mark> | Setup full mesh of iBGP sessions between csw5-pmtpa, csw1-sdtpa, cr1-eqiad, cr2-eqiad (separate v4/v6 sessions) | [production] | 
            
  | 15:17 | <mark> | Removed IPv6-only iBGP session between cr1-eqiad and cr2-eqiad and converted the v4 iBGP session into multi-address-family | [production] | 
            
  | 14:22 | <mark> | Setup OSPFv3 between csw1-sdtpa and csw5-pmtpa | [production] | 
            
  | 14:08 | <reedy> | synchronized php-1.17/wmf-config/InitialiseSettings.php  'bug 28292' | [production] | 
            
  | 14:04 | <reedy> | synchronized php-1.17/includes/api/ApiPageSet.php  'r89646' | [production] | 
            
  | 13:58 | <mark> | Setup OSPF and OSPFv3 on the first 10G wave circuit between csw1-sdtpa and cr1-eqiad | [production] | 
            
  | 13:39 | <RobH> | updaed puppet giving andrew shields basic restricted shell access to fenari | [production] | 
            
  | 11:08 | <mark> | Setup quick log rotation of ipv6and4 on maerlant | [production] | 
            
  | 04:51 | <demon> | synchronized php-1.17/wmf-config/CommonSettings.php  'Let normal users test/signoff on revisions, just like we let them post comments. Restricting it to "coders" kind of defeats the purpose' | [production] |