| 
      
        2011-06-03
      
      §
     | 
  
    
  | 21:27 | 
  <catrope> | 
  synchronized php-1.17/extensions/ArticleFeedback/modules/jquery.articleFeedback/jquery.articleFeedback.css  'r89444, r89445' | 
  [production] | 
            
  | 21:27 | 
  <catrope> | 
  synchronized php-1.17/extensions/ArticleFeedback/modules/jquery.articleFeedback/jquery.articleFeedback.js  'r89444, r89445' | 
  [production] | 
            
  | 21:27 | 
  <catrope> | 
  synchronized php-1.17/extensions/ArticleFeedback/modules/ext.articleFeedback/ext.articleFeedback.js  'r89444, r89445' | 
  [production] | 
            
  | 20:43 | 
  <Ryan_Lane> | 
  added temporary dns entry controller.labs.wikimedia.org until we figure out a proper DNS scheme for labs | 
  [production] | 
            
  | 19:43 | 
  <Ryan_Lane> | 
  repooling mobile4/5 with a weight of 8 | 
  [production] | 
            
  | 19:09 | 
  <notpeter> | 
  pushing mible 4 and 5 into pool | 
  [production] | 
            
  | 19:00 | 
  <Ryan_Lane> | 
  reinstalling opendj on virt1 with a new domain; using labs instead of tesla | 
  [production] | 
            
  | 17:59 | 
  <awjr> | 
  killing eternally running query on civicrm db on db9 | 
  [production] | 
            
  | 17:28 | 
  <pdhanda> | 
  running maintenance/namespaceDupes.php on frwikiversity | 
  [production] | 
            
  
    | 
      
        2011-06-01
      
      §
     | 
  
    
  | 21:46 | 
  <reedy> | 
  synchronized php-1.17/includes/User.php  'bug 27514 Make unblockself available as a global permission' | 
  [production] | 
            
  | 21:24 | 
  <reedy> | 
  synchronized php-1.17/wmf-config/InitialiseSettings.php  'bug 26319 Enable collection on fawiki. Testing on rtl' | 
  [production] | 
            
  | 21:13 | 
  <reedy> | 
  synchronized php-1.17/wmf-config/CommonSettings.php  'bug 27323 WMF Logo/Button not served via Bits' | 
  [production] | 
            
  | 19:07 | 
  <Ryan_Lane> | 
  switching test.wikipedia.org back to text cname, since it is using a fake cert. (testing was successful) | 
  [production] | 
            
  | 18:47 | 
  <Ryan_Lane> | 
  changing cname for test.wikipedia.org to wikipedia-lb, to test https | 
  [production] | 
            
  | 18:41 | 
  <Ryan_Lane> | 
  changing scheduler for https services from wrr to sh on pmtpa lvs servers. restarting pybal on lvs1 | 
  [production] | 
            
  | 18:38 | 
  <Ryan_Lane> | 
  make that ns1 | 
  [production] | 
            
  | 18:38 | 
  <Ryan_Lane> | 
  restarting pdns on ns2, it locked up after authdns-update | 
  [production] | 
            
  | 18:36 | 
  <Ryan_Lane> | 
  adding wikipedia-lb geodns entry | 
  [production] | 
            
  | 18:30 | 
  <Ryan_Lane> | 
  restarting pybal on amslvs1 | 
  [production] | 
            
  | 18:29 | 
  <Ryan_Lane> | 
  adding wikipedia-lb service to amslvs1 | 
  [production] | 
            
  | 16:11 | 
  <reedy> | 
  synchronized php-1.17/wmf-config/InitialiseSettings.php  'bug 29228' | 
  [production] | 
            
  | 15:43 | 
  <reedy> | 
  synchronized php-1.17/extensions/CentralAuth/SpecialCentralAuth.php  'bug 28767' | 
  [production] | 
            
  | 15:40 | 
  <reedy> | 
  synchronized php-1.17/extensions/CentralAuth/SpecialCentralAuth.php  'bug 28767' | 
  [production] | 
            
  | 14:39 | 
  <Reedy> | 
  Poking at CentralAuth (bug 28767) on testwiki. If things get more broken, it's probably me | 
  [production] | 
            
  | 09:32 | 
  <apergos> | 
  there's a hung tcpdump on amssq37 tht won't die.  it doesn't seem to be doing much but it won't die either (that was me looking at purge issues) | 
  [production] | 
            
  | 08:18 | 
  <thedj> | 
  Cache invalidations issues continue, but squid source unknown atm. | 
  [production] | 
            
  
    | 
      
        2011-05-31
      
      §
     | 
  
    
  | 23:28 | 
  <asher> | 
  synchronized php-1.17/wmf-config/db.php  'removing db7 from rotation' | 
  [production] | 
            
  | 23:19 | 
  <Ryan_Lane> | 
  restarting pybal on lvs1 | 
  [production] | 
            
  | 23:07 | 
  <Ryan_Lane> | 
  adding forward entry for wikipedia-lb, for https testing | 
  [production] | 
            
  | 22:44 | 
  <Ryan_Lane> | 
  restarting pdns on ns0, it's locked up | 
  [production] | 
            
  | 22:43 | 
  <Ryan_Lane> | 
  changing cname for wikimania2005 to wikimedia-lb, for testing https | 
  [production] | 
            
  | 22:37 | 
  <Ryan_Lane> | 
  adding geodns entry for wikimedia-lb | 
  [production] | 
            
  | 22:26 | 
  <Ryan_Lane> | 
  adding wikimedia-lb forward entry for esams | 
  [production] | 
            
  | 21:56 | 
  <Ryan_Lane> | 
  switching wikimania2005 back to text | 
  [production] | 
            
  | 21:45 | 
  <Ryan_Lane> | 
  changing cname of wikimania2005 from text to wikimedia-lb to test https | 
  [production] | 
            
  | 20:51 | 
  <hashar> | 
  wikitech 'ci.tesla: setup a cron for user ci to delete /tmp/mwParser* directories' | 
  [production] | 
            
  | 20:26 | 
  <mark> | 
  Extended LVS prefix lists on csw1-esams and csw2-esams with 91.198.174.224/28 | 
  [production] | 
            
  | 20:25 | 
  <Ryan_Lane> | 
  restarting pybal on lvs1 | 
  [production] | 
            
  | 19:52 | 
  <Ryan_Lane> | 
  updating yvon and gurvin in dns, moving them to the squid-lvs address range | 
  [production] | 
            
  | 19:40 | 
  <Ryan_Lane> | 
  adding wikimedia https service to pybal, and restarting pybal | 
  [production] | 
            
  | 18:47 | 
  <mark> | 
  Disabled (redundant) PIM on csw5-pmtpa:ve3, so only csw1-sdtpa is running PIM now | 
  [production] | 
            
  | 18:20 | 
  <Ryan_Lane> | 
  and restarting apache on it | 
  [production] | 
            
  | 18:20 | 
  <Ryan_Lane> | 
  running sync common on srv186 | 
  [production] | 
            
  | 16:07 | 
  <hashar:> | 
  ci.tesla: was actually out of inodes on /.  /tmp filled with mwParser-...-images directories | 
  [production] | 
            
  | 16:02 | 
  <hashar:> | 
  ci.tesla: restarted cruisecontrol (no space left on device) error. It still has space though! | 
  [production] |