| 
      
        2010-06-02
      
      §
     | 
  
    
  | 19:59 | 
  <Rob> | 
  had to swap power cable on msw-b5-sdtpa | 
  [production] | 
            
  | 14:02 | 
  <Rob> | 
  stay off db28, fixing its firmware. | 
  [production] | 
            
  | 13:44 | 
  <andrew> | 
  synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php  | 
  [production] | 
            
  | 13:39 | 
  <andrew> | 
  synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php  | 
  [production] | 
            
  | 13:38 | 
  <Tim> | 
  ArchRunner on lily was stuck in a busy loop of some kind, had to restart it with kill -9 | 
  [production] | 
            
  | 13:36 | 
  <andrew> | 
  synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php  | 
  [production] | 
            
  | 13:35 | 
  <andrew> | 
  synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php  | 
  [production] | 
            
  | 13:32 | 
  <andrew> | 
  synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php  | 
  [production] | 
            
  | 13:32 | 
  <andrew> | 
  synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ParserFunctions.php  | 
  [production] | 
            
  | 13:31 | 
  <andrew> | 
  synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy.i18n.php  | 
  [production] | 
            
  | 13:31 | 
  <andrew> | 
  synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy.php  | 
  [production] | 
            
  | 06:49 | 
  <tstarling> | 
  synchronized php-1.5/extensions/CodeReview/backend/Subversion.php  'r67213' | 
  [production] | 
            
  | 06:45 | 
  <Tim> | 
  updated codereview-proxy on isidore to r67211 | 
  [production] | 
            
  | 06:13 | 
  <Tim> | 
  attempting to set up CodeReview for pywikipedia | 
  [production] | 
            
  | 05:48 | 
  <jeluf> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  '23705 - Change namespaces in ja.wikipedia' | 
  [production] | 
            
  | 05:33 | 
  <jeluf> | 
  synchronized php-1.5/wmf-config/flaggedrevs.php  '23742 -  make category namespace flaggable on en.wikinews' | 
  [production] | 
            
  | 05:29 | 
  <jeluf> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  '23572 - Imagemap cannot accept dynamic links.' | 
  [production] | 
            
  
    | 
      
        2010-06-01
      
      §
     | 
  
    
  | 23:10 | 
  <Fred> | 
  mobile2 re-installed and puppetized | 
  [production] | 
            
  | 22:44 | 
  <Fred> | 
  re-imaging mobile2 for total lucid puppetization. | 
  [production] | 
            
  | 20:17 | 
  <Rob> | 
  mobile1 decided no more ssh server, its reinstalled and defined in puppet so it is ok now. | 
  [production] | 
            
  | 19:42 | 
  <catrope> | 
  synchronized php-1.5/languages/messages/MessagesCkb_arab.php  'r67198' | 
  [production] | 
            
  | 14:26 | 
  <catrope> | 
  synchronized php-1.5/extensions/CategoryTree/CategoryTreeFunctions.php  'r67183' | 
  [production] | 
            
  | 14:10 | 
  <domas> | 
  livehacked the CategoryTreeFunctions.php to fix a fatal error :) | 
  [production] | 
            
  | 14:09 | 
  <midom> | 
  synchronized php-1.5/extensions/CategoryTree/CategoryTreeFunctions.php  | 
  [production] | 
            
  | 12:02 | 
  <tstarling> | 
  synchronizing Wikimedia installation... Revision: 66620 | 
  [production] | 
            
  | 12:01 | 
  <Tim> | 
  updating CategoryTree to r67181 | 
  [production] | 
            
  | 05:56 | 
  <midom> | 
  synchronized php-1.5/includes/db/Database.php  | 
  [production] | 
            
  | 05:52 | 
  <midom> | 
  synchronized php-1.5/extensions/CategoryTree/CategoryTreeFunctions.php  | 
  [production] | 
            
  
    | 
      
        2010-05-31
      
      §
     | 
  
    
  | 20:45 | 
  <jeluf> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  '23646 - Flagged Revisions on Tamil Wikinews (ta.wikinews.org)' | 
  [production] | 
            
  | 20:44 | 
  <jeluf> | 
  synchronized flaggedrevs.dblist  | 
  [production] | 
            
  | 20:39 | 
  <jeluf> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  '23705 -  Change namespaces in ja.wikipedia' | 
  [production] | 
            
  | 19:52 | 
  <jeluf> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  '23728 - Local time for Croatian Wiktionary' | 
  [production] | 
            
  | 19:45 | 
  <JeLuF> | 
  sync-apache doesn't update /etc/apache2/apache2.conf on all hosts, two different versions are currently in use. Probably due to missing /home NFS mount on some apaches | 
  [production] | 
            
  | 19:17 | 
  <jeluf> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  '23737 - Enabling extension AbuseFilter for Upper Sorbian and Lower Sorbian Wikipedia' | 
  [production] | 
            
  | 19:13 | 
  <jeluf> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  '15063 - wpSpamRegex entry for large image tables' | 
  [production] | 
            
  | 19:08 | 
  <jeluf> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  '23728 - Local time for Croatian Wiktionary' | 
  [production] | 
            
  | 09:36 | 
  <catrope> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'Enable $wgEnotifWatchlist on outreachwiki' | 
  [production] | 
            
  | 06:57 | 
  <Tim> | 
  installed NRPE on db22 | 
  [production] | 
            
  | 06:53 | 
  <Tim> | 
  installed NRPE on db14 | 
  [production] | 
            
  | 06:51 | 
  <Tim> | 
  installed NRPE on db16 | 
  [production] | 
            
  | 06:24 | 
  <Tim> | 
  db16 has the same problem, killed 6 times today, taking the same action (27GB to 24GB) | 
  [production] | 
            
  | 06:16 | 
  <Tim> | 
  mysql on db14 has been killed 4 times today by the OOM killer, reducing innodb_buffer_pool_size from 28GB to 24GB | 
  [production] | 
            
  | 06:13 | 
  <Tim> | 
  mysql on db14 killed by kernel OOM killer, recovered without intervention | 
  [production] |