| 2011-02-16
      
      § | 
    
  | 11:52 | <mark> | Restarted squid-frontend on sq35 | [production] | 
            
  | 11:48 | <RoanKattouw> | Running maintenance/wmf/fixUsabilityPrefs2.php on all wikis | [production] | 
            
  | 11:34 | <tstarling> | synchronized php-1.17/wmf-config/CommonSettings.php  'fix wfGetIP call' | [production] | 
            
  | 11:30 | <Tim> | all wikis -> 1.17 | [production] | 
            
  | 11:19 | <Tim> | enwiki -> 1.17 | [production] | 
            
  | 10:59 | <mark> | Restoring traffic to bits.esams | [production] | 
            
  | 10:42 | <mark> | Moving bits.esams traffic to bits.pmtpa | [production] | 
            
  | 10:36 | <mark> | Installing 2.6.37-12 kernel on knsq4, rebooting | [production] | 
            
  | 10:14 | <mark> | Deploying fix: User-agent sending in Varnish backend checks | [production] | 
            
  | 10:11 | <Tim> | enwiki -> 1.16 | [production] | 
            
  | 10:01 | <Tim> | enwiki -> 1.17 | [production] | 
            
  | 09:18 | <Tim> | whacking canary error moles | [production] | 
            
  | 08:49 | <catrope> | synchronized php-1.17/languages/classes/LanguageEo.php  'Fix cx->cxx problem on Esperanto wikis' | [production] | 
            
  | 08:42 | <Tim> | doubled APC cache size to 240MB | [production] | 
            
  | 08:27 | <apergos> | restarted apache on srv247, was seeing lots of segfaults | [production] | 
            
  | 08:25 | <tstarling> | synchronized php-1.17/wmf-config/CommonSettings.php  're-enable wmerrors' | [production] | 
            
  | 08:23 | <tstarling> | synchronized php-1.17/wmf-config/CommonSettings.php  'disable wmerrors' | [production] | 
            
  | 08:09 | <mark> | Having puppet install screen and gdb on all machines (in base.pp) | [production] | 
            
  | 07:56 | <catrope> | synchronized php-1.17/extensions/FlaggedRevs/FlaggedRevs.php  'Style version' | [production] | 
            
  | 07:55 | <catrope> | synchronized php-1.17/extensions/FlaggedRevs/client/flaggedrevs.css  'Fix for FR RTL issue' | [production] | 
            
  | 07:43 | <demon> | synchronized php-1.17/extensions/FlaggedRevs/specialpages/ProblemChanges_body.php  'Stop fatal' | [production] | 
            
  | 07:40 | <root> | ran sync-common-all | [production] | 
            
  | 07:35 | <demon> | synchronized php-1.17/includes/User.php  'r82222' | [production] | 
            
  | 07:20 | <demon> | synchronized php-1.17/wmf-config/CommonSettings.php  'Turning NewUserMessage back on for 1.17 wikis' | [production] | 
            
  | 07:01 | <Tim> | frwiki -> 1.16 | [production] | 
            
  | 06:51 | <catrope> | synchronized php-1.17/extensions/FlaggedRevs/FlaggedRevs.hooks.php  'Fix FlaggedRevs path bug' | [production] | 
            
  | 06:48 | <Tim> | zhwiki -> 1.17 | [production] | 
            
  | 06:46 | <Tim> | enwiktionary -> 1.17 | [production] | 
            
  | 06:45 | <Tim> | commonswiki -> 1.17 | [production] | 
            
  | 06:43 | <Tim> | jawiki -> 1.17 | [production] | 
            
  | 06:38 | <Tim> | dewiki, frwiki to 1.17 | [production] | 
            
  | 06:30 | <Tim> | nlwiki to 1.17 | [production] | 
            
  | 06:23 | <Tim> | ran sync-common on srv298 | [production] | 
            
  | 06:22 | <Tim> | eowiki to 1.17 | [production] | 
            
  | 06:21 | <mark|coffee> | Cleaned up space on srv219 | [production] | 
            
  | 06:12 | <Tim> | running fixUsabilityPrefs.php | [production] | 
            
  | 02:53 | <Tim> | updated wmerrors in apt to version 1.1.2 | [production] | 
            
  
    | 2011-02-15
      
      § | 
    
  | 22:03 | <RoanKattouw> | Uncommented srv298 in mediawiki-installation node list. Comment says it's not installed, but it's pooled | [production] | 
            
  | 20:59 | <catrope> | synchronized php-1.17/extensions/FlaggedRevs/FlaggedRevs.class.php  'Fix extension path in FlaggedRevs' | [production] | 
            
  | 20:59 | <catrope> | synchronized php-1.17/extensions/FlaggedRevs/FlaggedRevs.php  'Fix extension path in FlaggedRevs' | [production] | 
            
  | 18:58 | <mark> | Singer has a bad HD /dev/sda, marked it as faulty in the RAID1 arrays | [production] | 
            
  | 18:51 | <mark> | powercycled singer | [production] | 
            
  | 14:12 | <mark> | powercycled amssq32 | [production] | 
            
  | 10:25 | <tstarling> | ran sync-common-all | [production] | 
            
  | 10:14 | <Tim> | deploying latest version of 1.17wmf1 to the wikis that use it | [production] | 
            
  | 08:53 | <Tim> | added wmerrors requirement to puppet, with a configuration file that sends logs to UDP on fenari | [production] | 
            
  | 08:38 | <Tim> | set up temporary UDP log receiver for wmerrors on fenari, logging to /var/log/mw/fatal.log | [production] | 
            
  | 07:01 | <Tim> | added package php5-wmerrors to apt, and installed it on srv224 | [production] | 
            
  | 05:24 | <aaron> | synchronized php-1.17/extensions/FlaggedRevs/FlaggedRevs.php  'deployed r82159' | [production] |