| 2009-12-17
      
      § | 
    
  | 15:52 | <mark> | Killed memcached on browne | [production] | 
            
  | 15:51 | <mark> | Started ircd on browne | [production] | 
            
  | 15:51 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21041: Allow sysops to grant and bcrats to remove transwiki on nowiki' | [production] | 
            
  | 15:46 | <Rob> | browne back online after move. | [production] | 
            
  | 15:46 | <Rob> | nagios synced to node group files without will. | [production] | 
            
  | 15:45 | <Rob> | will decommissioned, pulled from rack | [production] | 
            
  | 15:40 | <Rob> | shutting down browne to move its rack location, will be back online shortly. | [production] | 
            
  | 15:36 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21071: Add patroller and autopatroller groups on hewiki' | [production] | 
            
  | 15:26 | <mark> | Moved udpmcast from browne to dobson | [production] | 
            
  | 13:11 | <mark> | Fixed Racktables rack thumb problem by installing php5-gd; it was just serving cached thumbs | [production] | 
            
  | 11:06 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21306: Allow sysops to add/remove patroller and autopatrol on hrwiki' | [production] | 
            
  | 11:00 | <RoanKattouw> | Running namespaceDueps on mlwiki for bug 21277 | [production] | 
            
  | 10:56 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21277: Add Portal and Portal talk as aliases on mlwiki' | [production] | 
            
  | 10:53 | <RoanKattouw> | Running namespaceDupes.php on cawikibooks for bug 20980 | [production] | 
            
  | 10:53 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 20980: Add Viquiprojecte namespace on cawikibooks' | [production] | 
            
  | 10:47 | <RoanKattouw> | Resyncing srv194 and rebuilding caches | [production] | 
            
  | 10:46 | <domas> | srv194 had 5G-sized oprofile error log, hehe hehehe | [production] | 
            
  | 10:39 | <RoanKattouw> | srv194 disk still full | [production] | 
            
  | 10:39 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21134: Allow sysops to add/remove rollbacker on gawiki' | [production] | 
            
  
    | 2009-12-16
      
      § | 
    
  | 20:41 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'fix mistake' | [production] | 
            
  | 20:32 | <RoanKattouw> | srv194 disk full | [production] | 
            
  | 20:32 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21134: Add rollbacker group on gawiki' | [production] | 
            
  | 19:56 | <andrew> | synchronized php-1.5/extensions/UsabilityInitiative/js/js2/jquery-ui-1.7.2.js  'Deploying r60130' | [production] | 
            
  | 19:55 | <andrew> | synchronized php-1.5/extensions/UsabilityInitiative/js/js2.combined.min.js  'Deploying r60130' | [production] | 
            
  | 19:55 | <andrew> | synchronized php-1.5/extensions/UsabilityInitiative/js/js2.combined.js  'Deploying r60130' | [production] | 
            
  | 19:53 | <fvassard> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'changed groupOvrrides for fiwiki for arbcom.' | [production] | 
            
  | 17:44 | <aaron> | synchronized php-1.5/wmf-config/flaggedrevs.php  'FR labs config - remove excess level' | [production] | 
            
  | 16:36 | <hcatlin> | new and improved mobile with compressed memcached + new homepags + better utf-8 handling | [production] | 
            
  | 16:24 | <hcatlin> | taking down mobile1 for a large software update | [production] | 
            
  | 15:59 | <mark> | Disabled NIS on zwinger | [production] | 
            
  | 15:54 | <mark> | Disabled NIS on ms1 | [production] | 
            
  | 15:53 | <mark> | Disabled NIS on ms4 | [production] | 
            
  | 15:47 | <mark> | Installed puppet on ms1 and ms7 | [production] | 
            
  | 15:27 | <Andrew> | srv129, srv123, srv120, srv95 seem to be in swapdeath | [production] | 
            
  | 15:25 | <andrew> | ran sync-common-all | [production] | 
            
  | 15:24 | <Andrew> | sync-common-all caused memory spike on apaches again, site seems to still be up though | [production] | 
            
  | 15:17 | <Andrew> | Updating LiquidThreads to trunk state, using sync-common-all | [production] | 
            
  | 12:58 | <RoanKattouw> | Tim ran rebuildTemplates.php on hume for all languages | [production] | 
            
  | 12:52 | <Andrew> | test | [production] | 
            
  
    | 2009-12-15
      
      § | 
    
  | 14:23 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21439: Add autopatrolled group on simplewiktionary' | [production] | 
            
  | 14:18 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21571: Allow sysops to add/remove flood flag for all users on simplewiki' | [production] | 
            
  | 14:13 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'bug 21560: Add rollbacker group on cawiki' | [production] | 
            
  | 11:47 | <RoanKattouw> | Fixed three more broken renames on arwiki about 15 mins ago, but morebots doesn't like Arabic usernames :( | [production] | 
            
  | 11:36 | <RoanKattouw> | Fixing broken rename from Mohammed Khalil to MK on arwiki | [production] | 
            
  | 10:23 | <tomaszf> | outage window closed early for payments server. cc pipeline back up | [production] | 
            
  | 03:22 | <tomaszf> | bouncing mobile1 through cluster stop/start script | [production] | 
            
  | 00:16 | <fvassard> | synchronized php-1.5/wmf-config/CommonSettings.php  'Adding Craigs banner and landing page to tracking.' | [production] |