| 2012-01-10
      
      § | 
    
  | 23:58 | <preilly> | weekly mobile frontend push | [production] | 
            
  | 23:58 | <preilly> | synchronized php-1.18/extensions/MobileFrontend/  'weekly update to mobile frontend' | [production] | 
            
  | 22:10 | <lcarr> | broke ganglia redirect on nickel, fixing with next push | [production] | 
            
  | 19:45 | <LeslieCarr> | stopping gmetad on spence and unmounting the tmpfs drive | [production] | 
            
  | 18:32 | <LeslieCarr> | restarting gmetad on nickel | [production] | 
            
  | 11:39 | <nikerabbit> | synchronized php-1.18/extensions/Translate/MessageGroups.php  'Translate bugfix [[rev:108500|r108500]]' | [production] | 
            
  | 07:20 | <nikerabbit> | synchronized php-1.18/extensions/Translate/TranslateEditAddons.php  '[[rev:108497|r108497]]' | [production] | 
            
  | 02:05 | <LocalisationUpdate> | completed (1.18) at Tue Jan 10 02:05:15 UTC 2012 | [production] | 
            
  | 01:31 | <binasher> | all varnish servers have been upgraded to 3.0.2 | [production] | 
            
  | 00:38 | <RobH> | db1004 pd8 set to offline per rt 2140, will place call to dell for replacement | [production] | 
            
  | 00:23 | <RobH> | correction for typo, mw1102, not mw1002 | [production] | 
            
  | 00:23 | <binasher> | repooled cp3002 | [production] | 
            
  | 00:23 | <RobH> | mw1002 coming down for hw testing rt 1656 | [production] | 
            
  | 00:19 | <binasher> | depooling cp3002, upgrading varnish | [production] | 
            
  
    | 2012-01-09
      
      § | 
    
  | 23:57 | <binasher> | testing varnish 3.0.2 upgrade on cp3001 (bits) | [production] | 
            
  | 23:42 | <binasher> | adding two new mobile cache servers running varnish 3.0.2 (cp104[12]) to the m.wiki eqiad vip | [production] | 
            
  | 22:26 | <LeslieCarr> | ganglia moved to new nickel server | [production] | 
            
  | 21:36 | <LeslieCarr> | changing gmond source for ganglia3-tip | [production] | 
            
  | 21:19 | <RobH> | snapshot1001-1004 mgmt online | [production] | 
            
  | 21:05 | <RobH> | updating dns with snapshot1001-1004 primary ip info | [production] | 
            
  | 20:56 | <RobH> | updating dns with snapshot1001-1004 mgmt | [production] | 
            
  | 20:30 | <catrope> | synchronized php-1.18/extensions/ArticleFeedbackv5/modules/jquery.articleFeedbackv5/jquery.articleFeedbackv5.js  '[[rev:108470|r108470]]' | [production] | 
            
  | 20:29 | <catrope> | synchronized php-1.18/extensions/ArticleFeedbackv5/api/ApiArticleFeedbackv5.php  '[[rev:108470|r108470]]' | [production] | 
            
  | 20:25 | <LeslieCarr> | replacing the ops@ alias with the new ops list on mchenry as people keep forgetting to email the new list | [production] | 
            
  | 19:57 | <nikerabbit> | synchronized php-1.18/extensions/Translate/Translate.php  'Deploy [[rev:108469|r108469]] - bugfix for Translate' | [production] | 
            
  | 19:43 | <RobH> | torrus dead, kicking | [production] | 
            
  | 19:32 | <nikerabbit> | synchronized wmf-config/CommonSettings.php  'Updating Translate config 2/2' | [production] | 
            
  | 19:32 | <nikerabbit> | synchronized wmf-config/InitialiseSettings.php  'Updating Translate config 1/2' | [production] | 
            
  | 19:16 | <nikerabbit> | synchronized php-1.18/includes/parser/Parser.php  'Deploying [[rev:108461|r108461]]' | [production] | 
            
  | 19:07 | <catrope> | synchronized php-1.18/extensions/UploadWizard/resources/mw.UploadWizardLicenseInput.js  '[[rev:108459|r108459]]' | [production] | 
            
  | 18:55 | <nikerabbit> | synchronized php-1.18/extensions/Translate/  'Deploying translate [[rev:108451|r108451]]' | [production] | 
            
  | 18:54 | <nikerabbit> | synchronized php-1.18/languages/messages/MessagesEn.php  'Updating messagesEn' | [production] | 
            
  | 18:42 | <nikerabbit> | synchronized php-1.18/extensions/ParserFunctions/ParserFunctions.i18n.magic.php  'Deploying [[rev:108449|r108449]]' | [production] | 
            
  | 18:34 | <nikerabbit> | synchronized php-1.18/extensions/WikimediaMessages/WikimediaGrammarForms.php  'Deploying [[rev:108433|r108433]]' | [production] | 
            
  | 18:30 | <nikerabbit> | synchronized p/extensions/WebFonts/  'Updating WebFonts [[rev:108447|r108447]]' | [production] | 
            
  | 18:21 | <nikerabbit> | synchronized php-1.18/extensions/Narayam/  'Syncing Narayam' | [production] | 
            
  | 18:18 | <Nikerabbit> | running Narayam preference migration script | [production] | 
            
  | 17:30 | <jeremyb> | the time is now 17:30:30 UTC | [production] | 
            
  | 17:20 | <RoanKattouw> | Installing (!) NTP on wikitech | [production] | 
            
  | 17:16 | <jeremyb> | the time is now 17:19:30 UTC | [production] | 
            
  | 02:01 | <LocalisationUpdate> | completed (1.18) at Mon Jan  9 02:04:47 UTC 2012 | [production] | 
            
  
    | 2012-01-08
      
      § | 
    
  | 23:20 | <Reedy> | For some reason cp1001-10042 weren't listed in CommonSettings.php XFF, but (at least) 1042 was in service, meaning edits were attributed to it | [production] | 
            
  | 23:18 | <reedy> | synchronized wmf-config/CommonSettings.php  'Add cp1001-cp1041' | [production] | 
            
  | 23:10 | <reedy> | synchronized wmf-config/CommonSettings.php  'Add cp1042 to XFF' | [production] | 
            
  | 21:47 | <rainman-sr> | killed broken search indexer thread on searchidx1 (please note searchidx1 is no longer in use!), and restarted incremental indexing on searchidx2 which was somehow broken | [production] | 
            
  | 21:43 | <rainman-sr> | someone started incremental updating on searchidx1 ??!! | [production] | 
            
  | 14:54 | <apergos> | removed old puppet lockfile on brewster, ran by hand | [production] | 
            
  | 14:47 | <apergos> | cleared out some very large squid logs on brewster, (basically all of them) plus lighty logs, disk was full. restarted squid manually | [production] | 
            
  | 02:01 | <LocalisationUpdate> | completed (1.18) at Sun Jan  8 02:05:11 UTC 2012 | [production] |