| 2012-02-05
      
      § | 
    
  | 18:29 | <reedy> | synchronized php-1.18/includes/api | [production] | 
            
  | 16:58 | <maplebed> | restarted lsearchd on search6 | [production] | 
            
  | 16:38 | <binasher> | running alter table add column on db1017 enwiki.revision to benchmark | [production] | 
            
  | 16:34 | <asher> | synchronized wmf-config/db.php  'returning db35 to service' | [production] | 
            
  | 14:23 | <reedy> | synchronized php/cache/interwiki.cdb  'Updating interwiki cache' | [production] | 
            
  | 13:10 | <mutante> | stopped and started lsearchd once again on search6 | [production] | 
            
  | 12:51 | <mutante> | restarted lsearchd on search6 | [production] | 
            
  | 02:25 | <LocalisationUpdate> | completed (1.18) at Sun Feb  5 02:25:51 UTC 2012 | [production] | 
            
  | 02:11 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'touch' | [production] | 
            
  
    | 2012-02-03
      
      § | 
    
  | 23:59 | <LeslieCarr> | applying loopback filter on cr1-sdtpa | [production] | 
            
  | 23:21 | <binasher> | timing the same operation as a normal alter on db1005. expect db lag to get backed up by hours | [production] | 
            
  | 23:16 | <binasher> | testing and timing pt-online-schema change to dewiki.revision on db1021 (not in rotation) | [production] | 
            
  | 23:07 | <LeslieCarr> | applying loopback filter on cr2-eqiad | [production] | 
            
  | 23:06 | <binasher> | upgrading percona-toolkit to 2.02 on all coredbs | [production] | 
            
  | 22:43 | <asher> | synchronized wmf-config/db.php  'returning db33, 39, 46 to prod' | [production] | 
            
  | 22:39 | <binasher> | db35 had an iblogfile size inconsistent with other s5 hosts. streaming a hotbacking of db1034 to db35 | [production] | 
            
  | 22:23 | <binasher> | rebooted db35, db39 | [production] | 
            
  | 21:55 | <asher> | synchronized wmf-config/db.php  'pulling db35, 39, 46 for upgrades' | [production] | 
            
  | 20:52 | <K4-713> | updated production civicrm to [[rev:1295|r1295]] | [production] | 
            
  | 20:45 | <asher> | synchronized wmf-config/db.php  'adding back dbs 13,18,25' | [production] | 
            
  | 20:32 | <binasher> | upgraded mysql on dbs 13,18,25,33 | [production] | 
            
  | 20:17 | <reedy> | synchronized php-1.18/extensions/SpamBlacklist/SpamBlacklist_body.php  '[[rev:110682|r110682]]' | [production] | 
            
  | 19:23 | <asher> | synchronized wmf-config/db.php  'pulling dbs 13,18,25,26 for upgrades' | [production] | 
            
  | 19:11 | <RobH> | manutius installed and ready for use | [production] | 
            
  | 17:26 | <RobH> | updated dns for manutius.mgmt | [production] | 
            
  | 17:15 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'touch' | [production] | 
            
  | 17:11 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'touch' | [production] | 
            
  | 16:08 | <RobH> | db41 being reinstalled, appears down but logging to be safe | [production] | 
            
  | 15:20 | <mark> | Around 14:50 UTC, removed the 3 remaining esams upload squids in the knsq8-15 range from the config. This made ms5 unhappy. | [production] | 
            
  | 15:13 | <reedy> | synchronized wmf-config/db.php  'Add comment that db40 is parsercache' | [production] | 
            
  | 13:53 | <mutante> | resetting stats on new wikis per bz 34184: updateArticleCount.php vepwiki --update; updateArticleCount.php pnbwiktionary --update | [production] | 
            
  | 13:42 | <mark> | Disabled knsq1-15 in PyBal, preparing for decommissioning | [production] | 
            
  | 03:53 | <maplebed> | moved all the individual puppet files out of place, stopped nagios, and re-ran puppet (at now minus 1.5hrs) | [production] | 
            
  | 02:24 | <LocalisationUpdate> | completed (1.18) at Fri Feb  3 02:24:54 UTC 2012 | [production] | 
            
  | 00:57 | <K4-713> | re-enabled the donations queue consumer via Jenkins | [production] | 
            
  | 00:42 | <K4-713> | updated production civicrm to [[rev:1293|r1293]] | [production] | 
            
  | 00:23 | <asher> | synchronized wmf-config/db.php  'moving watchlist/recentchanges back to db12, returning db24 to s2' | [production] | 
            
  | 00:09 | <K4-713> | Disabled donations queue consumption on aluminium | [production] |