| 2012-08-16
      
      § | 
    
  | 23:39 | <Tim> | on fluorine: chown'd log files and restarted udp2log to get new uid | [production] | 
            
  | 23:39 | <binasher> | reslaved es1002 after conversion to innodb | [production] | 
            
  | 23:31 | <olivneh> | synchronized php-1.20wmf9/extensions/E3Experiments/Experiments.hooks.php | [production] | 
            
  | 23:26 | <mutante> | fix date/NTP on sq36 | [production] | 
            
  | 23:14 | <kaldari> | Finished syncing Wikimedia installation... : | [production] | 
            
  | 23:12 | <mutante> | killing nagios-wm. it stopped talking even though stuff gets written to --infile | [production] | 
            
  | 22:51 | <kaldari> | Started syncing Wikimedia installation... : | [production] | 
            
  | 22:25 | <preilly> | Finished syncing Wikimedia installation... : update mobile frontend | [production] | 
            
  | 22:04 | <preilly> | Started syncing Wikimedia installation... : update mobile frontend | [production] | 
            
  | 22:03 | <notpeter> | restarting puppet on nfs1/2 | [production] | 
            
  | 21:54 | <notpeter> | restarting puppet on locke | [production] | 
            
  | 21:51 | <notpeter> | restarting puppet on emery | [production] | 
            
  | 21:39 | <notpeter> | restarting puppet on oxygen | [production] | 
            
  | 21:37 | <cmjohnson1> | shutting ms-be6 down for hardware testing/replacing | [production] | 
            
  | 21:27 | <notpeter> | stopping puppet on nfs2 and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet | [production] | 
            
  | 21:20 | <notpeter> | stopping puppet on nfs1 and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet | [production] | 
            
  | 21:12 | <maplebed> | ms-be6 down for bad disk repair | [production] | 
            
  | 20:58 | <Ryan_Lane> | attempting to upgrade virt1000 to precise | [production] | 
            
  | 20:47 | <cmjohnson1> | ms-be6 shutting down to replace 2 disks | [production] | 
            
  | 20:38 | <notpeter> | stopping puppet on locke and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet | [production] | 
            
  | 20:12 | <RobH> | ms-be1004 is ready to be installed into service | [production] | 
            
  | 19:57 | <RobH> | ms-be1004 down for ssd install | [production] | 
            
  | 19:44 | <notpeter> | stopping puppet on emery and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet | [production] | 
            
  | 19:34 | <aaron> | synchronized wmf-config/filebackend.php  'Set $readFromSwiftShared = true;' | [production] | 
            
  | 19:31 | <aaron> | synchronized wmf-config/filebackend.php | [production] | 
            
  | 19:29 | <notpeter> | stopping puppet on oxygen and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet | [production] | 
            
  | 19:23 | <aaron> | synchronized wmf-config/filebackend.php | [production] | 
            
  | 19:17 | <binasher> | running purgeParserCache.php again | [production] | 
            
  | 19:05 | <RobH> | puppet restarted on brewster | [production] | 
            
  | 18:58 | <aaron> | synchronized wmf-config/filebackend.php  'Fixed container mapping for shared repo' | [production] | 
            
  | 18:28 | <aaron> | synchronized wmf-config/filebackend.php  'Use NFS for reads for shared-multiwrite' | [production] | 
            
  | 18:14 | <aaron> | synchronized wmf-config/swift.php  'Disabled redundant thumb copy/purge hooks.' | [production] | 
            
  | 18:01 | <RobH> | authdns-update for new es1005-1010 | [production] | 
            
  | 17:59 | <aaron> | synchronized wmf-config/filebackend.php  'Make internal reads come from swift for all wikis' | [production] | 
            
  | 17:50 | <apergos> | powercycled ms-be3 ... in theory | [production] | 
            
  | 16:52 | <cmjohnson1> | shutting down mw18 and mw19 to replace DIMM | [production] | 
            
  | 16:29 | <ottomata> | Stopping puppet on brewster again. Sigh.  PARTMAAAAN! | [production] | 
            
  | 16:22 | <reedy> | synchronized php-1.20wmf9/includes/QueryPage.php | [production] | 
            
  | 16:07 | <cmjohnson1> | shutting down mw8 to replace bad DIMM | [production] | 
            
  | 15:59 | <ottomata> | starting puppet on brewster.  (Woo, partman looking better!) | [production] | 
            
  | 14:15 | <ottomata> | stopping puppet on brewster to continue partman troubleshooting for analytics dells | [production] | 
            
  | 13:26 | <mark> | Enabled and started SIS deduplication on home_pmtpa on nas1-a | [production] | 
            
  | 12:05 | <mark> | Removed OSPF metric on xe-5/2/1.0 on cr2-eqiad, to move eqiad->pmtpa traffic to the lower latency link | [production] |