| 2012-11-30
      
      § | 
    
  | 18:50 | <cmjohnson1> | analytics1007 troubleshooting hdd/pxe boot issue (going to power cycle several times) | [production] | 
            
  | 18:21 | <RobH> | authdns-update to add wtp1001 info to dns | [production] | 
            
  | 03:18 | <K4-713> | updated payments cluster to 4c15a56c46bf52a | [production] | 
            
  | 02:49 | <LocalisationUpdate> | completed (1.21wmf4) at Fri Nov 30 02:49:43 UTC 2012 | [production] | 
            
  | 02:26 | <LocalisationUpdate> | completed (1.21wmf5) at Fri Nov 30 02:26:44 UTC 2012 | [production] | 
            
  | 01:40 | <olivneh> | synchronized php-1.21wmf5/extensions/EventLogging/content/JsonSchemaHooks.php | [production] | 
            
  | 01:14 | <py> | synchronized wmf-config/db.php  's7: db26 out, db68 in, db56 lower weight' | [production] | 
            
  | 00:27 | <olivneh> | Finished syncing Wikimedia installation... : | [production] | 
            
  | 00:16 | <aaron> | synchronized wmf-config/InitialiseSettings.php  'LST for test2wiki' | [production] | 
            
  
    | 2012-11-29
      
      § | 
    
  | 23:51 | <dzahn> | gracefulled all apaches | [production] | 
            
  | 23:35 | <olivneh> | Started syncing Wikimedia installation... : | [production] | 
            
  | 23:32 | <dzahn> | gracefulled all apaches | [production] | 
            
  | 23:20 | <olivneh> | synchronized php-1.21wmf5/extensions/EventLogging | [production] | 
            
  | 23:16 | <spage> | synchronized php-1.21wmf4/extensions/E3Experiments  'E3 deploy ACUX at 100%' | [production] | 
            
  | 23:15 | <mutante> | DNS update - add wikivoyage.com | [production] | 
            
  | 22:58 | <notpeter> | restarting incremental indexer on searchidx2 | [production] | 
            
  | 22:56 | <kaldari> | synchronized php-1.21wmf5/extensions/UploadWizard/resources/mw.UploadWizardDetails.js  'resyncing UploadWizard patch from yesterday' | [production] | 
            
  | 22:45 | <olivneh> | synchronized wmf-config/InitialiseSettings.php  'Enabling EventLogging on metawiki' | [production] | 
            
  | 22:44 | <olivneh> | synchronized wmf-config/CommonSettings.php  'Updating configuration of EventLogging' | [production] | 
            
  | 22:38 | <olivneh> | synchronized php-1.21wmf4/extensions/EventLogging/modules/ext.EventLogging.js | [production] | 
            
  | 22:15 | <notpeter> | starting innobackup from db1041 to db68 (s7) | [production] | 
            
  | 21:48 | <asher> | synchronized wmf-config/db.php  'pooling db66 as a new s3 slave' | [production] | 
            
  | 21:27 | <mutante> | old swift logs on iron, some rm'ed, some gzipped, archiving ben's home contents on tridge, clean up iron | [production] | 
            
  | 19:49 | <demon> | rebuilt wikiversions.cdb and synchronized wikiversions files: itwikisource back to 1.21wmf4 | [production] | 
            
  | 19:48 | <mutante> | installing package upgrades on iron | [production] | 
            
  | 19:41 | <mutante> | removing mysql server from iron | [production] | 
            
  | 19:29 | <RobH> | authdns-update to add dns for tin | [production] | 
            
  | 19:25 | <demon> | synchronized php-1.21wmf5/extensions/LabeledSectionTransclusion/  'Updating LST to master' | [production] | 
            
  | 19:22 | <demon> | synchronized wmf-config/InitialiseSettings.php  'TemplateSandbox on all wikis' | [production] | 
            
  | 19:21 | <demon> | synchronized wmf-config/CommonSettings.php  'TemplateSandbox on all wikis' | [production] | 
            
  | 18:13 | <aaron> | synchronized wmf-config/PrivateSettings.php  'Set Swift auth URL to the IP address host.' | [production] | 
            
  | 17:30 | <cmjohnson1> | es1004 has raid error...power cycling to enter raid bios | [production] | 
            
  | 15:37 | <cmjohnson1> | provisioning labsdb1002 | [production] | 
            
  | 14:37 | <cmjohnson1> | provisioning labsdb1001 | [production] | 
            
  | 06:09 | <Tim> | fixing searchidx2 by increasing RMI timeout | [production] | 
            
  | 02:45 | <LocalisationUpdate> | completed (1.21wmf4) at Thu Nov 29 02:45:27 UTC 2012 | [production] | 
            
  | 02:24 | <LocalisationUpdate> | completed (1.21wmf5) at Thu Nov 29 02:24:32 UTC 2012 | [production] | 
            
  | 00:48 | <pgehres> | synchronized php-1.21wmf4/extensions/CentralNotice/  'Updating CentralNotice to master to hide banners on mobile devices' | [production] | 
            
  | 00:45 | <pgehres> | synchronized php-1.21wmf5/extensions/CentralNotice/  'Updating CentralNotice to master to hide banners on mobile devices' | [production] | 
            
  | 00:12 | <Tim> | uploaded new lucene-search-2 with fixed init script, will upgrade it on the search servers | [production] | 
            
  
    | 2012-11-28
      
      § | 
    
  | 23:30 | <kaldari> | synchronized php-1.21wmf5/skins/vector/screen.css  'updating vector skin' | [production] | 
            
  | 23:30 | <kaldari> | synchronized php-1.21wmf5/skins/modern/main.css  'updating modern skin' | [production] | 
            
  | 23:29 | <kaldari> | synchronized php-1.21wmf5/extensions/Vector/modules/ext.vector.collapsibleNav.css  'adding forward-compat to Vector for [[bugzilla:42452|bug 42452]]' | [production] | 
            
  | 22:59 | <demon> | rebuilt wikiversions.cdb and synchronized wikiversions files: Moving all non-pedias back to wmf5 | [production] | 
            
  | 22:46 | <cmjohnson1> | running authdns update | [production] | 
            
  | 22:45 | <cmjohnson1> | adding DNS entry labsdb1001/1002 .eqiad.wmnet | [production] | 
            
  | 22:41 | <demon> | rebuilt wikiversions.cdb and synchronized wikiversions files: metawiki to wmf5 | [production] | 
            
  | 22:34 | <demon> | rebuilt wikiversions.cdb and synchronized wikiversions files: Rolling wikiversions.dat back to de90c27d, undoing todays deploy | [production] | 
            
  | 22:18 | <aaron> | synchronized php-1.21wmf4/extensions/SwiftCloudFiles | [production] | 
            
  | 22:01 | <Ryan_Lane> | disabled page counters on labsconsole | [production] |