| 2012-10-25
      
      § | 
    
  | 14:52 | <cmjohnson1> | shutting down srv194 to replace disk | [production] | 
            
  | 14:05 | <mark> | Sending all non-European upload traffic to eqiad | [production] | 
            
  | 12:01 | <mark> | Sending US upload traffic to eqiad | [production] | 
            
  | 12:01 | <logmsgbot_> | demon synchronized wmf-config/wgConf.php  'Syncing out new prefixes for wikidata/wikivoyage' | [production] | 
            
  | 10:56 | <mark> | Sending Argentina upload traffic to eqiad | [production] | 
            
  | 10:37 | <mark> | Sending Brazil upload traffic to eqiad | [production] | 
            
  | 10:24 | <mark> | Sending Canadian upload traffic to eqiad | [production] | 
            
  | 10:04 | <paravoid> | powercycling nickel, OOM & unable to login | [production] | 
            
  | 09:42 | <mark> | Hacked Nagios back up | [production] | 
            
  | 08:43 | <mark> | Added georecords for wikidata-lb.wikimedia.org and wikivoyage-lb.wikimedia.org, their geomaps containing just a default entry pointing to eqiad | [production] | 
            
  | 08:33 | <mark> | Added LVS service IPs for wikidata and wikivoyage (pmtpa/eqiad) to DNS | [production] | 
            
  | 07:12 | <mark> | Stopping backend squid on sq82, sda I/O errors | [production] | 
            
  | 00:35 | <paravoid> | upgrading oggvideotools to 0.8a on all imagescalers, fixing regression on the lucid->precise upgrade | [production] | 
            
  | 00:27 | <binasher> | deploying updated squid mobile redirector | [production] | 
            
  | 00:24 | <logmsgbot_> | tstarling synchronized wmf-config/CommonSettings.php | [production] | 
            
  
    | 2012-10-24
      
      § | 
    
  | 23:12 | <binasher> | restarting pdns on ns0 | [production] | 
            
  | 23:09 | <cmjohnson1> | db78 loading base OS | [production] | 
            
  | 23:07 | <cmjohnson1> | authdns update adding db78.pmtpa.wmnet | [production] | 
            
  | 22:53 | <cmjohnson1> | authdns changes adding db63-db78 mgmt | [production] | 
            
  | 21:37 | <logmsgbot_> | aaron synchronized php-1.21wmf2/includes/EditPage.php  'deployed 51eede5af0fe0bb28d7abdf81a04292ba8a4864c' | [production] | 
            
  | 20:49 | <logmsgbot_> | demon synchronized php-1.21wmf2/includes/Title.php  'Syncing Ic2d3f0b8' | [production] | 
            
  | 20:44 | <logmsgbot_> | demon synchronized php-1.21wmf2/includes/EditPage.php  'Deploying I4c2055be' | [production] | 
            
  | 19:59 | <logmsgbot_> | dzahn gracefulled all apaches | [production] | 
            
  | 18:49 | <logmsgbot_> | catrope synchronized php-1.21wmf2/includes/upload/UploadStash.php  'rm debugging live hacks' | [production] | 
            
  | 18:46 | <logmsgbot_> | catrope synchronized php-1.21wmf2/includes/upload/UploadStash.php  'Debugging exception' | [production] | 
            
  | 18:44 | <logmsgbot_> | catrope synchronized php-1.21wmf2/includes/upload/UploadStash.php  'Debugging exception' | [production] | 
            
  | 18:39 | <logmsgbot_> | catrope synchronized php-1.21wmf2/includes/upload/UploadStash.php  'Debugging exception' | [production] | 
            
  | 18:17 | <Reedy> | Running sync-common on mw40 | [production] | 
            
  | 18:02 | <logmsgbot_> | reedy rebuilt wikiversions.cdb and synchronized wikiversions files: Everything else to 1.21wmf2 | [production] | 
            
  | 17:53 | <notpeter> | upgrading srv223 and srv224 to precise | [production] | 
            
  | 17:41 | <logmsgbot_> | preilly synchronized php-1.21wmf2/extensions/ZeroRatedMobileAccess  'update post deploy' | [production] | 
            
  | 17:40 | <logmsgbot_> | preilly synchronized php-1.21wmf1/extensions/ZeroRatedMobileAccess  'update post deploy' | [production] | 
            
  | 17:38 | <logmsgbot_> | lcarr synchronized wmf-config/throttle.php  'I updated a throttle' | [production] | 
            
  | 17:26 | <logmsgbot_> | preilly synchronized php-1.21wmf2/extensions/MobileFrontend  'update after deploy' | [production] | 
            
  | 17:25 | <logmsgbot_> | preilly synchronized php-1.21wmf1/extensions/MobileFrontend  'update after deploy' | [production] | 
            
  | 17:21 | <logmsgbot_> | lcarr synchronized wmf-config/throttle.php  'I updated a throttle' | [production] | 
            
  | 17:10 | <cmjohnson1> | db62 loading OS | [production] | 
            
  | 16:15 | <cmjohnson1> | shutting down db61 for rack relocation | [production] | 
            
  | 16:03 | <cmjohnson1> | removing h310 controller from db62 and adding original h700 card | [production] | 
            
  | 14:21 | <notpeter> | upgarding srv221 and srv222 to precise | [production] | 
            
  | 13:39 | <cmjohnson1> | installing base OS on db62 | [production] | 
            
  | 11:56 | <paravoid> | putting ms-fe2 (upgraded to precise/swift 1.7.4) back into the pool | [production] | 
            
  | 05:59 | <logmsgbot_> | tstarling synchronized wmf-config/CommonSettings.php | [production] | 
            
  | 02:48 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf1) at Wed Oct 24 02:48:06 UTC 2012 | [production] | 
            
  | 02:27 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf2) at Wed Oct 24 02:27:30 UTC 2012 | [production] | 
            
  | 00:50 | <logmsgbot_> | maxsem synchronized php-1.21wmf1/extensions/MobileFrontend | [production] | 
            
  | 00:26 | <mutante> | flushing varnish mobile cache | [production] | 
            
  | 00:21 | <logmsgbot_> | maxsem synchronized php-1.21wmf1/extensions/MobileFrontend/ | [production] | 
            
  | 00:18 | <logmsgbot_> | maxsem synchronized php-1.21wmf2/extensions/MobileFrontend/ | [production] | 
            
  | 00:09 | <logmsgbot_> | maxsem Finished syncing Wikimedia installation... : Weekly MobileFrontend and Zero deployment | [production] |