| 2013-02-22
      
      ยง | 
    
  | 23:59 | <RobH> | argon is shut down now | [production] | 
            
  | 23:55 | <RobH> | argon is going offline, killing our limesurvey install | [production] | 
            
  | 23:29 | <paravoid> | deploying squid config for upload's new transcoded container | [production] | 
            
  | 23:26 | <paravoid> | deploying squid | [production] | 
            
  | 22:55 | <Ryan_Lane> | changing dns entry for wikitech-static | [production] | 
            
  | 22:41 | <RobH> | mw110 throwing odd puppet errors, will come back to it later | [production] | 
            
  | 22:41 | <RobH> | sq41 reinstalled, throws endless puppet errors during redeployment | [production] | 
            
  | 22:07 | <MaxSem> | reindexing complete | [production] | 
            
  | 21:39 | <RobH> | harmon and copper online with OS installed for datadumps misc host support | [production] | 
            
  | 21:39 | <MaxSem> | Nuking GeoData Solr index and reindexing | [production] | 
            
  | 21:38 | <maxsem> | synchronized php-1.21wmf9/extensions/GeoData/solrupdate.php  'https://gerrit.wikimedia.org/r/#/c/50388/' | [production] | 
            
  | 21:35 | <maxsem> | synchronized php-1.21wmf10/extensions/GeoData/solrupdate.php  'https://gerrit.wikimedia.org/r/#/c/50388/' | [production] | 
            
  | 21:05 | <RobH> | installing harmon and copper into dump generation misc use | [production] | 
            
  | 20:17 | <olivneh> | synchronized php-1.21wmf9/extensions/GuidedTour/modules/tours/gettingstarted.js  'Resume split test (3/3)' | [production] | 
            
  | 20:16 | <olivneh> | synchronized php-1.21wmf9/extensions/GettingStarted/resources/ext.gettingstarted.js  'Resume split test (2/3)' | [production] | 
            
  | 20:16 | <olivneh> | synchronized php-1.21wmf9/extensions/E3Experiments/experiments/openTask.js  'Resume split test (1/3)' | [production] | 
            
  | 20:14 | <olivneh> | synchronized php-1.21wmf9/extensions/Math  'Updating Math extension to fix db caching behavior (Change-Id: I9b690e55001859c97fd40330272791d49ec6de75)' | [production] | 
            
  | 20:13 | <olivneh> | synchronized php-1.21wmf10/extensions/Math  'Updating Math extension to fix db caching behavior (Change-Id: I9b690e55001859c97fd40330272791d49ec6de75)' | [production] | 
            
  | 20:09 | <RobH> | authdns-update | [production] | 
            
  | 19:58 | <RobH> | sq41 boot order was fubar, fixed, reinstalling (as reboot into installer wiped mbr) | [production] | 
            
  | 19:56 | <RobH> | wtp1002-1004 os installed | [production] | 
            
  | 19:34 | <Jeff_Green> | start mysqldump of otrs database on db49 | [production] | 
            
  | 19:18 | <RobH> | kicked ntpd manually on mw1045 | [production] | 
            
  | 19:09 | <RobH> | sq41 reinstalling | [production] | 
            
  | 18:57 | <RobH> | mw112-125 back into pybal api pool | [production] | 
            
  | 18:56 | <RobH> | mw86-99 & mw111 back into pybal pool | [production] | 
            
  | 18:49 | <robh> | Finished syncing Wikimedia installation... : | [production] | 
            
  | 18:37 | <robh> | Started syncing Wikimedia installation... : | [production] | 
            
  | 17:53 | <sbernardin> | taking down sq41 to replace controller card.... https://rt.wikimedia.org/Ticket/Display.html?id=4550 | [production] | 
            
  | 16:24 | <mutante> | tartupeedia.ee now redirects to et.wp portal page ([[bugzilla:44893|bug 44893]]) | [production] | 
            
  | 16:12 | <mutante> | gracefulling eqiad Apaches via dsh to push tartupeedia.ee redirect ([[bugzilla:44893|bug 44893]]) | [production] | 
            
  | 16:11 | <dzahn> | gracefulled all apaches | [production] | 
            
  | 16:07 | <mutante> | mw110 - sits at partioning screen in installer | [production] | 
            
  | 15:47 | <hashar> | gallium removed live hack in /srv/org/wikimedia/doc/puppetsource/manifests/role/labsmediawiki.pp | [production] | 
            
  | 14:52 | <^demon> | restarted gerrit on manganese, jetty flapping again | [production] | 
            
  | 14:18 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 13:14 | <mark> | Halted ms-be3001-3003 for controller replacement | [production] | 
            
  | 13:11 | <mark> | Halted ms-be3004 for controller replacement | [production] | 
            
  | 13:07 | <mark> | Halted cp3009 for controller replacement | [production] | 
            
  | 12:20 | <mark> | Halted cp3010 for controller replacement | [production] | 
            
  | 11:23 | <mutante> | DNS update - add indiawikipedia.com | [production] | 
            
  | 07:33 | <apergos> | restarted lucene search on search1016 | [production] | 
            
  | 06:49 | <tstarling> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 05:33 | <tstarling> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 05:33 | <tstarling> | synchronized docroot/bits/favicon/wikipedia.ico | [production] | 
            
  | 05:20 | <tstarling> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 05:18 | <tstarling> | synchronized docroot/bits | [production] | 
            
  | 02:53 | <LocalisationUpdate> | completed (1.21wmf9) at Fri Feb 22 02:53:05 UTC 2013 | [production] | 
            
  | 02:29 | <LocalisationUpdate> | completed (1.21wmf10) at Fri Feb 22 02:29:09 UTC 2013 | [production] | 
            
  | 01:57 | <binasher> | migrating wikivoyage and wikidata external blob stores to innodb | [production] |