| 
      
        2013-02-22
      
      §
     | 
  
    
  | 22:55 | 
  <Ryan_Lane> | 
  changing dns entry for wikitech-static | 
  [production] | 
            
  | 22:41 | 
  <RobH> | 
  mw110 throwing odd puppet errors, will come back to it later | 
  [production] | 
            
  | 22:41 | 
  <RobH> | 
  sq41 reinstalled, throws endless puppet errors during redeployment | 
  [production] | 
            
  | 22:07 | 
  <MaxSem> | 
  reindexing complete | 
  [production] | 
            
  | 21:39 | 
  <RobH> | 
  harmon and copper online with OS installed for datadumps misc host support | 
  [production] | 
            
  | 21:39 | 
  <MaxSem> | 
  Nuking GeoData Solr index and reindexing | 
  [production] | 
            
  | 21:38 | 
  <maxsem> | 
  synchronized php-1.21wmf9/extensions/GeoData/solrupdate.php  'https://gerrit.wikimedia.org/r/#/c/50388/' | 
  [production] | 
            
  | 21:35 | 
  <maxsem> | 
  synchronized php-1.21wmf10/extensions/GeoData/solrupdate.php  'https://gerrit.wikimedia.org/r/#/c/50388/' | 
  [production] | 
            
  | 21:05 | 
  <RobH> | 
  installing harmon and copper into dump generation misc use | 
  [production] | 
            
  | 20:17 | 
  <olivneh> | 
  synchronized php-1.21wmf9/extensions/GuidedTour/modules/tours/gettingstarted.js  'Resume split test (3/3)' | 
  [production] | 
            
  | 20:16 | 
  <olivneh> | 
  synchronized php-1.21wmf9/extensions/GettingStarted/resources/ext.gettingstarted.js  'Resume split test (2/3)' | 
  [production] | 
            
  | 20:16 | 
  <olivneh> | 
  synchronized php-1.21wmf9/extensions/E3Experiments/experiments/openTask.js  'Resume split test (1/3)' | 
  [production] | 
            
  | 20:14 | 
  <olivneh> | 
  synchronized php-1.21wmf9/extensions/Math  'Updating Math extension to fix db caching behavior (Change-Id: I9b690e55001859c97fd40330272791d49ec6de75)' | 
  [production] | 
            
  | 20:13 | 
  <olivneh> | 
  synchronized php-1.21wmf10/extensions/Math  'Updating Math extension to fix db caching behavior (Change-Id: I9b690e55001859c97fd40330272791d49ec6de75)' | 
  [production] | 
            
  | 20:09 | 
  <RobH> | 
  authdns-update | 
  [production] | 
            
  | 19:58 | 
  <RobH> | 
  sq41 boot order was fubar, fixed, reinstalling (as reboot into installer wiped mbr) | 
  [production] | 
            
  | 19:56 | 
  <RobH> | 
  wtp1002-1004 os installed | 
  [production] | 
            
  | 19:34 | 
  <Jeff_Green> | 
  start mysqldump of otrs database on db49 | 
  [production] | 
            
  | 19:18 | 
  <RobH> | 
  kicked ntpd manually on mw1045 | 
  [production] | 
            
  | 19:09 | 
  <RobH> | 
  sq41 reinstalling | 
  [production] | 
            
  | 18:57 | 
  <RobH> | 
  mw112-125 back into pybal api pool | 
  [production] | 
            
  | 18:56 | 
  <RobH> | 
  mw86-99 & mw111 back into pybal pool | 
  [production] | 
            
  | 18:49 | 
  <robh> | 
  Finished syncing Wikimedia installation... : | 
  [production] | 
            
  | 18:37 | 
  <robh> | 
  Started syncing Wikimedia installation... : | 
  [production] | 
            
  | 17:53 | 
  <sbernardin> | 
  taking down sq41 to replace controller card.... https://rt.wikimedia.org/Ticket/Display.html?id=4550 | 
  [production] | 
            
  | 16:24 | 
  <mutante> | 
  tartupeedia.ee now redirects to et.wp portal page ([[bugzilla:44893|bug 44893]]) | 
  [production] | 
            
  | 16:12 | 
  <mutante> | 
  gracefulling eqiad Apaches via dsh to push tartupeedia.ee redirect ([[bugzilla:44893|bug 44893]]) | 
  [production] | 
            
  | 16:11 | 
  <dzahn> | 
  gracefulled all apaches | 
  [production] | 
            
  | 16:07 | 
  <mutante> | 
  mw110 - sits at partioning screen in installer | 
  [production] | 
            
  | 15:47 | 
  <hashar> | 
  gallium removed live hack in /srv/org/wikimedia/doc/puppetsource/manifests/role/labsmediawiki.pp | 
  [production] | 
            
  | 14:52 | 
  <^demon> | 
  restarted gerrit on manganese, jetty flapping again | 
  [production] | 
            
  | 14:18 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 13:14 | 
  <mark> | 
  Halted ms-be3001-3003 for controller replacement | 
  [production] | 
            
  | 13:11 | 
  <mark> | 
  Halted ms-be3004 for controller replacement | 
  [production] | 
            
  | 13:07 | 
  <mark> | 
  Halted cp3009 for controller replacement | 
  [production] | 
            
  | 12:20 | 
  <mark> | 
  Halted cp3010 for controller replacement | 
  [production] | 
            
  | 11:23 | 
  <mutante> | 
  DNS update - add indiawikipedia.com | 
  [production] | 
            
  | 07:33 | 
  <apergos> | 
  restarted lucene search on search1016 | 
  [production] | 
            
  | 06:49 | 
  <tstarling> | 
  synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 05:33 | 
  <tstarling> | 
  synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 05:33 | 
  <tstarling> | 
  synchronized docroot/bits/favicon/wikipedia.ico | 
  [production] | 
            
  | 05:20 | 
  <tstarling> | 
  synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 05:18 | 
  <tstarling> | 
  synchronized docroot/bits | 
  [production] | 
            
  | 02:53 | 
  <LocalisationUpdate> | 
  completed (1.21wmf9) at Fri Feb 22 02:53:05 UTC 2013 | 
  [production] | 
            
  | 02:29 | 
  <LocalisationUpdate> | 
  completed (1.21wmf10) at Fri Feb 22 02:29:09 UTC 2013 | 
  [production] | 
            
  | 01:57 | 
  <binasher> | 
  migrating wikivoyage and wikidata external blob stores to innodb | 
  [production] | 
            
  | 01:08 | 
  <aaron> | 
  synchronized wmf-config/filebackend.php  'deployed f699c5a9ad2f780dc18863592dcae4a51ba6d841' | 
  [production] |