| 
      
        2012-06-13
      
      §
     | 
  
    
  | 14:46 | 
  <Ryan_Lane> | 
  lowering ttl for virt0 | 
  [production] | 
            
  | 14:17 | 
  <Jeff_Green> | 
  storage3 dist-upgrade and reboot | 
  [production] | 
            
  | 12:31 | 
  <mutante> | 
  backing up wikitech dir locally on linode instance | 
  [production] | 
            
  | 09:24 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config/InitialiseSettings.php  '([[bugzilla:37482|bug 37482]]) Adding Proofread Page ext. namespaces on nl.wikisource' | 
  [production] | 
            
  | 09:08 | 
  <hashar> | 
  finished deploying my wmflabs related change. mediawiki-config is now at commit c0baf3e | 
  [production] | 
            
  | 09:07 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config  | 
  [production] | 
            
  | 09:06 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config/InitialiseSettings-wmflabs.php  | 
  [production] | 
            
  | 09:05 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config/throttle.php  | 
  [production] | 
            
  | 09:05 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config/mobile-wmflabs.php  | 
  [production] | 
            
  | 09:05 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config/mobile.php  | 
  [production] | 
            
  | 08:47 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config/InitialiseSettings.php  '[[bugzilla:37006|bug 37006]] - fawiki: add Book namespace + aliases' | 
  [production] | 
            
  | 08:45 | 
  <hashar> | 
  reverted  '([[bugzilla:37482|bug 37482]]) Adding Proofread Page ext. namespaces on nl.wikisource'  --> used the wrong configuration setting. | 
  [production] | 
            
  | 08:37 | 
  <mutante> | 
  installing samba-common-bin, smbclient package upgrades on tridge | 
  [production] | 
            
  | 08:33 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config/InitialiseSettings.php  '([[bugzilla:37482|bug 37482]]) Adding Proofread Page ext. namespaces on nl.wikisource' | 
  [production] | 
            
  | 08:28 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config/InitialiseSettings.php  '([[bugzilla:37482|bug 37482]]) Adding Proofread Page ext. namespaces on nl.wikisource' | 
  [production] | 
            
  | 08:24 | 
  <hashar> | 
  deploying several changes made to mediawiki-config gerrit changes 11034 11035 9131 11036 11037 9132 9136 and 9237 | 
  [production] | 
            
  | 02:52 | 
  <logmsgbot_> | 
  LocalisationUpdate completed (1.20wmf5) at Wed Jun 13 02:52:38 UTC 2012 | 
  [production] | 
            
  | 02:27 | 
  <logmsgbot_> | 
  LocalisationUpdate completed (1.20wmf4) at Wed Jun 13 02:27:37 UTC 2012 | 
  [production] | 
            
  
    | 
      
        2012-06-12
      
      §
     | 
  
    
  | 23:58 | 
  <maplebed> | 
  started swift container listing loop to compare purge timing when listings are fresh | 
  [production] | 
            
  | 23:16 | 
  <logmsgbot_> | 
  preilly synchronized php-1.20wmf5/extensions/MobileFrontend/  'try again' | 
  [production] | 
            
  | 23:15 | 
  <logmsgbot_> | 
  preilly synchronized php-1.20wmf4/extensions/MobileFrontend/  'try again' | 
  [production] | 
            
  | 22:58 | 
  <logmsgbot_> | 
  maxsem synchronized php-1.20wmf4/extensions/MobileFrontend/  'Updating MobileFrontend' | 
  [production] | 
            
  | 22:53 | 
  <logmsgbot_> | 
  maxsem synchronized php-1.20wmf4/extensions/ZeroRatedMobileAccess/  'Updating ZeroRatedMobileAccess' | 
  [production] | 
            
  | 22:52 | 
  <logmsgbot_> | 
  maxsem synchronized php-1.20wmf4/extensions/MobileFrontend/  'Updating MobileFrontend' | 
  [production] | 
            
  | 22:50 | 
  <logmsgbot_> | 
  maxsem synchronized php-1.20wmf5/extensions/ZeroRatedMobileAccess/  'Updating ZeroRatedMobileAccess' | 
  [production] | 
            
  | 22:49 | 
  <logmsgbot_> | 
  maxsem synchronized php-1.20wmf5/extensions/MobileFrontend/  'Updating MobileFrontend' | 
  [production] | 
            
  | 20:28 | 
  <RoanKattouw> | 
  Correction: the /usr/local/apache filesystem is full on hume, the root fs is not | 
  [production] | 
            
  | 20:27 | 
  <RoanKattouw> | 
  hume has a full disk | 
  [production] | 
            
  | 20:23 | 
  <RoanKattouw> | 
  Fixed ownership of php-1.20wmf{4,5}/cache/l10n , should be l10nupdate:wikidev . The wmf4 copy had wrong ownership causing rebuildLocalisationCache.php to fail for shell users (e.g. from scap) | 
  [production] | 
            
  | 19:40 | 
  <logmsgbot_> | 
  mlitn Finished syncing Wikimedia installation... :  | 
  [production] | 
            
  | 19:13 | 
  <logmsgbot_> | 
  mlitn Started syncing Wikimedia installation... :  | 
  [production] | 
            
  | 18:09 | 
  <logmsgbot_> | 
  py synchronized wmf-config/db.php  're-adding db25 to pool after kern upgares' | 
  [production] | 
            
  | 18:02 | 
  <notpeter> | 
  halting owa3 for repairs | 
  [production] | 
            
  | 16:44 | 
  <logmsgbot_> | 
  py synchronized wmf-config/db.php  'removing db25 from pools for kern upgares' | 
  [production] | 
            
  | 16:27 | 
  <logmsgbot_> | 
  py synchronized wmf-config/db.php  're-adding dbs 33, 34, 36, 50, 55, 56 to pools after kern upgares' | 
  [production] | 
            
  | 15:55 | 
  <RobH> | 
  virt1001 and virt1002 rebooting, disregard | 
  [production] | 
            
  | 15:48 | 
  <cmjohnson1_> | 
  shutting down search32 to run a diagnostic test | 
  [production] | 
            
  | 15:45 | 
  <binasher> | 
  migrating enwiki.bv2009_edits (?) to innodb | 
  [production] | 
            
  | 15:41 | 
  <binasher> | 
  migrating enwiki.moodbar_feedback to innodb | 
  [production] | 
            
  | 15:39 | 
  <binasher> | 
  migrating enwiki.aft_article_filter_count to innodb | 
  [production] | 
            
  | 15:33 | 
  <logmsgbot_> | 
  py synchronized wmf-config/db.php  'removing dbs 33, 34, 36, 50, 55, 56 from pools for kern upgares' | 
  [production] | 
            
  | 15:31 | 
  <notpeter> | 
  doing another round of DB kernel upgrades | 
  [production] | 
            
  | 15:25 | 
  <logmsgbot_> | 
  py synchronized wmf-config/db.php  | 
  [production] | 
            
  | 15:14 | 
  <logmsgbot_> | 
  asher synchronized wmf-config/CommonSettings.php  'reenabling mysql pcache' | 
  [production] | 
            
  | 15:00 | 
  <binasher> | 
  rebooting db40 | 
  [production] | 
            
  | 14:52 | 
  <binasher> | 
  set innodb_max_dirty_pages_pct = 0 on db40 in prep for shutdown | 
  [production] | 
            
  | 14:48 | 
  <logmsgbot_> | 
  asher synchronized wmf-config/CommonSettings.php  'disabling mysql parsercache (db40) in order to perform maintenance' | 
  [production] | 
            
  | 14:45 | 
  <notpeter> | 
  putting kern-upgraded DBs back into pools | 
  [production] | 
            
  | 14:44 | 
  <binasher> | 
  resumed replication on es3, es1002 after cluster23 sync completed | 
  [production] | 
            
  | 13:41 | 
  <Jeff_Green> | 
  added awight to fr-tech@wikimedia.org email alias | 
  [production] |