| 
      
        2012-11-16
      
      §
     | 
  
    
  | 23:00 | 
  <logmsgbot_> | 
  maxsem synchronized php-1.21wmf3/extensions/TimedMediaHandler  'https://gerrit.wikimedia.org/r/#/c/33819/' | 
  [production] | 
            
  | 22:58 | 
  <logmsgbot_> | 
  maxsem synchronized php-1.21wmf4/extensions/TimedMediaHandler  'https://gerrit.wikimedia.org/r/#/c/33819/' | 
  [production] | 
            
  | 22:45 | 
  <notpeter> | 
  repooling srv231-srv247 | 
  [production] | 
            
  | 22:21 | 
  <logmsgbot_> | 
  reedy synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 22:18 | 
  <logmsgbot_> | 
  catrope synchronized php-1.21wmf4/resources/jquery/jquery.tablesorter.js  'Deploying 9cb43905cd7189aa9a42f942f24a7aea50b4f0e9' | 
  [production] | 
            
  | 22:18 | 
  <notpeter> | 
  repooling srv214-srv218 | 
  [production] | 
            
  | 22:17 | 
  <logmsgbot_> | 
  catrope synchronized php-1.21wmf3/resources/jquery/jquery.tablesorter.js  'Deploying 2405956a8d6f305f6d3f9b0a1bda4deb7e917ec8' | 
  [production] | 
            
  | 21:30 | 
  <notpeter> | 
  starting innobackupex from es1004 to es1 | 
  [production] | 
            
  | 21:09 | 
  <logmsgbot_> | 
  py synchronized wmf-config/db.php  'pulling es1' | 
  [production] | 
            
  | 20:40 | 
  <binasher> | 
  running patch-job_attempts.sql migration on all wikis | 
  [production] | 
            
  | 20:30 | 
  <binasher> | 
  purging zhwiki refreshLinks2 jobs | 
  [production] | 
            
  | 20:03 | 
  <notpeter> | 
  depooling srv231-srv247 from apaches pool for upgrade to precise | 
  [production] | 
            
  | 20:03 | 
  <notpeter> | 
  depooling srv214-srv218 from api pool for upgrade to precise | 
  [production] | 
            
  | 19:48 | 
  <logmsgbot_> | 
  py synchronized wmf-config/db.php  'es2 going live' | 
  [production] | 
            
  | 18:56 | 
  <notpeter> | 
  temp stopping puppet on brewster | 
  [production] | 
            
  | 17:41 | 
  <paravoid> | 
  depooling ms-fe1 | 
  [production] | 
            
  | 17:15 | 
  <logmsgbot_> | 
  hashar synchronized wmf-config/CommonSettings.php  'Redis-setup is unavailable for wmflabs, use memcached {{gerrit|33721}}' | 
  [production] | 
            
  | 16:49 | 
  <Reedy> | 
  Running sync-common on mw52 | 
  [production] | 
            
  | 15:34 | 
  <logmsgbot_> | 
  reedy synchronized php-1.21wmf3/extensions/EducationProgram/ | 
  [production] | 
            
  | 15:33 | 
  <logmsgbot_> | 
  reedy synchronized php-1.21wmf4/extensions/EducationProgram/ | 
  [production] | 
            
  | 15:16 | 
  <paravoid> | 
  pooling ms-fe1 back with the modified rewrite.py | 
  [production] | 
            
  | 12:37 | 
  <Reedy> | 
  Running sync common on srv252, lots of Failed opening required fatals... | 
  [production] | 
            
  | 04:58 | 
  <K4-713> | 
  updated payments cluster to c898ce38e162516e73 | 
  [production] | 
            
  | 03:11 | 
  <Tim> | 
  deleted corrupted memcached value enwiki:gadgets-definition:6 | 
  [production] | 
            
  | 02:48 | 
  <logmsgbot_> | 
  LocalisationUpdate completed (1.21wmf3) at Fri Nov 16 02:48:37 UTC 2012 | 
  [production] | 
            
  | 02:37 | 
  <RoanKattouw> | 
  Forcing puppet run on wtp1 to reinstall Parsoid | 
  [production] | 
            
  | 02:28 | 
  <logmsgbot_> | 
  LocalisationUpdate completed (1.21wmf4) at Fri Nov 16 02:28:52 UTC 2012 | 
  [production] | 
            
  | 01:49 | 
  <logmsgbot_> | 
  aaron synchronized php-1.21wmf4/thumb.php  'remove hacks' | 
  [production] | 
            
  | 01:34 | 
  <logmsgbot_> | 
  aaron synchronized php-1.21wmf4/thumb.php  'more debugging' | 
  [production] | 
            
  | 01:33 | 
  <logmsgbot_> | 
  aaron synchronized php-1.21wmf4/thumb.php | 
  [production] | 
            
  | 01:32 | 
  <logmsgbot_> | 
  aaron synchronized php-1.21wmf4/thumb.php | 
  [production] | 
            
  | 01:17 | 
  <logmsgbot_> | 
  aaron synchronized php-1.21wmf4/thumb.php | 
  [production] | 
            
  | 01:12 | 
  <logmsgbot_> | 
  aaron synchronized php-1.21wmf4/thumb.php  'debug logging' | 
  [production] | 
            
  | 00:35 | 
  <logmsgbot_> | 
  tstarling synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 00:35 | 
  <logmsgbot_> | 
  tstarling synchronized wmf-config/CommonSettings.php | 
  [production] | 
            
  | 00:30 | 
  <logmsgbot_> | 
  tstarling synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 00:29 | 
  <logmsgbot_> | 
  tstarling synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 00:28 | 
  <logmsgbot_> | 
  tstarling synchronized small.dblist | 
  [production] | 
            
  | 00:21 | 
  <logmsgbot_> | 
  tstarling synchronized php-1.21wmf4/extensions/UniversalLanguageSelector | 
  [production] | 
            
  
    | 
      
        2012-11-15
      
      §
     | 
  
    
  | 22:41 | 
  <logmsgbot_> | 
  reedy synchronized php-1.21wmf4/extensions/ReaderFeedback/ | 
  [production] | 
            
  | 22:36 | 
  <logmsgbot_> | 
  reedy synchronized php-1.21wmf4/extensions/WikimediaIncubator/ | 
  [production] | 
            
  | 22:29 | 
  <Reedy> | 
  Ran sync-docroot | 
  [production] | 
            
  | 22:08 | 
  <notpeter> | 
  repooling srv25-srv257 | 
  [production] | 
            
  | 22:06 | 
  <notpeter> | 
  repooling srv190-srv192, srv225-srv230 | 
  [production] | 
            
  | 21:33 | 
  <binasher> | 
  starting apache on srv249 | 
  [production] | 
            
  | 21:32 | 
  <binasher> | 
  stopping apache on srv249 | 
  [production] | 
            
  | 21:30 | 
  <binasher> | 
  ran chmod 755 /usr/local/apache/common-local/wmf-config on srv249 | 
  [production] | 
            
  | 20:46 | 
  <Jeff_Green> | 
  adjusted key_buffer_size for fundraisingdbs from 1M to 1G | 
  [production] | 
            
  | 20:42 | 
  <notpeter> | 
  removing srv225-srv230 for upgrade to precise | 
  [production] | 
            
  | 20:34 | 
  <notpeter> | 
  reimaging srv190-srv192 as regular apaches | 
  [production] |