| 
      
        2013-06-12
      
      §
     | 
  
    
  | 23:56 | 
  <asher> | 
  synchronized wmf-config  'revert twemproxy' | 
  [production] | 
            
  | 23:47 | 
  <asher> | 
  restarted twemproxy on all servers | 
  [production] | 
            
  | 23:45 | 
  <asher> | 
  synchronized wmf-config/twemproxy-pmtpa.yaml  'pull 10.0.12.15' | 
  [production] | 
            
  | 23:42 | 
  <aaron> | 
  cleared profiling data | 
  [production] | 
            
  | 23:34 | 
  <asher> | 
  synchronized wmf-config  'use twemproxy for memcached access from all hosts' | 
  [production] | 
            
  | 23:32 | 
  <tstarling> | 
  cleared profiling data | 
  [production] | 
            
  | 23:10 | 
  <paravoid> | 
  apt: updating libmemcached/php5-memcached (#5268) | 
  [production] | 
            
  | 22:59 | 
  <asher> | 
  synchronized wmf-config/mc-eqiad.php  'set (server_failure_limit, retry_timeout) = 0 for twemproxy test hosts' | 
  [production] | 
            
  | 22:25 | 
  <aaron> | 
  synchronized php-1.22wmf6/includes/objectcache/MemcachedPeclBagOStuff.php  '7f091934ceae0280b44292e5ce426b24c5a579a2' | 
  [production] | 
            
  | 22:23 | 
  <aaron> | 
  synchronized php-1.22wmf5/includes/objectcache/MemcachedPeclBagOStuff.php  'f6287b2e2faba20aea7379dae84ee7c5dd84983f' | 
  [production] | 
            
  | 21:34 | 
  <mutante> | 
  deploying new favicon on wikitech | 
  [production] | 
            
  | 21:22 | 
  <LeslieCarr> | 
  restarting caesium | 
  [production] | 
            
  | 20:55 | 
  <mutante> | 
  PXE booting analytics1020 | 
  [production] | 
            
  | 18:51 | 
  <asher> | 
  synchronized wmf-config/mc-eqiad.php  'use twemproxy on mw113* (10 api apaches)' | 
  [production] | 
            
  | 17:28 | 
  <cmjohnson1> | 
  powering down wtp1008 for h/w problem/testing | 
  [production] | 
            
  | 17:23 | 
  <yurik> | 
  synchronized php-1.22wmf5/extensions/ZeroRatedMobileAccess/ | 
  [production] | 
            
  | 17:20 | 
  <yurik> | 
  mw1020 complained during depl about fingerprint 81:2e:56:16:83:fd:b1:65:08:7b:ad:f8:66:98:19:c9. | 
  [production] | 
            
  | 17:19 | 
  <ori-l> | 
  mw1020: Warning: Remote Host Identification Has Changed | 
  [production] | 
            
  | 17:18 | 
  <yurik> | 
  synchronized php-1.22wmf6/extensions/ZeroRatedMobileAccess/ | 
  [production] | 
            
  | 17:06 | 
  <cmjohnson1> | 
  removing/replacing disk slot 9 ms-be1007 | 
  [production] | 
            
  | 16:35 | 
  <cmjohnson1> | 
  removing/replacing failed disks in slot5 and slot9 from ms-be1012 | 
  [production] | 
            
  | 16:00 | 
  <cmjohnson1> | 
  powering down carbon for h/w testing/reports | 
  [production] | 
            
  | 15:19 | 
  <cmjohnson1> | 
  mw1041 powering down for h/w issue | 
  [production] | 
            
  | 15:09 | 
  <gwicke> | 
  updated Parsoid to 058da0822 | 
  [production] | 
            
  | 02:27 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Wed Jun 12 02:27:19 UTC 2013 | 
  [production] | 
            
  | 02:13 | 
  <LocalisationUpdate> | 
  completed (1.22wmf5) at Wed Jun 12 02:13:49 UTC 2013 | 
  [production] | 
            
  | 02:07 | 
  <LocalisationUpdate> | 
  completed (1.22wmf6) at Wed Jun 12 02:07:39 UTC 2013 | 
  [production] | 
            
  | 00:20 | 
  <Ryan_Lane> | 
  upgraded mediawiki on wikitech-static | 
  [production] | 
            
  | 00:10 | 
  <Tim> | 
  installing the experimental libmemcached packages on srv193 | 
  [production] | 
            
  
    | 
      
        2013-06-11
      
      §
     | 
  
    
  | 22:58 | 
  <cmjohnson1> | 
  wtp1008 rebooting to check bios setting | 
  [production] | 
            
  | 21:26 | 
  <cmjohnson1> | 
  mw1171 powering down via racadm | 
  [production] | 
            
  | 21:21 | 
  <maxsem> | 
  synchronized php-1.22wmf5/extensions/MobileFrontend/ | 
  [production] | 
            
  | 21:18 | 
  <maxsem> | 
  Finished syncing Wikimedia installation... : Weekly mobile deployment | 
  [production] | 
            
  | 21:10 | 
  <maxsem> | 
  Started syncing Wikimedia installation... : Weekly mobile deployment | 
  [production] | 
            
  | 20:33 | 
  <mutante> | 
  deploying bugzilla frontpage css/html changes (bug 22170) | 
  [production] | 
            
  | 20:27 | 
  <cmjohnson1> | 
  powering off asw-c8-eqiad and removing from rack | 
  [production] | 
            
  | 20:17 | 
  <LeslieCarr> | 
  halting asw-c8-eqiad | 
  [production] | 
            
  | 20:17 | 
  <LeslieCarr> | 
  disabling asw-c8-eqiad | 
  [production] | 
            
  | 19:46 | 
  <gwicke> | 
  updated Parsoid to ab8d15596f | 
  [production] | 
            
  | 19:34 | 
  <kaldari> | 
  Finished syncing Wikimedia installation... : | 
  [production] | 
            
  | 19:22 | 
  <kaldari> | 
  Started syncing Wikimedia installation... : | 
  [production] | 
            
  | 18:55 | 
  <Aaron|home> | 
  Cleared rows for queued transcodes on commonswiki | 
  [production] | 
            
  | 18:40 | 
  <bsitu> | 
  synchronized wmf-config/CommonSettings.php  'Enable Echo interaction schema and cohort study' | 
  [production] | 
            
  | 18:40 | 
  <cmjohnson1> | 
  depooling and powering down wtp1001-1002 and wtp1005-1tp1008 | 
  [production] | 
            
  | 18:39 | 
  <bsitu> | 
  synchronized wmf-config/InitialiseSettings.php  'Enable Echo interaction schema and cohort study' | 
  [production] | 
            
  | 18:14 | 
  <Aaron|home> | 
  Parsoid jobs pipeline fixed with 866e66104fa6d285911da1888b9f9dcece2f53a4, pipeline should be working now | 
  [production] |