| 2013-06-12
      
      § | 
    
  | 23:56 | <asher> | synchronized wmf-config  'revert twemproxy' | [production] | 
            
  | 23:47 | <asher> | restarted twemproxy on all servers | [production] | 
            
  | 23:45 | <asher> | synchronized wmf-config/twemproxy-pmtpa.yaml  'pull 10.0.12.15' | [production] | 
            
  | 23:42 | <aaron> | cleared profiling data | [production] | 
            
  | 23:34 | <asher> | synchronized wmf-config  'use twemproxy for memcached access from all hosts' | [production] | 
            
  | 23:32 | <tstarling> | cleared profiling data | [production] | 
            
  | 23:10 | <paravoid> | apt: updating libmemcached/php5-memcached (#5268) | [production] | 
            
  | 22:59 | <asher> | synchronized wmf-config/mc-eqiad.php  'set (server_failure_limit, retry_timeout) = 0 for twemproxy test hosts' | [production] | 
            
  | 22:25 | <aaron> | synchronized php-1.22wmf6/includes/objectcache/MemcachedPeclBagOStuff.php  '7f091934ceae0280b44292e5ce426b24c5a579a2' | [production] | 
            
  | 22:23 | <aaron> | synchronized php-1.22wmf5/includes/objectcache/MemcachedPeclBagOStuff.php  'f6287b2e2faba20aea7379dae84ee7c5dd84983f' | [production] | 
            
  | 21:34 | <mutante> | deploying new favicon on wikitech | [production] | 
            
  | 21:22 | <LeslieCarr> | restarting caesium | [production] | 
            
  | 20:55 | <mutante> | PXE booting analytics1020 | [production] | 
            
  | 18:51 | <asher> | synchronized wmf-config/mc-eqiad.php  'use twemproxy on mw113* (10 api apaches)' | [production] | 
            
  | 17:28 | <cmjohnson1> | powering down wtp1008 for h/w problem/testing | [production] | 
            
  | 17:23 | <yurik> | synchronized php-1.22wmf5/extensions/ZeroRatedMobileAccess/ | [production] | 
            
  | 17:20 | <yurik> | mw1020 complained during depl about fingerprint 81:2e:56:16:83:fd:b1:65:08:7b:ad:f8:66:98:19:c9. | [production] | 
            
  | 17:19 | <ori-l> | mw1020: Warning: Remote Host Identification Has Changed | [production] | 
            
  | 17:18 | <yurik> | synchronized php-1.22wmf6/extensions/ZeroRatedMobileAccess/ | [production] | 
            
  | 17:06 | <cmjohnson1> | removing/replacing disk slot 9 ms-be1007 | [production] | 
            
  | 16:35 | <cmjohnson1> | removing/replacing failed disks in slot5 and slot9 from ms-be1012 | [production] | 
            
  | 16:00 | <cmjohnson1> | powering down carbon for h/w testing/reports | [production] | 
            
  | 15:19 | <cmjohnson1> | mw1041 powering down for h/w issue | [production] | 
            
  | 15:09 | <gwicke> | updated Parsoid to 058da0822 | [production] | 
            
  | 02:27 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed Jun 12 02:27:19 UTC 2013 | [production] | 
            
  | 02:13 | <LocalisationUpdate> | completed (1.22wmf5) at Wed Jun 12 02:13:49 UTC 2013 | [production] | 
            
  | 02:07 | <LocalisationUpdate> | completed (1.22wmf6) at Wed Jun 12 02:07:39 UTC 2013 | [production] | 
            
  | 00:20 | <Ryan_Lane> | upgraded mediawiki on wikitech-static | [production] | 
            
  | 00:10 | <Tim> | installing the experimental libmemcached packages on srv193 | [production] | 
            
  
    | 2013-06-11
      
      § | 
    
  | 22:58 | <cmjohnson1> | wtp1008 rebooting to check bios setting | [production] | 
            
  | 21:26 | <cmjohnson1> | mw1171 powering down via racadm | [production] | 
            
  | 21:21 | <maxsem> | synchronized php-1.22wmf5/extensions/MobileFrontend/ | [production] | 
            
  | 21:18 | <maxsem> | Finished syncing Wikimedia installation... : Weekly mobile deployment | [production] | 
            
  | 21:10 | <maxsem> | Started syncing Wikimedia installation... : Weekly mobile deployment | [production] | 
            
  | 20:33 | <mutante> | deploying bugzilla frontpage css/html changes (bug 22170) | [production] | 
            
  | 20:27 | <cmjohnson1> | powering off asw-c8-eqiad and removing from rack | [production] | 
            
  | 20:17 | <LeslieCarr> | halting asw-c8-eqiad | [production] | 
            
  | 20:17 | <LeslieCarr> | disabling asw-c8-eqiad | [production] | 
            
  | 19:46 | <gwicke> | updated Parsoid to ab8d15596f | [production] | 
            
  | 19:34 | <kaldari> | Finished syncing Wikimedia installation... : | [production] | 
            
  | 19:22 | <kaldari> | Started syncing Wikimedia installation... : | [production] | 
            
  | 18:55 | <Aaron|home> | Cleared rows for queued transcodes on commonswiki | [production] | 
            
  | 18:40 | <bsitu> | synchronized wmf-config/CommonSettings.php  'Enable Echo interaction schema and cohort study' | [production] | 
            
  | 18:40 | <cmjohnson1> | depooling and powering down wtp1001-1002 and wtp1005-1tp1008 | [production] | 
            
  | 18:39 | <bsitu> | synchronized wmf-config/InitialiseSettings.php  'Enable Echo interaction schema and cohort study' | [production] | 
            
  | 18:14 | <Aaron|home> | Parsoid jobs pipeline fixed with 866e66104fa6d285911da1888b9f9dcece2f53a4, pipeline should be working now | [production] | 
            
  | 17:20 | <asher> | restarted twemproxy on all servers | [production] | 
            
  | 17:20 | <asher> | synchronized wmf-config | [production] | 
            
  | 16:03 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] |