| 
      
        2014-01-10
      
      §
     | 
  
    
  | 11:52 | 
  <mutante> | 
  welcome new software deployer Kartik from Language Engineering | 
  [production] | 
            
  | 07:58 | 
  <springle> | 
  xtrabackup clone db1018 to db1060 | 
  [production] | 
            
  | 05:56 | 
  <springle> | 
  xtrabackup clone db1050 to db1055 | 
  [production] | 
            
  | 03:32 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Fri Jan 10 03:32:03 UTC 2014 | 
  [production] | 
            
  | 03:01 | 
  <spage> | 
  synchronized php-1.23wmf10/extensions/Flow/includes/Repository/TreeRepository.php  'Flow cache key fix to 1.23wmf10' | 
  [production] | 
            
  | 01:46 | 
  <paravoid> | 
  swift: set_weight 0 to ms-be11/sde1, disk failed | 
  [production] | 
            
  | 01:45 | 
  <maxsem> | 
  synchronized php-1.23wmf10/extensions/MobileFrontend/  'https://gerrit.wikimedia.org/r/#/c/106639/' | 
  [production] | 
            
  | 01:41 | 
  <maxsem> | 
  synchronized php-1.23wmf9/extensions/MobileFrontend/  'https://gerrit.wikimedia.org/r/#/c/106639/' | 
  [production] | 
            
  | 01:34 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'Reduce LB general traffic during reindexing/partitioning on groupLoadsBySection slaves' | 
  [production] | 
            
  | 01:21 | 
  <paravoid> | 
  restoring RT's mail interface; expect delayed RT email to arrive soon | 
  [production] | 
            
  | 01:19 | 
  <paravoid> | 
  apt: installing trusty's libio-socket-ssl-perl into precise-wikimedia; SNI-capable | 
  [production] | 
            
  | 01:06 | 
  <RobH> | 
  gerrit seems faster again for now | 
  [production] | 
            
  | 01:02 | 
  <RobH> | 
  gerrit is slowed down and memory is maxed out on system, restarting gerrit to see if it helps | 
  [production] | 
            
  | 00:08 | 
  <maxsem> | 
  synchronized wmf-config/InitialiseSettings.php  'https://gerrit.wikimedia.org/r/106629' | 
  [production] | 
            
  
    | 
      
        2014-01-09
      
      §
     | 
  
    
  | 22:29 | 
  <ori> | 
  synchronized php-1.23wmf10/extensions/VisualEditor/ApiVisualEditor.php  'Update VisualEditor for cherry pick I5cc44c5ef35 (bug 59867)' | 
  [production] | 
            
  | 22:19 | 
  <aaron> | 
  synchronized php-1.23wmf10/includes/libs  '1a5ac00f8991905d8fd643d53cb744024143c558' | 
  [production] | 
            
  | 20:51 | 
  <aaron> | 
  synchronized php-1.23wmf10/includes/filebackend  '94cb6f164ed2b9f7dbdf809e2d861ae04ab1df21' | 
  [production] | 
            
  | 20:20 | 
  <aaron> | 
  synchronized php-1.23wmf10/includes/filebackend  'e45db51adeddcc71a97e6547a6f4ecaf5f320a8c' | 
  [production] | 
            
  | 20:19 | 
  <aaron> | 
  synchronized php-1.23wmf10/includes/filebackend  'e45db51adeddcc71a97e6547a6f4ecaf5f320a8c' | 
  [production] | 
            
  | 20:18 | 
  <aaron> | 
  synchronized php-1.23wmf10/includes/filebackend  'e45db51adeddcc71a97e6547a6f4ecaf5f320a8c' | 
  [production] | 
            
  | 20:08 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: mediawikiwiki to 1.23wmf10 aswell | 
  [production] | 
            
  | 20:07 | 
  <reedy> | 
  finished scap (duration: 19m 42s) | 
  [production] | 
            
  | 19:50 | 
  <reedy> | 
  started scap | 
  [production] | 
            
  | 19:41 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: phase1 wikis minux mediawikiwiki to 1.23wmf10 | 
  [production] | 
            
  | 19:38 | 
  <reedy> | 
  started scap: Update 1.23wmf10 l10n cache | 
  [production] | 
            
  | 19:34 | 
  <reedy> | 
  started scap: Update 1.23wmf10 l10n cache | 
  [production] | 
            
  | 19:33 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: 1.23wmf10 looks brokened | 
  [production] | 
            
  | 19:30 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: phase1wikis to 1.23wmf10 | 
  [production] | 
            
  | 19:07 | 
  <reedy> | 
  synchronized wmf-config/  'AssertEdit only on 1.23wmf9' | 
  [production] | 
            
  | 19:04 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: Wikipedias to 1.23wmf9 | 
  [production] | 
            
  | 18:22 | 
  <reedy> | 
  updated /a/common to {{Gerrit|Ib6f2c4d96}}: cleanup old Wikibase settings which are same as default now | 
  [production] | 
            
  | 18:22 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki back to 1.23wmf9 till window | 
  [production] | 
            
  | 18:20 | 
  <reedy> | 
  finished scap: testwiki to 1.23wmf10 build l10n cache (duration: 31m 21s) | 
  [production] | 
            
  | 17:53 | 
  <reedy> | 
  started scap: testwiki to 1.23wmf10 build l10n cache | 
  [production] | 
            
  | 17:47 | 
  <reedy> | 
  synchronized php-1.23wmf10 | 
  [production] | 
            
  | 17:34 | 
  <reedy> | 
  updated /a/common to {{Gerrit|Iaada76f43}}: pdf1 died, replace with pdf2 | 
  [production] | 
            
  | 17:31 | 
  <robh> | 
  synchronized wmf-config/ | 
  [production] | 
            
  | 17:18 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 17:16 | 
  <reedy> | 
  updated /a/common to {{Gerrit|I5f2816468}}: Segregate watchlist and recentshangeslinked queries on all shards. | 
  [production] | 
            
  | 17:14 | 
  <reedy> | 
  synchronized php-1.23wmf10 | 
  [production] | 
            
  | 04:31 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'watchlist/recnetchangeslinked LB on s[234567]' | 
  [production] | 
            
  | 03:34 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Thu Jan  9 03:33:55 UTC 2014 | 
  [production] | 
            
  | 03:03 | 
  <springle> | 
  partition logging tables on logpager slaves: s2 db1002, s4 db1004, s5 db1026, s6 db1040 | 
  [production] | 
            
  | 03:03 | 
  <springle> | 
  wikitech down. restarted apache on virt0. phusion_passenger exception + MaxClients hit | 
  [production] | 
            
  | 02:03 | 
  <awight> | 
  crm updated from 1234a7f9deb8cb7a526b0d7e12bd6ee369b570a1 to 43a7475df8461f59ab49d8a932ccd76257dc6d72 | 
  [production] | 
            
  | 01:14 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'repool db1041' | 
  [production] | 
            
  | 00:38 | 
  <ori> | 
  synchronized php-1.23wmf8/extensions/EventLogging  'Update EventLogging to master' | 
  [production] | 
            
  | 00:25 | 
  <maxsem> | 
  synchronized php-1.23wmf8/extensions/Collection/  'Shit hit fan' | 
  [production] | 
            
  | 00:21 | 
  <maxsem> | 
  synchronized php-1.23wmf8/extensions/Collection/  'https://gerrit.wikimedia.org/r/106293' | 
  [production] | 
            
  | 00:15 | 
  <maxsem> | 
  synchronized wmf-config  'https://gerrit.wikimedia.org/r/106236' | 
  [production] |