| 
      
        2014-11-18
      
      ยง
     | 
  
    
  | 21:33 | 
  <^d> | 
  elasticsearch: set auto_expand_replicas to 0-2 on ttmserver(-test) like other indexes for extra redundancy. | 
  [production] | 
            
  | 20:25 | 
  <ori> | 
  re-enabling puppet on all varnishes following deployment of Iac35f2329 | 
  [production] | 
            
  | 20:10 | 
  <legoktm> | 
  running batchCAAntiSpoof.php on terbium | 
  [production] | 
            
  | 20:02 | 
  <legoktm> | 
  ran populateGlobalRenameLogSearch.php on metawiki | 
  [production] | 
            
  | 19:47 | 
  <ori> | 
  disabling Puppet on varnishes to push out Iac35f2329 | 
  [production] | 
            
  | 19:40 | 
  <reedy> | 
  Synchronized wmf-config/Wikibase.php: bump epoch (duration: 00m 13s) | 
  [production] | 
            
  | 19:40 | 
  <ottomata> | 
  starting trusty upgrade of analytics1032 | 
  [production] | 
            
  | 19:28 | 
  <reedy> | 
  Synchronized wmf-config/: (no message) (duration: 00m 14s) | 
  [production] | 
            
  | 19:23 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.25wmf8 | 
  [production] | 
            
  | 19:14 | 
  <ottomata> | 
  starting trusty upgrade of analytics1031 | 
  [production] | 
            
  | 19:05 | 
  <ori> | 
  depooled mw1205; out of sync | 
  [production] | 
            
  | 19:03 | 
  <maxsem> | 
  Synchronized php-1.25wmf7/extensions/WikiGrok/: Retry sync (duration: 00m 07s) | 
  [production] | 
            
  | 18:57 | 
  <maxsem> | 
  Synchronized php-1.25wmf7/extensions/WikiGrok/: Revert (duration: 00m 04s) | 
  [production] | 
            
  | 18:54 | 
  <maxsem> | 
  Synchronized php-1.25wmf7/extensions/WikiGrok/: SQL backed version (duration: 00m 04s) | 
  [production] | 
            
  | 18:49 | 
  <maxsem> | 
  Synchronized php-1.25wmf8/extensions/WikiGrok/: SQL backed version (duration: 00m 05s) | 
  [production] | 
            
  | 18:47 | 
  <ejegg> | 
  updated crm from 71ec68e8da1de289c4e7adca090c0fdbccbd8b8a to ff89895638a0dd0600b2e4c0b6adfd1b8e402df5 | 
  [production] | 
            
  | 18:47 | 
  <ejegg> | 
  updated crm | 
  [production] | 
            
  | 18:42 | 
  <ottomata> | 
  starting trusty upgrade of analtyics1030 | 
  [production] | 
            
  | 18:42 | 
  <demon> | 
  Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 04s) | 
  [production] | 
            
  | 18:34 | 
  <ejegg> | 
  update crm from e9e81a828d50e8bddf98eae699c925e09b25927b to 71ec68e8da1de289c4e7adca090c0fdbccbd8b8a | 
  [production] | 
            
  | 18:31 | 
  <MaxSem> | 
  created wikigrok_questions table on test, test2 and enwiki | 
  [production] | 
            
  | 18:25 | 
  <maxsem> | 
  Synchronized php-1.25wmf7/extensions/MobileFrontend/: https://gerrit.wikimedia.org/r/#/c/173316/ (duration: 00m 04s) | 
  [production] | 
            
  | 18:25 | 
  <maxsem> | 
  Synchronized php-1.25wmf8/extensions/MobileFrontend/: https://gerrit.wikimedia.org/r/#/c/173316/ (duration: 00m 08s) | 
  [production] | 
            
  | 18:08 | 
  <ottomata> | 
  starting trusty upgrade of analytics1029 | 
  [production] | 
            
  | 18:04 | 
  <aaron> | 
  Synchronized wmf-config/StartProfiler.php: Added switch-logic for new Profiler config format (duration: 00m 05s) | 
  [production] | 
            
  | 17:40 | 
  <demon> | 
  Synchronized php-1.25wmf8/extensions/Translate/ttmserver/ElasticSearchTTMServer.php: hack (duration: 00m 04s) | 
  [production] | 
            
  | 17:40 | 
  <demon> | 
  Synchronized php-1.25wmf7/extensions/Translate/ttmserver/ElasticSearchTTMServer.php: hack (duration: 00m 04s) | 
  [production] | 
            
  | 17:34 | 
  <_joe_> | 
  restarting icinga | 
  [production] | 
            
  | 17:24 | 
  <demon> | 
  Synchronized php-1.25wmf7/extensions/Translate/scripts/ttmserver-export.php: profiling hack (duration: 00m 04s) | 
  [production] | 
            
  | 17:22 | 
  <ottomata> | 
  starting trusty upgrade of analytics1020 | 
  [production] | 
            
  | 17:21 | 
  <demon> | 
  Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 05s) | 
  [production] | 
            
  | 17:15 | 
  <demon> | 
  Synchronized php-1.25wmf8/extensions/Translate/scripts/ttmserver-export.php: profiling hack (duration: 00m 06s) | 
  [production] | 
            
  | 17:07 | 
  <demon> | 
  Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 04s) | 
  [production] | 
            
  | 17:06 | 
  <demon> | 
  Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 04s) | 
  [production] | 
            
  | 16:35 | 
  <anomie> | 
  Synchronized php-1.25wmf8/extensions/SecurePoll: SWAT: Fix SecurePollContent handling [[gerrit:174125]] (duration: 00m 09s) | 
  [production] | 
            
  | 16:32 | 
  <anomie> | 
  Synchronized php-1.25wmf8/extensions/MultimediaViewer: SWAT: Media Viewer UI bugfixes [[gerrit:174116]] (for real this time) (duration: 00m 09s) | 
  [production] | 
            
  | 16:30 | 
  <godog> | 
  restarting txstatsd on tungsten to drop old metrics | 
  [production] | 
            
  | 16:29 | 
  <anomie> | 
  Synchronized php-1.25wmf8/extensions/MultimediaViewer: SWAT: Media Viewer UI bugfixes [[gerrit:174116]] (duration: 00m 09s) | 
  [production] | 
            
  | 16:28 | 
  <ottomata> | 
  starting upgrade to trusty of analytics1017 | 
  [production] | 
            
  | 16:27 | 
  <anomie> | 
  Synchronized php-1.25wmf8/includes/filebackend: SWAT: Log more details about backend-fail-internal errors [[gerrit:174128]] (duration: 00m 09s) | 
  [production] | 
            
  | 16:18 | 
  <bblack> | 
  rubidium+eeden gdnsd upgraded to 2.1.0 (baham was already there) | 
  [production] | 
            
  | 16:06 | 
  <manybubbles> | 
  replaying 20,000 searches at approximately the same speed that they were issued caused only marginal bounce in load (cluster load average was 13% and two machines went about 20%).  We're ready from a performance standpoint.  yay | 
  [production] | 
            
  | 16:02 | 
  <anomie> | 
  Synchronized wmf-config/InitialiseSettings.php: Touch a random PHP file, supposedly required (duration: 00m 09s) | 
  [production] | 
            
  | 16:02 | 
  <manybubbles> | 
  replaying some searches against cirrus to make *super* *duper* sure it won't fall over tomorrow when we enable enwiki | 
  [production] | 
            
  | 16:01 | 
  <anomie> | 
  Synchronized visualeditor-default.dblist: SWAT: Enable VisualEditor by default on Catalan Wikiquote (cawikiquote) [[gerrit:174036]] (duration: 00m 09s) | 
  [production] | 
            
  | 16:01 | 
  <anomie> | 
  Synchronized visualeditor.dblist: SWAT: Enable VisualEditor by default on Catalan Wikiquote (cawikiquote) [[gerrit:174036]] (duration: 00m 09s) | 
  [production] | 
            
  | 15:43 | 
  <ottomata> | 
  starting trusty upgrade of analytics1016 | 
  [production] | 
            
  | 15:32 | 
  <hashar> | 
  Deleting job https://integration.wikimedia.org/ci/job/mediawiki-vendor-integration/  replaced by mediawiki-phpunit. Clearing out workspaces {{bug|73515}} | 
  [production] | 
            
  | 14:58 | 
  <ottomata> | 
  starting upgrade to Trusty of analytics1015 | 
  [production] | 
            
  | 14:55 | 
  <springle> | 
  fail over m2 to m2-slave (db1046); investigating db1020 | 
  [production] |