| 
      
        2015-10-22
      
      §
     | 
  
    
  | 19:53 | 
  <yurik@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/ZeroBanner: Deploying ZeroBanner T116309 patch 248116 (duration: 00m 18s) | 
  [production] | 
            
  | 19:27 | 
  <bd808> | 
  Forced ELK Elasticsearch to allocate replica of logstash-2015.10.22 shard 0 on logstash1004 | 
  [production] | 
            
  | 18:56 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.27.0-wmf.3 | 
  [production] | 
            
  | 16:48 | 
  <bd808> | 
  Restarted Elasticsearch on logstash1004 | 
  [production] | 
            
  | 16:39 | 
  <kartik@tin> | 
  Synchronized private/PrivateSettings.php: T116134: Set CX JWT token (duration: 00m 17s) | 
  [production] | 
            
  | 16:19 | 
  <ori@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: I8f690589: Increase abusefilter emergency disable threshold on MediaWiki.org (duration: 00m 17s) | 
  [production] | 
            
  | 15:30 | 
  <thcipriani@tin> | 
  Synchronized docroot/noc/conf/highlight.php: SWAT: Remove urlencode from phabricator links [[gerrit:248049]] (duration: 00m 17s) | 
  [production] | 
            
  | 15:13 | 
  <thcipriani@tin> | 
  Synchronized docroot/noc/conf: SWAT: noc: change Gitblit links to Diffusion [[gerrit:248027]] (duration: 00m 17s) | 
  [production] | 
            
  | 15:11 | 
  <moritzm> | 
  uploaded openjdk-8 8u66-b17 for jessie-wikimedia to carbon | 
  [production] | 
            
  | 14:46 | 
  <jynus> | 
  performing schema change on eventlogging database on db1046 | 
  [production] | 
            
  | 14:41 | 
  <mutante> | 
  mw1083 - Error: Could not run Puppet configuration client: Read-only file system | 
  [production] | 
            
  | 14:25 | 
  <jynus> | 
  setting thread_pool_size to 32 dynamically on all MariaDB hosts | 
  [production] | 
            
  | 14:01 | 
  <jynus> | 
  performing schema change on officewiki-flow (s3) | 
  [production] | 
            
  | 13:19 | 
  <jynus> | 
  performing schema change on x1-master (flowdb) | 
  [production] | 
            
  | 12:31 | 
  <jynus> | 
  Rolling schema change for GeoData on all wikis (geo_tags) | 
  [production] | 
            
  | 11:35 | 
  <mobrovac> | 
  restbase deployed 2bc05f40 | 
  [production] | 
            
  | 07:41 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.3/includes/jobqueue/JobQueueRedis.php: Ie7c544fc8: jobqueue: track real job inserts as inserts_actual & I627e8f6ce: JobQueueRedis::doBatchPush(): report metrics even when failures occur (duration: 00m 17s) | 
  [production] | 
            
  | 07:41 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.2/includes/jobqueue/JobQueueRedis.php: Ie7c544fc8: jobqueue: track real job inserts as inserts_actual & I627e8f6ce: JobQueueRedis::doBatchPush(): report metrics even when failures occur (duration: 07m 33s) | 
  [production] | 
            
  | 06:17 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Thu Oct 22 06:17:39 UTC 2015 (duration 17m 38s) | 
  [production] | 
            
  | 06:14 | 
  <AaronSchulz> | 
  Restarted hhvm on mw1011, it was stuck doing nothing at 100 cpu | 
  [production] | 
            
  | 05:10 | 
  <aaron@tin> | 
  Synchronized php-1.27.0-wmf.3/includes/deferred/LinksUpdate.php: fe323f9b68bbb (duration: 00m 17s) | 
  [production] | 
            
  | 03:05 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-22 03:05:21+00:00 | 
  [production] | 
            
  | 03:00 | 
  <l10nupdate@tin> | 
  Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 07m 52s) | 
  [production] | 
            
  | 02:37 | 
  <AaronSchulz> | 
  Startin running 5 threads of enwiki refreshLinks jobs on tin | 
  [production] | 
            
  | 02:35 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-22 02:35:41+00:00 | 
  [production] | 
            
  | 02:30 | 
  <l10nupdate@tin> | 
  Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 44s) | 
  [production] | 
            
  | 01:10 | 
  <krenair@mira> | 
  Synchronized README: testing sync from mira (duration: 00m 17s) | 
  [production] | 
            
  | 01:00 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.2/includes/Hooks.php: I0e5f2d3b2: Make hookErrorHandler() only care about serious signature errors (duration: 00m 17s) | 
  [production] | 
            
  | 01:00 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.3/includes/Hooks.php: I0e5f2d3b2: Make hookErrorHandler() only care about serious signature errors (duration: 00m 17s) | 
  [production] | 
            
  | 00:56 | 
  <krenair@mira> | 
  Synchronized README: (no message) (duration: 00m 16s) | 
  [production] | 
            
  | 00:55 | 
  <krenair@mira> | 
  Synchronized README: (no message) (duration: 00m 17s) | 
  [production] | 
            
  | 00:49 | 
  <krenair@mira> | 
  Synchronized README: (no message) (duration: 00m 16s) | 
  [production] | 
            
  | 00:20 | 
  <ori@tin> | 
  Synchronized wmf-config/CommonSettings.php: Ibf752b832: $wgMathCheckFiles = false (duration: 00m 18s) | 
  [production] | 
            
  | 00:05 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/AbuseFilter: Ice1b6da43: AbuseFilter: don't install custom error handler and I0ecdcdd142: Use isset() to check array element exists rather than relying on @ operator (duration: 00m 18s) | 
  [production] | 
            
  | 00:03 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter: Ice1b6da43: AbuseFilter: don't install custom error handler and I0ecdcdd142: Use isset() to check array element exists rather than relying on @ operator (duration: 00m 18s) | 
  [production] | 
            
  
    | 
      
        2015-10-21
      
      §
     | 
  
    
  | 23:33 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/CirrusSearch: Performance tweaks for corss-dc copy process (duration: 00m 19s) | 
  [production] | 
            
  | 23:32 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Performance tweaks for corss-dc copy process (duration: 00m 18s) | 
  [production] | 
            
  | 23:25 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.3/resources/: mw.ForeignStructuredUpload: Provide category suggestions from the right wiki (duration: 00m 17s) | 
  [production] | 
            
  | 23:16 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.3/resources/: mw.ForeignStructuredUpload: Rearrange messages to always display license name (duration: 00m 18s) | 
  [production] | 
            
  | 23:08 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/throttle.php: Add throtle exception for eswiki (duration: 00m 18s) | 
  [production] | 
            
  | 23:03 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter/AbuseFilter.parser.php: Ad-hoc debug logging of AbuseFilter exceptions (duration: 00m 17s) | 
  [production] | 
            
  | 23:00 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter/AbuseFilter.parser.php: Ad-hoc debug logging of AbuseFilter exceptions (duration: 00m 17s) | 
  [production] | 
            
  | 21:10 | 
  <ebernhardson> | 
  starting copy of elasticsearch eqiad indices to codfw | 
  [production] | 
            
  | 20:46 | 
  <ebernhardson|lch> | 
  cancel copying elasticsearch eqiad to labsearch, looks to be writing to wrong disks and will fill up | 
  [production] | 
            
  | 20:16 | 
  <AaronSchulz> | 
  Started running 8 threads of commonswiki refreshlinks jobs on terbium | 
  [production] | 
            
  | 20:14 | 
  <ebernhardson|lch> | 
  starting copy of elasticsearch indices from eqiad cluster to labsearch cluster | 
  [production] | 
            
  | 18:42 | 
  <ebernhardson> | 
  initializing elasticsearch index mapping for all wikis in the codfw and labsearch ES clusters | 
  [production] | 
            
  | 16:53 | 
  <hoo> | 
  Attached WeiaR@enwiki to the global account of the same name. T115699 | 
  [production] | 
            
  | 15:50 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/WikimediaEvents/: Revert SearchSatisfaction schema related changes due to suspected perf impact (duration: 00m 18s) | 
  [production] | 
            
  | 15:49 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/: Revert SearchSatisfaction schema related changes due to suspected perf impact (duration: 00m 18s) | 
  [production] |