| 
      
        2015-10-21
      
      §
     | 
  
    
  | 20:46 | 
  <ebernhardson|lch> | 
  cancel copying elasticsearch eqiad to labsearch, looks to be writing to wrong disks and will fill up | 
  [production] | 
            
  | 20:16 | 
  <AaronSchulz> | 
  Started running 8 threads of commonswiki refreshlinks jobs on terbium | 
  [production] | 
            
  | 20:14 | 
  <ebernhardson|lch> | 
  starting copy of elasticsearch indices from eqiad cluster to labsearch cluster | 
  [production] | 
            
  | 18:42 | 
  <ebernhardson> | 
  initializing elasticsearch index mapping for all wikis in the codfw and labsearch ES clusters | 
  [production] | 
            
  | 16:53 | 
  <hoo> | 
  Attached WeiaR@enwiki to the global account of the same name. T115699 | 
  [production] | 
            
  | 15:50 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/WikimediaEvents/: Revert SearchSatisfaction schema related changes due to suspected perf impact (duration: 00m 18s) | 
  [production] | 
            
  | 15:49 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/: Revert SearchSatisfaction schema related changes due to suspected perf impact (duration: 00m 18s) | 
  [production] | 
            
  | 15:38 | 
  <akosiaris> | 
  depooled mw1083 | 
  [production] | 
            
  | 15:29 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: touch and re-sync InitialiseSettings.php to bust cache (duration: 00m 17s) | 
  [production] | 
            
  | 15:24 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: CirrusSearch multi-datacenter configuration (duration: 00m 17s) | 
  [production] | 
            
  | 15:24 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/CommonSettings.php: CirrusSearch multi-datacenter configuration (duration: 00m 17s) | 
  [production] | 
            
  | 15:23 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/CirrusSearch-common.php: CirrusSearch multi-datacenter configuration (duration: 00m 17s) | 
  [production] | 
            
  | 15:23 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/CirrusSearch-production.php: CirrusSearch multi-datacenter configuration (duration: 00m 17s) | 
  [production] | 
            
  | 15:18 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/Cite/Cite_body.php: Do not double-parse error references duplicate key (duration: 00m 17s) | 
  [production] | 
            
  | 15:16 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/Cite/Cite_body.php: Do not double-parse error references duplicate key (duration: 00m 19s) | 
  [production] | 
            
  | 15:00 | 
  <aude> | 
  rsync failed on mw1083: "failed to set times on "/srv/mediawiki/wmf-config": Read-only file system" | 
  [production] | 
            
  | 14:49 | 
  <aude@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable GeoData on test.wikidata (duration: 00m 18s) | 
  [production] | 
            
  | 14:34 | 
  <aude@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: enabled geodata on beta wikidata (duration: 00m 18s) | 
  [production] | 
            
  | 14:08 | 
  <jynus> | 
  applying schema change to testwikidatawiki (s3) and wikidatawiki(s5) | 
  [production] | 
            
  | 13:56 | 
  <jynus> | 
  performing schema change on testwiki.geo_tags | 
  [production] | 
            
  | 13:35 | 
  <jynus> | 
  stopping and fixing replication on labsdb1004 (not in production) | 
  [production] | 
            
  | 08:40 | 
  <mobrovac> | 
  restbase deployment of 3006b77e {{done}} | 
  [production] | 
            
  | 08:32 | 
  <mobrovac> | 
  restbase deploying 3006b77e | 
  [production] | 
            
  | 07:36 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Wed Oct 21 07:36:04 UTC 2015 (duration 36m 3s) | 
  [production] | 
            
  | 03:13 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-21 03:13:42+00:00 | 
  [production] | 
            
  | 03:09 | 
  <l10nupdate@tin> | 
  Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 24s) | 
  [production] | 
            
  | 02:42 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-21 02:42:44+00:00 | 
  [production] | 
            
  | 02:37 | 
  <l10nupdate@tin> | 
  Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 05s) | 
  [production] | 
            
  | 01:12 | 
  <hoo@tin> | 
  Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 17s) | 
  [production] | 
            
  | 01:03 | 
  <hoo@tin> | 
  Synchronized wmf-config/interwiki.cdb: revert (duration: 00m 18s) | 
  [production] | 
            
  | 01:03 | 
  <hoo@tin> | 
  Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 17s) | 
  [production] | 
            
  | 00:29 | 
  <legoktm> | 
  wikidata'd everything | 
  [production] | 
            
  | 00:22 | 
  <hoo@tin> | 
  Synchronized dblists/: Enable WikibaseClient on mediawikiwiki, metawiki and specieswiki (duration: 00m 17s) | 
  [production] | 
            
  | 00:19 | 
  <hoo@tin> | 
  Synchronized wmf-config/: Enable WikibaseClient on mediawikiwiki, metawiki and specieswiki (duration: 00m 19s) | 
  [production] | 
            
  
    | 
      
        2015-10-20
      
      §
     | 
  
    
  | 23:54 | 
  <hoo@tin> | 
  Synchronized wmf-config/: Add MediaWiki, Meta-Wiki and Wikispecies to Wikibase special site groups (duration: 00m 18s) | 
  [production] | 
            
  | 23:47 | 
  <hoo@tin> | 
  Synchronized wmf-config/: Add MediaWiki, Meta-Wiki and Wikispecies to Wikibase special site groups (testwikidata) (duration: 00m 18s) | 
  [production] | 
            
  | 23:36 | 
  <krenair@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/WikimediaEventsHooks.php: https://gerrit.wikimedia.org/r/#/c/247650/ (duration: 00m 17s) | 
  [production] | 
            
  | 23:26 | 
  <hoo@tin> | 
  Synchronized wmf-config/: Revert "Temporarily disable "item-merge" right on Wikidata" (duration: 00m 18s) | 
  [production] | 
            
  | 23:25 | 
  <aaron@tin> | 
  Synchronized php-1.27.0-wmf.3/includes/deferred: 2a1e1d7dd88a62aba9 (duration: 00m 17s) | 
  [production] | 
            
  | 23:22 | 
  <hoo@tin> | 
  Synchronized wmf-config/: Bump the cache epoch for (test)wikidata (duration: 00m 18s) | 
  [production] | 
            
  | 23:20 | 
  <hoo@tin> | 
  Finished scap: Update Wikibase to wmf3b and add messages for sitelinks to MediaWiki, Meta-Wiki and Wikispecies (duration: 48m 44s) | 
  [production] | 
            
  | 23:16 | 
  <mutante> | 
  mw1232: restarted hhvm  | 
  [production] | 
            
  | 22:31 | 
  <hoo@tin> | 
  Started scap: Update Wikibase to wmf3b and add messages for sitelinks to MediaWiki, Meta-Wiki and Wikispecies | 
  [production] | 
            
  | 21:11 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.3/includes/page/WikiPage.php: I5d0440588d: Make triggerOpportunisticLinksUpdate() directly use RefreshLinks (T116001) (duration: 00m 17s) | 
  [production] | 
            
  | 21:11 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.2/includes/page/WikiPage.php: I5d0440588d: Make triggerOpportunisticLinksUpdate() directly use RefreshLinks (T116001) (duration: 00m 18s) | 
  [production] | 
            
  | 20:23 | 
  <gwicke> | 
  reverted restbase deploy on restbase1001 to a4c55e40 | 
  [production] | 
            
  | 20:15 | 
  <mutante> | 
  starting restbase on restbase1001 | 
  [production] | 
            
  | 20:09 | 
  <mutante> | 
  errors argon' on argon  | 
  [production] | 
            
  | 20:04 | 
  <ottomata> | 
  uninstalling hadoop packages on analytics1017 | 
  [production] | 
            
  | 19:46 | 
  <ori> | 
  previous syncs was of I46200d4edb3: Revert "Revert "Revert "Enable config for all three search clusters, but only write to eqiad""" | 
  [production] |