| 2015-10-29
      
      § | 
    
  | 19:50 | <ori@tin> | Synchronized wmf-config/CommonSettings.php: I06879b6e6e: Enable ScribuntoGatherFunctionStats (duration: 00m 17s) | [production] | 
            
  | 19:40 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedia wikis to 1.27.0-wmf.3 | [production] | 
            
  | 19:39 | <twentyafterfour> | rolling back to 1.27.0-wmf.3 due to increase in log errors | [production] | 
            
  | 19:31 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedia wikis to 1.27.0-wmf.4 | [production] | 
            
  | 18:59 | <cmjohnson1> | powering down aqs1001 for h/w maintenance | [production] | 
            
  | 17:53 | <AaronSchulz> | Touched/synced PrivateSettings.php symlink via touch -h | [production] | 
            
  | 17:47 | <aaron@tin> | Synchronized wmf-config/PrivateSettings.php: (no message) (duration: 00m 18s) | [production] | 
            
  | 17:36 | <AaronSchulz> | Did touch of InitialiseSettings.php | [production] | 
            
  | 17:33 | <aaron@tin> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 18s) | [production] | 
            
  | 17:32 | <aaron@tin> | Synchronized private/PrivateSettings.php: (no message) (duration: 00m 17s) | [production] | 
            
  | 17:17 | <kartik@tin> | Synchronized wmf-config/PrivateSettings.php: Really sync right file this time (duration: 00m 17s) | [production] | 
            
  | 17:10 | <kartik@tin> | Synchronized private/PrivateSettings.php: Retry syncing for CX token (duration: 00m 17s) | [production] | 
            
  | 16:57 | <YuviPanda> | restart etherpad on etherpad1001 | [production] | 
            
  | 16:22 | <moritzm> | removed obsolete mysql 5.5 packages on mw102[2-9], mw1032, mw1053, mw1114, mw1163 | [production] | 
            
  | 16:19 | <_joe_> | moved purge_abusefilter from terbium to mw1152 | [production] | 
            
  | 15:48 | <_joe_> | moving purge_checkuser from terbium to mw1152 | [production] | 
            
  | 15:43 | <_joe_> | moving purge_securepoll from terbium to mw1152 | [production] | 
            
  | 15:15 | <moritzm> | removed openjdk-7 on restbase100[1-9] (it's using openjdk-8 for a while) | [production] | 
            
  | 13:17 | <kartik@tin> | Synchronized wmf-config/CommonSettings.php: Fix ContentTranslationCXServerAuth for CX (duration: 00m 18s) | [production] | 
            
  | 13:14 | <kartik@tin> | Synchronized private/PrivateSettings.php: Fix name of JWT token (duration: 00m 18s) | [production] | 
            
  | 12:33 | <kartik@tin> | Synchronized wmf-config/CommonSettings.php: Set ContentTranslationCXServerAuth for CX (duration: 00m 17s) | [production] | 
            
  | 11:24 | <mobrovac> | restbase rolling-restart after config change https://gerrit.wikimedia.org/r/249465 | [production] | 
            
  | 10:41 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1065 at 100% load. Reduce db1035 weight. (duration: 00m 17s) | [production] | 
            
  | 10:34 | <_joe_> | migrated jobqueue_stats_reporter to mw1152 | [production] | 
            
  | 10:21 | <hashar> | restarting Jenkins (java upgrade) | [production] | 
            
  | 10:20 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1065 after maintenance (duration: 00m 18s) | [production] | 
            
  | 10:14 | <hashar> | Upgrading java on gallium and restarting Jenkins | [production] | 
            
  | 10:04 | <moritzm> | removed openjdk-7 from cassandra test hosts (now using openjdk-8) | [production] | 
            
  | 10:00 | <aude@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable nearby on wikidata (duration: 00m 18s) | [production] | 
            
  | 10:00 | <aude@tin> | Synchronized wmf-config/Wikibase.php: Config for fetching labels on mobile wikidata (duration: 00m 18s) | [production] | 
            
  | 09:51 | <jynus> | shutdown mw1083 to avoid querying the mysql servers with an outdated config/spaming the error logs | [production] | 
            
  | 09:13 | <jynus> | restarting db1065 for regular maintenace | [production] | 
            
  | 08:59 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1065 for maintenance (duration: 00m 17s) | [production] | 
            
  | 07:04 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Thu Oct 29 07:04:04 UTC 2015 (duration 4m 3s) | [production] | 
            
  | 06:43 | <YuviPanda> | disabled two fr-tech related catchpoint tests per awight's request | [production] | 
            
  | 06:30 | <aaron@tin> | Synchronized rpc/RunJobs.php: 29ccbd248 (duration: 00m 17s) | [production] | 
            
  | 05:46 | <ebernhardson> | finished manually running 3M enwiki/enqueue, enwiki/wikibase-addUsagesForPage, and wikidatawiki/cirrusSearchLinksUpdatePrioritized jobs from mw1011 and mw1012 | [production] | 
            
  | 05:38 | <ebernhardson> | restarting elasticsearch on nobelium to attempt to clear up extra log GC pauses in the old generation (50s+) | [production] | 
            
  | 05:37 | <ebernhardson> | restarting elasticsearch on nobelium | [production] | 
            
  | 03:55 | <gwicke> | cassandra *staging*: testing DateTieredCompactionStrategy (https://labs.spotify.com/2014/12/18/date-tiered-compaction/) on wikipedia html and data-parsoid tables | [production] | 
            
  | 03:05 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.4) at 2015-10-29 03:05:52+00:00 | [production] | 
            
  | 03:02 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.4/cache/l10n: l10nupdate for 1.27.0-wmf.4 (duration: 06m 03s) | [production] | 
            
  | 02:59 | <YuviPanda> | start pybal on lvs1007 | [production] | 
            
  | 02:46 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-29 02:46:27+00:00 | [production] | 
            
  | 02:39 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 10m 47s) | [production] | 
            
  | 02:05 | <AaronSchulz> | Restarted stuck hhvm on mw1016; dump at /tmp/hhvm.25097.bt | [production] | 
            
  | 01:06 | <gwicke> | lowered gc_grace on wikipedia parsoid html and data-parsoid keyspaces to 24 hours | [production] |