| 2015-10-29
      
      ยง | 
    
  | 23:32 | <bd808> | Restarted logstash on logstash1003; died with OOM error | [production] | 
            
  | 23:24 | <ori@tin> | Synchronized php-1.27.0-wmf.4/extensions/Scribunto/engines/LuaSandbox/Engine.php: I69e9218 (duration: 00m 18s) | [production] | 
            
  | 23:21 | <mutante> | radium: scheduled downtime, reinstalling | [production] | 
            
  | 23:19 | <catrope@tin> | Synchronized php-1.27.0-wmf.4/extensions/CirrusSearch/: Fix unwritable cluster errors (duration: 00m 19s) | [production] | 
            
  | 23:18 | <catrope@tin> | Synchronized php-1.27.0-wmf.4/extensions/Flow: Fix CAPTCHA rendering in RTL languages (duration: 00m 19s) | [production] | 
            
  | 23:17 | <catrope@tin> | Synchronized php-1.27.0-wmf.4/extensions/Scribunto/: Make the percentile threshold for slow function stats configurable (duration: 00m 18s) | [production] | 
            
  | 23:16 | <catrope@tin> | Synchronized php-1.27.0-wmf.4/resources/src/mediawiki.special/mediawiki.special.search.css: SWAT: styling tweaks for inline interwiki search (duration: 00m 18s) | [production] | 
            
  | 22:33 | <tgr@tin> | Synchronized php-1.27.0-wmf.4/extensions/ZeroBanner/includes/ZeroSpecialPage.php: T116821 (duration: 00m 17s) | [production] | 
            
  | 22:31 | <tgr@tin> | Synchronized php-1.27.0-wmf.4/includes/MagicWord.php: T117066, fixes some exceptions in production (duration: 00m 17s) | [production] | 
            
  | 22:30 | <tgr@tin> | Synchronized php-1.27.0-wmf.4/includes/specials/SpecialSearch.php: c249899, fixes some warnings in production (duration: 00m 17s) | [production] | 
            
  | 22:29 | <tgr@tin> | Synchronized php-1.27.0-wmf.4/includes/Category.php: c249890, fixes some warnings in production (duration: 00m 18s) | [production] | 
            
  | 22:02 | <gwicke> | restbase: switched  local_group_default_T_parsoid_html to Date-Tiered compaction (DTCS) | [production] | 
            
  | 21:40 | <tgr@tin> | Synchronized php-1.27.0-wmf.4/includes/MagicWord.php: T117066 (duration: 00m 18s) | [production] | 
            
  | 21:32 | <ori@tin> | Synchronized php-1.27.0-wmf.4/includes/libs/Xhprof.php: (no message) (duration: 00m 18s) | [production] | 
            
  | 21:06 | <ori@tin> | Synchronized php-1.27.0-wmf.4/extensions/Cite/Cite_body.php: Revert "Avoid counting arrays if not needed" (duration: 00m 17s) | [production] | 
            
  | 20:56 | <gwicke> | restbase: switch local_group_wikiquote_T_title__revisions to Date-Tiered compaction (DTCS) | [production] | 
            
  | 20:47 | <ori@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: (no message) | [production] | 
            
  | 19:50 | <ori@tin> | Synchronized wmf-config/CommonSettings.php: I06879b6e6e: Enable ScribuntoGatherFunctionStats (duration: 00m 17s) | [production] | 
            
  | 19:40 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedia wikis to 1.27.0-wmf.3 | [production] | 
            
  | 19:39 | <twentyafterfour> | rolling back to 1.27.0-wmf.3 due to increase in log errors | [production] | 
            
  | 19:31 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedia wikis to 1.27.0-wmf.4 | [production] | 
            
  | 18:59 | <cmjohnson1> | powering down aqs1001 for h/w maintenance | [production] | 
            
  | 17:53 | <AaronSchulz> | Touched/synced PrivateSettings.php symlink via touch -h | [production] | 
            
  | 17:47 | <aaron@tin> | Synchronized wmf-config/PrivateSettings.php: (no message) (duration: 00m 18s) | [production] | 
            
  | 17:36 | <AaronSchulz> | Did touch of InitialiseSettings.php | [production] | 
            
  | 17:33 | <aaron@tin> | Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 18s) | [production] | 
            
  | 17:32 | <aaron@tin> | Synchronized private/PrivateSettings.php: (no message) (duration: 00m 17s) | [production] | 
            
  | 17:17 | <kartik@tin> | Synchronized wmf-config/PrivateSettings.php: Really sync right file this time (duration: 00m 17s) | [production] | 
            
  | 17:10 | <kartik@tin> | Synchronized private/PrivateSettings.php: Retry syncing for CX token (duration: 00m 17s) | [production] | 
            
  | 16:57 | <YuviPanda> | restart etherpad on etherpad1001 | [production] | 
            
  | 16:22 | <moritzm> | removed obsolete mysql 5.5 packages on mw102[2-9], mw1032, mw1053, mw1114, mw1163 | [production] | 
            
  | 16:19 | <_joe_> | moved purge_abusefilter from terbium to mw1152 | [production] | 
            
  | 15:48 | <_joe_> | moving purge_checkuser from terbium to mw1152 | [production] | 
            
  | 15:43 | <_joe_> | moving purge_securepoll from terbium to mw1152 | [production] | 
            
  | 15:15 | <moritzm> | removed openjdk-7 on restbase100[1-9] (it's using openjdk-8 for a while) | [production] | 
            
  | 13:17 | <kartik@tin> | Synchronized wmf-config/CommonSettings.php: Fix ContentTranslationCXServerAuth for CX (duration: 00m 18s) | [production] | 
            
  | 13:14 | <kartik@tin> | Synchronized private/PrivateSettings.php: Fix name of JWT token (duration: 00m 18s) | [production] | 
            
  | 12:33 | <kartik@tin> | Synchronized wmf-config/CommonSettings.php: Set ContentTranslationCXServerAuth for CX (duration: 00m 17s) | [production] | 
            
  | 11:24 | <mobrovac> | restbase rolling-restart after config change https://gerrit.wikimedia.org/r/249465 | [production] | 
            
  | 10:41 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1065 at 100% load. Reduce db1035 weight. (duration: 00m 17s) | [production] | 
            
  | 10:34 | <_joe_> | migrated jobqueue_stats_reporter to mw1152 | [production] | 
            
  | 10:21 | <hashar> | restarting Jenkins (java upgrade) | [production] | 
            
  | 10:20 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1065 after maintenance (duration: 00m 18s) | [production] | 
            
  | 10:14 | <hashar> | Upgrading java on gallium and restarting Jenkins | [production] | 
            
  | 10:04 | <moritzm> | removed openjdk-7 from cassandra test hosts (now using openjdk-8) | [production] | 
            
  | 10:00 | <aude@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable nearby on wikidata (duration: 00m 18s) | [production] | 
            
  | 10:00 | <aude@tin> | Synchronized wmf-config/Wikibase.php: Config for fetching labels on mobile wikidata (duration: 00m 18s) | [production] | 
            
  | 09:51 | <jynus> | shutdown mw1083 to avoid querying the mysql servers with an outdated config/spaming the error logs | [production] | 
            
  | 09:13 | <jynus> | restarting db1065 for regular maintenace | [production] | 
            
  | 08:59 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1065 for maintenance (duration: 00m 17s) | [production] |