| 
      
        2015-10-30
      
      §
     | 
  
    
  | 23:53 | 
  <ori@tin> | 
  Synchronized wmf-config/CommonSettings.php: Ifd3543d99: Re-enabled sidebar cache per 47eb083a0fe4 (duration: 00m 17s) | 
  [production] | 
            
  | 23:38 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.4/includes/cache/MessageCache.php: Id9a27ba2bbd3 (duration: 00m 17s) | 
  [production] | 
            
  | 23:38 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.4/includes/skins/Skin.php: Id9a27ba2bbd3 (duration: 00m 17s) | 
  [production] | 
            
  | 23:37 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.4/extensions/Collection: b89cff0a1d: Updated mediawiki/core Project: mediawiki/extensions/Collection  092204bf333e65b2c749e4bc4a32fd2b0254089b (duration: 00m 18s) | 
  [production] | 
            
  | 23:37 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.4/extensions/DismissableSiteNotice: a20aa8a544: Updated mediawiki/core Project: mediawiki/extensions/DismissableSiteNotice  5b8f1cfac48704fd740eb61f873aabb600c4c5fb (duration: 00m 17s) | 
  [production] | 
            
  | 23:03 | 
  <gwicke> | 
  fixed restbase labs install by deploying it; the code had gone missing | 
  [production] | 
            
  | 23:03 | 
  <ori> | 
  Added MaxSem and gwicke to Gerrit Project Creators group | 
  [production] | 
            
  | 22:44 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.4/includes/objectcache/ObjectCache.php: If12aedae7f: objectcache: Use singleton cache in newAccelerator() (duration: 00m 18s) | 
  [production] | 
            
  | 22:05 | 
  <ori@tin> | 
  Synchronized docroot and w: (no message) (duration: 00m 17s) | 
  [production] | 
            
  | 22:01 | 
  <mutante> | 
  labvirt1010: salt-minion always in "stop/waiting", doesn't restart | 
  [production] | 
            
  | 21:54 | 
  <mutante> | 
  labvirt1010 - start salt | 
  [production] | 
            
  | 21:41 | 
  <ori> | 
  Removing MediaWiki.xhprof.* from graphite{1,2}001 | 
  [production] | 
            
  | 21:41 | 
  <ori@tin> | 
  Synchronized wmf-config/StartProfiler.php: I0bfa21b5: Disable xhprof profiling to relieve storage pressure on graphite (duration: 00m 18s) | 
  [production] | 
            
  | 18:56 | 
  <jynus> | 
  disabling puppet and restarting mysql on es2008, es2009 and es2010- downtime planned for 2 hours - no production impact | 
  [production] | 
            
  | 17:33 | 
  <robh> | 
  bismuth has no console output, appears locked up in OS, rebooting via mgmt | 
  [production] | 
            
  | 17:22 | 
  <ori@tin> | 
  Synchronized docroot and w: (no message) (duration: 00m 18s) | 
  [production] | 
            
  | 16:56 | 
  <cmjohnson> | 
  reinstalling mw1083 https://phabricator.wikimedia.org/T116184 | 
  [production] | 
            
  | 15:35 | 
  <moritzm> | 
  updated db205[6-8] to the 3.19 kernel | 
  [production] | 
            
  | 14:38 | 
  <chasemp> | 
  nobelium in downtime -- this is a temporary test host for discovery and is not ops actionable | 
  [production] | 
            
  | 13:47 | 
  <Krenair> | 
  revert commit for https://gerrit.wikimedia.org/r/#/c/249971/ on tin | 
  [production] | 
            
  | 13:47 | 
  <krenair@tin> | 
  Synchronized php-1.27.0-wmf.4/extensions/VisualEditor/VisualEditor.hooks.php: https://gerrit.wikimedia.org/r/#/c/249999/ (duration: 00m 17s) | 
  [production] | 
            
  | 11:57 | 
  <paravoid> | 
  upgrading tor to latest stable on radium | 
  [production] | 
            
  | 11:31 | 
  <paravoid> | 
  ignoring asw-d-eqiad on librenms | 
  [production] | 
            
  | 11:25 | 
  <_joe_> | 
  powercycling dataset1001, stuck in some kernel task, unable to login from console | 
  [production] | 
            
  | 10:42 | 
  <dcausse> | 
  elastic in eqiad setting indexing trace threshold to -1 for commons, ruwiki, frwiki and itwiki | 
  [production] | 
            
  | 10:30 | 
  <dcausse> | 
  elastic in eqiad wide settings for indexing slow threshold are ineffective, trying to set index settings (T117181) | 
  [production] | 
            
  | 09:18 | 
  <dcausse> | 
  elastic in eqiad setting index.indexing.slowlog.threshold.index.trace to -1 | 
  [production] | 
            
  | 08:46 | 
  <_joe_> | 
  removed production-search-eqiad_index_indexing_slowlog.log.{7,8} on es1008 | 
  [production] | 
            
  | 06:24 | 
  <krinkle@tin> | 
  Synchronized php-1.27.0-wmf.4/includes/jobqueue/JobQueueRedis.php: (no message) (duration: 00m 18s) | 
  [production] | 
            
  | 05:11 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Fri Oct 30 05:11:08 UTC 2015 (duration 11m 7s) | 
  [production] | 
            
  | 04:19 | 
  <ori@tin> | 
  Synchronized wmf-config/CommonSettings.php: I1d0337b58: ScribuntoSlowFunctionThreshold: 0.90 -> 0.99 (duration: 00m 17s) | 
  [production] | 
            
  | 04:05 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.4/extensions/Scribunto/common/Hooks.php: I60b9eb617: When logging perf stats, include wfWikiId() in metric key (duration: 00m 18s) | 
  [production] | 
            
  | 02:30 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.27.0-wmf.4) at 2015-10-30 02:30:50+00:00 | 
  [production] | 
            
  | 02:27 | 
  <l10nupdate@tin> | 
  Synchronized php-1.27.0-wmf.4/cache/l10n: l10nupdate for 1.27.0-wmf.4 (duration: 06m 13s) | 
  [production] | 
            
  | 00:48 | 
  <tgr@tin> | 
  Synchronized php-1.27.0-wmf.4/includes/specials/SpecialUserlogin.php: T117027 (duration: 00m 18s) | 
  [production] | 
            
  | 00:34 | 
  <mutante> | 
  labvirt1010 - started salt-minion (no such process) | 
  [production] | 
            
  | 00:34 | 
  <mutante> | 
  mw1193 - restarted HHVM (socket timeout) | 
  [production] | 
            
  | 00:34 | 
  <mutante> | 
  wdqs1001 - restarted NTP (unknown offset) | 
  [production] | 
            
  | 00:09 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.4/extensions/Flow/: Fix regressions from SWAT (duration: 00m 20s) | 
  [production] | 
            
  | 00:08 | 
  <mutante> | 
  radium - back in service | 
  [production] | 
            
  | 00:01 | 
  <bd808> | 
  Restarted logstash on logstash1003 again. The first try apparently didn't take | 
  [production] |