| 
      
        2016-04-12
      
      §
     | 
  
    
  | 08:01 | 
  <elukey> | 
  restarted hhvm on mw1111 - multiple SEGV signals, hhvm-dump-debug in /tmp/hhvm.8424.bt. | 
  [production] | 
            
  | 08:00 | 
  <volans> | 
  Set rpl_semi_sync_master_timeout=100 on db1038 T131753 (filling up erro log) | 
  [production] | 
            
  | 02:33 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Tue Apr 12 02:33:25 UTC 2016 (duration 8m 34s) | 
  [production] | 
            
  | 02:24 | 
  <mwdeploy@tin> | 
  sync-l10n completed (1.27.0-wmf.20) (duration: 11m 20s) | 
  [production] | 
            
  | 00:37 | 
  <ori> | 
  Deleted refreshLinksDynamic jobs for commonswiki and enwiki (T132318) | 
  [production] | 
            
  | 00:34 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.20/includes/page/WikiPage.php: Ie9799f5ea: Flag triggerOpportunisticLinksUpdate() behind $wgMiserMode (duration: 00m 31s) | 
  [production] | 
            
  | 00:11 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.20/includes/collation/IcuCollation.php: Ie9799f5ea: Cache first-letter data in APC, if available (duration: 00m 25s) | 
  [production] | 
            
  | 00:07 | 
  <dereckson@tin> | 
  Synchronized php-1.27.0-wmf.20/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.ArticleTargetLoader.js: Check wpSection before converting textbox contents for use in VE ([[Gerrit:282827]]) (duration: 00m 25s) | 
  [production] | 
            
  
    | 
      
        2016-04-11
      
      §
     | 
  
    
  | 23:34 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: Fix wgCopyUploadsDomains on Commons Beta (Task T132285, [[Gerrit:282495]]) — 2/2 (duration: 00m 25s) | 
  [production] | 
            
  | 23:33 | 
  <dereckson@tin> | 
  Synchronized wmf-config/CommonSettings-labs.php: Fix wgCopyUploadsDomains on Commons Beta (Task T132285, [[Gerrit:282495]]) — 1/2 (duration: 00m 26s) | 
  [production] | 
            
  | 23:30 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Add mergehistory right to eliminator group on ja.wikipedia (Task T131751, [[Gerrit:282055]]) (duration: 00m 29s) | 
  [production] | 
            
  | 23:25 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Set wgSemiprotectedRestrictionLevels for fr.wikipedia (Task T132248, [[Gerrit:282469]]) (duration: 00m 29s) | 
  [production] | 
            
  | 23:20 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki idwiki (T45917) | 
  [production] | 
            
  | 23:19 | 
  <dereckson@tin> | 
  Synchronized wmf-config/CommonSettings.php: Remove $wgApiFrameOptions = SAMEORIGIN override for UploadWizard wikis (Task T131182, [[Gerrit:282768]]) (duration: 00m 31s) | 
  [production] | 
            
  | 23:17 | 
  <dereckson@tin> | 
  Synchronized static/images/project-logos/vecwiki.png: New logo for vec.wikipedia (and end of celebration logo) (Task T132185, [[Gerrit:282396]]) (duration: 00m 24s) | 
  [production] | 
            
  | 23:12 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki zh_classicalwiki (T45917) | 
  [production] | 
            
  | 23:09 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Remove $wgApiFrameOptions = SAMEORIGIN override for UploadWizard wikis (Task T131182, [[Gerrit:282768]]) (duration: 00m 27s) | 
  [production] | 
            
  | 22:11 | 
  <volans@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1049 after deploy of Puppet certs for TLS - T111654 (duration: 00m 30s) | 
  [production] | 
            
  | 22:07 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.20/includes/page/WikiPage.php: Ie9799f5ea: Increase triggerOpportunisticLinksUpdate() backoff TTL (duration: 00m 34s) | 
  [production] | 
            
  | 22:03 | 
  <mutante> | 
  creating virtual machine furud.codfw.wmnet | 
  [production] | 
            
  | 21:29 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki bgwikiquote (T45917) | 
  [production] | 
            
  | 21:29 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki frwikibooks (T45917) | 
  [production] | 
            
  | 21:22 | 
  <ebernhardson> | 
  restore elasticsearch cluster high disk watermark to 90% | 
  [production] | 
            
  | 21:07 | 
  <csteipp@tin> | 
  Synchronized wmf-config/CommonSettings-labs.php: revert oath in labs (duration: 00m 27s) | 
  [production] | 
            
  | 21:06 | 
  <csteipp@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: reverting oath (duration: 00m 29s) | 
  [production] | 
            
  | 21:01 | 
  <bearND> | 
  mobileapps deployed 6ef3054 | 
  [production] | 
            
  | 20:55 | 
  <csteipp@tin> | 
  Synchronized wmf-config/CommonSettings-labs.php: retry oath in labs (duration: 00m 29s) | 
  [production] | 
            
  | 20:53 | 
  <csteipp@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: retry oath in labs (duration: 00m 32s) | 
  [production] | 
            
  | 20:43 | 
  <bearND> | 
  starting mobileapps deploy | 
  [production] | 
            
  | 20:41 | 
  <Krinkle> | 
  mwscript deleteEqualMessages.php --wiki plwiki (T45917) | 
  [production] | 
            
  | 20:19 | 
  <arlolra> | 
  updated Parsoid to version e3766b79 | 
  [production] | 
            
  | 20:09 | 
  <arlolra> | 
  synced code; restarted Parsoid on wtp1001.eqiad as a canary | 
  [production] | 
            
  | 20:05 | 
  <ebernhardson> | 
  temporarily changing elasticsearch high watermark to 75% to rebalance cluster | 
  [production] | 
            
  | 20:03 | 
  <volans> | 
  Deploy and use Puppet certs for TLS on cross-dc replica for shard s5 T111654 | 
  [production] | 
            
  | 20:00 | 
  <mutante> | 
  antimony - shred and delete git.wikimedia.org SSL key | 
  [production] | 
            
  | 19:57 | 
  <volans@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1049 to deploy Pupper certs for TLS - T111654 (duration: 00m 28s) | 
  [production] | 
            
  | 19:55 | 
  <mutante> | 
  antimony - remove Apache package and config | 
  [production] | 
            
  | 19:53 | 
  <volans@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1049 to deploy Pupper certs for TLS - T111654 (duration: 02m 25s) | 
  [production] | 
            
  | 19:52 | 
  <mutante> | 
  powercycled mw1115 | 
  [production] | 
            
  | 19:41 | 
  <mutante> | 
  antimony (gitblit) - stop Apache  | 
  [production] | 
            
  | 19:15 | 
  <ejegg> | 
  extende globalcollect audit timeout from 90 min to 120 min for duration of NL campaign | 
  [production] | 
            
  | 19:01 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.20/extensions/WikimediaEvents: I672624e9fc30: Collect impact of proposed ResourceLoader feature-test in statsd (duration: 00m 34s) | 
  [production] | 
            
  | 18:08 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.20/includes/RevisionList.php: Undo oversight live hack (duration: 00m 25s) | 
  [production] | 
            
  | 17:49 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.20/includes/RevisionList.php: Attempt to fix oversight timeouts (duration: 00m 28s) | 
  [production] | 
            
  | 17:44 | 
  <gehel> | 
  rebooting wdqs1002 for kernel upgrade | 
  [production] | 
            
  | 17:36 | 
  <gehel> | 
  rebooting wdqs1001 | 
  [production] | 
            
  | 17:28 | 
  <gehel> | 
  deploying latest WDQS version | 
  [production] | 
            
  | 16:16 | 
  <ejegg> | 
  updated payments from f71d3fbc7b8331b0427748b3fd358b5e2fc626fa to f09297028acace67588c2de845b754e2ace75c97 | 
  [production] | 
            
  | 15:59 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: Match JsonConfig change [[gerrit:282447]] (duration: 00m 25s) | 
  [production] | 
            
  | 15:54 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert "Enable Echo survey on French-language wikis" (duration: 00m 26s) | 
  [production] |