| 2016-04-12
      
      § | 
    
  | 11:34 | <hashar> | Jenkins upgrading "Script Security Plugin" from 1.17 to 1.18.1 https://wiki.jenkins-ci.org/display/SECURITY/Jenkins+Security+Advisory+2016-04-11 | [production] | 
            
  | 11:19 | <tgr> | running CentralAuth/checkLocalUsers.php --delete on all wikis for T119736 | [production] | 
            
  | 11:10 | <godog> | start raid expansion on restbase2006 T127951 | [production] | 
            
  | 11:03 | <godog> | repool restbase2005 / depool restbase2006 | [production] | 
            
  | 10:16 | <ema> | restarted varnishstatsd-default.service on cp4017 (T132430) | [production] | 
            
  | 09:55 | <hoo> | Updated Wikidata's property suggester with data from Monday's json dump | [production] | 
            
  | 09:21 | <ema> | varnishstatsd-default restarted on cp4010 and cp4018 | [production] | 
            
  | 08:35 | <moritzm> | installing ntp bugfix updates (will trigger some ntpd Icinga warnings until the clocks have resynced) | [production] | 
            
  | 08:01 | <elukey> | restarted hhvm on mw1111 - multiple SEGV signals, hhvm-dump-debug in /tmp/hhvm.8424.bt. | [production] | 
            
  | 08:00 | <volans> | Set rpl_semi_sync_master_timeout=100 on db1038 T131753 (filling up erro log) | [production] | 
            
  | 02:33 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Tue Apr 12 02:33:25 UTC 2016 (duration 8m 34s) | [production] | 
            
  | 02:24 | <mwdeploy@tin> | sync-l10n completed (1.27.0-wmf.20) (duration: 11m 20s) | [production] | 
            
  | 00:37 | <ori> | Deleted refreshLinksDynamic jobs for commonswiki and enwiki (T132318) | [production] | 
            
  | 00:34 | <ori@tin> | Synchronized php-1.27.0-wmf.20/includes/page/WikiPage.php: Ie9799f5ea: Flag triggerOpportunisticLinksUpdate() behind $wgMiserMode (duration: 00m 31s) | [production] | 
            
  | 00:11 | <ori@tin> | Synchronized php-1.27.0-wmf.20/includes/collation/IcuCollation.php: Ie9799f5ea: Cache first-letter data in APC, if available (duration: 00m 25s) | [production] | 
            
  | 00:07 | <dereckson@tin> | Synchronized php-1.27.0-wmf.20/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.ArticleTargetLoader.js: Check wpSection before converting textbox contents for use in VE ([[Gerrit:282827]]) (duration: 00m 25s) | [production] | 
            
  
    | 2016-04-11
      
      § | 
    
  | 23:34 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: Fix wgCopyUploadsDomains on Commons Beta (Task T132285, [[Gerrit:282495]]) — 2/2 (duration: 00m 25s) | [production] | 
            
  | 23:33 | <dereckson@tin> | Synchronized wmf-config/CommonSettings-labs.php: Fix wgCopyUploadsDomains on Commons Beta (Task T132285, [[Gerrit:282495]]) — 1/2 (duration: 00m 26s) | [production] | 
            
  | 23:30 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Add mergehistory right to eliminator group on ja.wikipedia (Task T131751, [[Gerrit:282055]]) (duration: 00m 29s) | [production] | 
            
  | 23:25 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Set wgSemiprotectedRestrictionLevels for fr.wikipedia (Task T132248, [[Gerrit:282469]]) (duration: 00m 29s) | [production] | 
            
  | 23:20 | <Krinkle> | mwscript deleteEqualMessages.php --wiki idwiki (T45917) | [production] | 
            
  | 23:19 | <dereckson@tin> | Synchronized wmf-config/CommonSettings.php: Remove $wgApiFrameOptions = SAMEORIGIN override for UploadWizard wikis (Task T131182, [[Gerrit:282768]]) (duration: 00m 31s) | [production] | 
            
  | 23:17 | <dereckson@tin> | Synchronized static/images/project-logos/vecwiki.png: New logo for vec.wikipedia (and end of celebration logo) (Task T132185, [[Gerrit:282396]]) (duration: 00m 24s) | [production] | 
            
  | 23:12 | <Krinkle> | mwscript deleteEqualMessages.php --wiki zh_classicalwiki (T45917) | [production] | 
            
  | 23:09 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Remove $wgApiFrameOptions = SAMEORIGIN override for UploadWizard wikis (Task T131182, [[Gerrit:282768]]) (duration: 00m 27s) | [production] | 
            
  | 22:11 | <volans@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1049 after deploy of Puppet certs for TLS - T111654 (duration: 00m 30s) | [production] | 
            
  | 22:07 | <ori@tin> | Synchronized php-1.27.0-wmf.20/includes/page/WikiPage.php: Ie9799f5ea: Increase triggerOpportunisticLinksUpdate() backoff TTL (duration: 00m 34s) | [production] | 
            
  | 22:03 | <mutante> | creating virtual machine furud.codfw.wmnet | [production] | 
            
  | 21:29 | <Krinkle> | mwscript deleteEqualMessages.php --wiki bgwikiquote (T45917) | [production] | 
            
  | 21:29 | <Krinkle> | mwscript deleteEqualMessages.php --wiki frwikibooks (T45917) | [production] | 
            
  | 21:22 | <ebernhardson> | restore elasticsearch cluster high disk watermark to 90% | [production] | 
            
  | 21:07 | <csteipp@tin> | Synchronized wmf-config/CommonSettings-labs.php: revert oath in labs (duration: 00m 27s) | [production] | 
            
  | 21:06 | <csteipp@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: reverting oath (duration: 00m 29s) | [production] | 
            
  | 21:01 | <bearND> | mobileapps deployed 6ef3054 | [production] | 
            
  | 20:55 | <csteipp@tin> | Synchronized wmf-config/CommonSettings-labs.php: retry oath in labs (duration: 00m 29s) | [production] | 
            
  | 20:53 | <csteipp@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: retry oath in labs (duration: 00m 32s) | [production] | 
            
  | 20:43 | <bearND> | starting mobileapps deploy | [production] | 
            
  | 20:41 | <Krinkle> | mwscript deleteEqualMessages.php --wiki plwiki (T45917) | [production] | 
            
  | 20:19 | <arlolra> | updated Parsoid to version e3766b79 | [production] | 
            
  | 20:09 | <arlolra> | synced code; restarted Parsoid on wtp1001.eqiad as a canary | [production] | 
            
  | 20:05 | <ebernhardson> | temporarily changing elasticsearch high watermark to 75% to rebalance cluster | [production] | 
            
  | 20:03 | <volans> | Deploy and use Puppet certs for TLS on cross-dc replica for shard s5 T111654 | [production] | 
            
  | 20:00 | <mutante> | antimony - shred and delete git.wikimedia.org SSL key | [production] | 
            
  | 19:57 | <volans@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1049 to deploy Pupper certs for TLS - T111654 (duration: 00m 28s) | [production] | 
            
  | 19:55 | <mutante> | antimony - remove Apache package and config | [production] | 
            
  | 19:53 | <volans@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1049 to deploy Pupper certs for TLS - T111654 (duration: 02m 25s) | [production] | 
            
  | 19:52 | <mutante> | powercycled mw1115 | [production] | 
            
  | 19:41 | <mutante> | antimony (gitblit) - stop Apache | [production] | 
            
  | 19:15 | <ejegg> | extende globalcollect audit timeout from 90 min to 120 min for duration of NL campaign | [production] | 
            
  | 19:01 | <ori@tin> | Synchronized php-1.27.0-wmf.20/extensions/WikimediaEvents: I672624e9fc30: Collect impact of proposed ResourceLoader feature-test in statsd (duration: 00m 34s) | [production] |