| 2016-12-09
      
      § | 
    
  | 13:34 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=pdfrender']) | [production] | 
            
  | 13:34 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=ores']) | [production] | 
            
  | 13:34 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=cxserver']) | [production] | 
            
  | 13:33 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=apertium']) | [production] | 
            
  | 13:33 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=mobileapps']) | [production] | 
            
  | 13:33 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=citoid']) | [production] | 
            
  | 13:33 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=graphoid']) | [production] | 
            
  | 13:33 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=mathoid']) | [production] | 
            
  | 12:59 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1087 - T150644 (duration: 00m 45s) | [production] | 
            
  | 12:50 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: mw1290.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=api_appserver', 'service=apache2']) | [production] | 
            
  | 12:50 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: mw1289.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=api_appserver', 'service=apache2']) | [production] | 
            
  | 12:44 | <mobrovac> | scb re-enabled changeprop | [production] | 
            
  | 12:23 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=yes; selector: mw1189.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=api_appserver', 'service=apache2']) | [production] | 
            
  | 12:16 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=no; selector: mw1189.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=api_appserver', 'service=apache2']) | [production] | 
            
  | 12:02 | <hashar> | https://grafana-admin.wikimedia.org/dashboard/db/api-requests Made the template variable for MediaWiki.api.main.executeTiming. to be refreshed on dashboard load (that is for the pXX entries) | [production] | 
            
  | 12:00 | <mobrovac> | scb stopping changeprop in eqiad to investigate outage | [production] | 
            
  | 11:49 | <mobrovac@tin> | Finished deploy [changeprop/deploy@9a33bf4]: (no message) (duration: 00m 51s) | [production] | 
            
  | 11:48 | <mobrovac@tin> | Starting deploy [changeprop/deploy@9a33bf4]: (no message) | [production] | 
            
  | 11:23 | <ema> | upgrading cache_upload to varnish 4.1.4-1wm1 | [production] | 
            
  | 11:13 | <marostegui> | Deploy alter table s5 wikidatawiki.revision on db1087 - T150644 | [production] | 
            
  | 11:09 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1087 - T150644 (duration: 00m 46s) | [production] | 
            
  | 10:12 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1082 - T150644 (duration: 00m 46s) | [production] | 
            
  | 08:39 | <marostegui> | Deploy alter table S5 wikidatawiki.revision on db1082 - T150644 | [production] | 
            
  | 08:29 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1082 - T150644 (duration: 02m 10s) | [production] | 
            
  | 07:42 | <marostegui> | Stop MySQL db2034 and db2048 for maintenance - T149553 | [production] | 
            
  | 01:54 | <kaldari> | foreachwiki extensions/CentralAuth/maintenance/populateLocalAndGlobalIds.php | [production] | 
            
  | 00:22 | <maxsem@tin> | Synchronized php-1.29.0-wmf.5/extensions/JsonConfig: https://gerrit.wikimedia.org/r/#/c/326051/ (duration: 00m 46s) | [production] | 
            
  | 00:06 | <demon@tin> | Synchronized wmf-config/InitialiseSettings.php: swat (duration: 00m 46s) | [production] | 
            
  
    | 2016-12-08
      
      § | 
    
  | 23:31 | <yurik@tin> | Synchronized wmf-config: Enable structured data on Commons - step 2 - https://gerrit.wikimedia.org/r/#/c/326046 (duration: 00m 46s) | [production] | 
            
  | 23:29 | <yurik@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable structured data on Commons https://gerrit.wikimedia.org/r/#/c/326046 (duration: 00m 45s) | [production] | 
            
  | 23:10 | <yurik@tin> | Finished scap: Updating JsonConfig bump and i18n https://gerrit.wikimedia.org/r/#/c/326045/ (duration: 27m 34s) | [production] | 
            
  | 22:43 | <yurik@tin> | Started scap: Updating JsonConfig bump and i18n https://gerrit.wikimedia.org/r/#/c/326045/ | [production] | 
            
  | 22:17 | <mobrovac@tin> | Finished deploy [changeprop/deploy@ab552cd]: Deploying fix for T152690 (duration: 00m 49s) | [production] | 
            
  | 22:16 | <mobrovac@tin> | Starting deploy [changeprop/deploy@ab552cd]: Deploying fix for T152690 | [production] | 
            
  | 22:03 | <legoktm@tin> | Synchronized wmf-config/InitialiseSettings.php: Set $wgUserEmailUseReplyTo = true; everywhere - T66795 (duration: 00m 56s) | [production] | 
            
  | 21:43 | <Reedy> | created securepoll_elections.el_owner on all wikis T152721 | [production] | 
            
  | 21:20 | <mobrovac@tin> | Finished deploy [changeprop/deploy@2fe48e0]: Deploying fix for T152229 (duration: 00m 51s) | [production] | 
            
  | 21:19 | <mobrovac@tin> | Starting deploy [changeprop/deploy@2fe48e0]: Deploying fix for T152229 | [production] | 
            
  | 20:10 | <godog> | upgrade prometheus-node-exporter in labs - T152580 | [production] | 
            
  | 20:07 | <twentyafterfour@tin> | rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.5 | [production] | 
            
  | 19:59 | <thcipriani@tin> | Synchronized php-1.29.0-wmf.5/includes/specials/SpecialUserrights.php: SWAT: [[gerrit:325964|Special:Userrights should set isself on page view, not just on submit]] T152600 (duration: 00m 45s) | [production] | 
            
  | 19:49 | <thcipriani@tin> | Synchronized php-1.29.0-wmf.4/extensions/PageImages/includes/Job/InitImageDataJob.php: SWAT: [[gerrit:325811|Wrap waitForReplication in try/catch]] (duration: 00m 46s) | [production] | 
            
  | 19:46 | <thcipriani@tin> | Synchronized php-1.29.0-wmf.5/extensions/PageImages/includes/Job/InitImageDataJob.php: SWAT: [[gerrit:325989|Wrap waitForReplication in try/catch]] (duration: 00m 53s) | [production] | 
            
  | 19:40 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:325957|Enable SandboxLink on bnwikisource]] T152692 (duration: 00m 45s) | [production] | 
            
  | 19:35 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:325803|Enable SandboxLink at sdwiki and sdwikt]] T152609 (duration: 00m 46s) | [production] | 
            
  | 19:00 | <hoo> | Started rebuildItemsPerSite for Wikidata on terbium. Note: This can be killed at any time, if needed. | [production] | 
            
  | 18:40 | <legoktm@tin> | Synchronized wmf-config: Deploy Linter extension to beta cluster - no-op (duration: 00m 50s) | [production] | 
            
  | 18:15 | <ottomata> | restarting broker on kafka1012 to repro T152674 | [production] | 
            
  | 18:07 | <gehel> | cleanup nginx access logs on elasticsearch cluster (access logs are disabled, this is just left over) | [production] | 
            
  | 17:53 | <ejegg> | disabled CiviCRM de-dupe jobs (CiviCRM contacts, Major gifts contacts, Major gifts 500+) | [production] |