| 2020-04-30
      
      § | 
    
  | 14:13 | <marostegui> | Stop slave on es2020 for testing | [production] | 
            
  | 14:11 | <vgutierrez> | rolling restart of ats-tls on text@esams - T249335 | [production] | 
            
  | 14:01 | <vgutierrez> | upgrade trafficserver to version 8.0.7-1wm2 on cp4025 and cp4031 | [production] | 
            
  | 13:14 | <marostegui@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 13:11 | <marostegui@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 13:04 | <liw@deploy1001> | rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.30 | [production] | 
            
  | 12:44 | <arturo> | re-enable puppet in apt1001 | [production] | 
            
  | 12:35 | <jbond42> | rolling restart of php7.2-fpm on mw1* servers | [production] | 
            
  | 12:09 | <jbond42> | rolling restart of thumbor service | [production] | 
            
  | 12:02 | <arturo> | disable puppet in apt1001 to briefly test a reprepro pull filter before merging a proper patch | [production] | 
            
  | 11:59 | <kormat@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 11:56 | <kormat@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 11:56 | <jbond42> | updating tiff on stretch | [production] | 
            
  | 11:54 | <arturo> | running `aborrero@apt1001:~ $ sudo -i reprepro --delete clearvanished` to clean unused openstack components and packages (see https://gerrit.wikimedia.org/r/c/operations/puppet/+/593223) | [production] | 
            
  | 11:30 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: 83e1475: Uncoupling graphoid on testwiki (T242855) (duration: 01m 06s) | [production] | 
            
  | 11:07 | <marostegui> | Deploy schema change on db1091 | [production] | 
            
  | 11:07 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1091', diff saved to https://phabricator.wikimedia.org/P11099 and previous config saved to /var/cache/conftool/dbconfig/20200430-110721-marostegui.json | [production] | 
            
  | 11:05 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1084', diff saved to https://phabricator.wikimedia.org/P11098 and previous config saved to /var/cache/conftool/dbconfig/20200430-110539-marostegui.json | [production] | 
            
  | 11:05 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: 6572e25: Enable transwiki import from wikidata, frwikisource and hiwikibooks in hiwikisource (T251485) (duration: 01m 12s) | [production] | 
            
  | 10:51 | <mutante> | bromine,vega,miscweb[12]002: rm -rf /srv/org/wikimedia/TransparencyReport-private | [production] | 
            
  | 10:09 | <jayme> | imported helm 2.12.2-4 to main for buster-wikimedia | [production] | 
            
  | 09:53 | <jayme> | imported helm3 3.2.0-1+deb10u1 to main for buster-wikimedia | [production] | 
            
  | 09:47 | <kormat> | reimaging db1077 for testing purposes T251392 | [production] | 
            
  | 08:36 | <XioNoX> | change blackhole term scope on all routers - T226742 | [production] | 
            
  | 07:52 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db2089', diff saved to https://phabricator.wikimedia.org/P11097 and previous config saved to /var/cache/conftool/dbconfig/20200430-075211-marostegui.json | [production] | 
            
  | 07:31 | <marostegui@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 07:29 | <marostegui@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 06:50 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1111', diff saved to https://phabricator.wikimedia.org/P11096 and previous config saved to /var/cache/conftool/dbconfig/20200430-065044-marostegui.json | [production] | 
            
  | 06:50 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1111', diff saved to https://phabricator.wikimedia.org/P11095 and previous config saved to /var/cache/conftool/dbconfig/20200430-065008-marostegui.json | [production] | 
            
  | 06:44 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db2089', diff saved to https://phabricator.wikimedia.org/P11094 and previous config saved to /var/cache/conftool/dbconfig/20200430-064450-marostegui.json | [production] | 
            
  | 05:18 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1092', diff saved to https://phabricator.wikimedia.org/P11093 and previous config saved to /var/cache/conftool/dbconfig/20200430-051818-marostegui.json | [production] | 
            
  | 05:16 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1092', diff saved to https://phabricator.wikimedia.org/P11092 and previous config saved to /var/cache/conftool/dbconfig/20200430-051637-marostegui.json | [production] | 
            
  | 05:15 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1099:3318', diff saved to https://phabricator.wikimedia.org/P11091 and previous config saved to /var/cache/conftool/dbconfig/20200430-051506-marostegui.json | [production] | 
            
  | 05:13 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1099:3318', diff saved to https://phabricator.wikimedia.org/P11090 and previous config saved to /var/cache/conftool/dbconfig/20200430-051329-marostegui.json | [production] | 
            
  | 05:02 | <marostegui> | Restart x1 master finished - T250701 | [production] | 
            
  | 05:00 | <marostegui> | Restart x1 master (db1120) - T250701 | [production] | 
            
  | 04:52 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1084', diff saved to https://phabricator.wikimedia.org/P11089 and previous config saved to /var/cache/conftool/dbconfig/20200430-045159-marostegui.json | [production] | 
            
  | 04:38 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1097:3314', diff saved to https://phabricator.wikimedia.org/P11088 and previous config saved to /var/cache/conftool/dbconfig/20200430-043803-marostegui.json | [production] | 
            
  | 00:26 | <twentyafterfour> | phabricator update finished | [production] | 
            
  | 00:15 | <twentyafterfour> | deploying phabricator update: https://phabricator.wikimedia.org/project/view/4620/ | [production] | 
            
  | 00:11 | <eileen> | process-control config revision is 1f31dd21c5 | [production] | 
            
  
    | 2020-04-29
      
      § | 
    
  | 23:55 | <jforrester@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T91649 Drop Sentry, Part II: Stop configuring it for production or Beta Cluster (duration: 01m 05s) | [production] | 
            
  | 23:51 | <jforrester@deploy1001> | Synchronized wmf-config/CommonSettings.php: T91649 Drop Sentry, Part I: Stop loading it anywhere (duration: 01m 05s) | [production] | 
            
  | 23:37 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Set Growth Screener survey sample rate to 0.1% and limit to anons only (T248421) (duration: 01m 05s) | [production] | 
            
  | 23:26 | <RoanKattouw> | Ran updateArticleCount.php on trwikisource | [production] | 
            
  | 23:22 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Set $wgArticleCount to any on trwikisource (duration: 01m 06s) | [production] | 
            
  | 21:59 | <bstorm_> | upgrading RAID firmware on labsdb1011 T249188 | [production] | 
            
  | 21:34 | <volker-e@deploy1001> | Finished deploy [design/style-guide@c4956c3]: Deploy design/style-guide:  (duration: 00m 08s) | [production] | 
            
  | 21:34 | <volker-e@deploy1001> | Started deploy [design/style-guide@c4956c3]: Deploy design/style-guide: | [production] | 
            
  | 21:22 | <jforrester@deploy1001> | Synchronized php-1.35.0-wmf.28/extensions/GlobalBlocking/includes/api/ApiQueryGlobalBlocks.php: T251430 Unconditionally select gb_timestamp (duration: 01m 06s) | [production] |