| 2020-04-30
      
      ยง | 
    
  | 23:21 | <urbanecm@deploy1001> | Synchronized wmf-config/CommonSettings.php: SWAT: 9065650: Add project taglines (T249047) (duration: 01m 04s) | [production] | 
            
  | 23:19 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: 9065650: Add project taglines (T249047) (duration: 01m 04s) | [production] | 
            
  | 23:17 | <urbanecm@deploy1001> | Synchronized static/images/mobile/copyright/: SWAT: 9065650: Add project taglines (T249047) (duration: 01m 04s) | [production] | 
            
  | 23:14 | <urbanecm@deploy1001> | Synchronized static/images/project-logos/: SWAT: 9065650: Add project taglines (T249047) (duration: 01m 05s) | [production] | 
            
  | 23:08 | <urbanecm@deploy1001> | Synchronized static/images/project-logos/: SWAT: ae1424a: Logo wordmarks should not define fill color - opacity will be used (T251135) (duration: 01m 05s) | [production] | 
            
  | 23:05 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: cf5f7ff: Assign oathauth-verify-user to stewards (T251447) (duration: 01m 05s) | [production] | 
            
  | 20:13 | <shdubsh> | test mtail rc35 upgrade on logstash1007 - T251466 | [production] | 
            
  | 20:10 | <rzl> | mcrouter certs re-renewed on puppetmaster1001, puppet enabled on mcrouter hosts | [production] | 
            
  | 20:05 | <jeh> | cloudvirt1024 upgrade iDRAC firmware from 2.4.8 to 2.5.4 T241884 | [production] | 
            
  | 20:04 | <rzl> | Disabling puppet on all mcrouter hosts for cert renewal. This isn't strictly needed, as the certs from last time are still fine -- just testing the renewal script. | [production] | 
            
  | 19:42 | <jeh> | reboot cloudvirt1024 for NIC firmware updates T241884 | [production] | 
            
  | 19:25 | <shdubsh> | test mtail rc35 upgrade on fermium - T251466 | [production] | 
            
  | 17:40 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1091', diff saved to https://phabricator.wikimedia.org/P11104 and previous config saved to /var/cache/conftool/dbconfig/20200430-174057-marostegui.json | [production] | 
            
  | 17:37 | <brennen@deploy1001> | rebuilt and synchronized wikiversions files: Revert "group1 and group2 wikis to 1.35.0-wmf.28" | [production] | 
            
  | 17:24 | <reedy@deploy1001> | Synchronized wmf-config/CommonSettings-labs.php: labs only (duration: 00m 58s) | [production] | 
            
  | 15:28 | <volans@deploy1001> | Finished deploy [homer/deploy@56506db]: Release v0.2.1 (duration: 00m 21s) | [production] | 
            
  | 15:27 | <volans@deploy1001> | Started deploy [homer/deploy@56506db]: Release v0.2.1 | [production] | 
            
  | 15:11 | <marostegui> | Create lag on es1021 | [production] | 
            
  | 14:53 | <krinkle@deploy1001> | Synchronized wmf-config/db-eqiad.php: I46d2b811f6287689 (duration: 00m 57s) | [production] | 
            
  | 14:38 | <krinkle@deploy1001> | Synchronized wmf-config/db-codfw.php: I46d2b811f6287689 (duration: 00m 57s) | [production] | 
            
  | 14:24 | <vgutierrez> | upgrade trafficserver to 8.0.7-1wm2 on cp[5006,5011] | [production] | 
            
  | 14:13 | <marostegui> | Stop slave on es2020 for testing | [production] | 
            
  | 14:11 | <vgutierrez> | rolling restart of ats-tls on text@esams - T249335 | [production] | 
            
  | 14:01 | <vgutierrez> | upgrade trafficserver to version 8.0.7-1wm2 on cp4025 and cp4031 | [production] | 
            
  | 13:14 | <marostegui@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 13:11 | <marostegui@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 13:04 | <liw@deploy1001> | rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.30 | [production] | 
            
  | 12:44 | <arturo> | re-enable puppet in apt1001 | [production] | 
            
  | 12:35 | <jbond42> | rolling restart of php7.2-fpm on mw1* servers | [production] | 
            
  | 12:09 | <jbond42> | rolling restart of thumbor service | [production] | 
            
  | 12:02 | <arturo> | disable puppet in apt1001 to briefly test a reprepro pull filter before merging a proper patch | [production] | 
            
  | 11:59 | <kormat@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 11:56 | <kormat@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 11:56 | <jbond42> | updating tiff on stretch | [production] | 
            
  | 11:54 | <arturo> | running `aborrero@apt1001:~ $ sudo -i reprepro --delete clearvanished` to clean unused openstack components and packages (see https://gerrit.wikimedia.org/r/c/operations/puppet/+/593223) | [production] | 
            
  | 11:30 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: 83e1475: Uncoupling graphoid on testwiki (T242855) (duration: 01m 06s) | [production] | 
            
  | 11:07 | <marostegui> | Deploy schema change on db1091 | [production] | 
            
  | 11:07 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1091', diff saved to https://phabricator.wikimedia.org/P11099 and previous config saved to /var/cache/conftool/dbconfig/20200430-110721-marostegui.json | [production] | 
            
  | 11:05 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1084', diff saved to https://phabricator.wikimedia.org/P11098 and previous config saved to /var/cache/conftool/dbconfig/20200430-110539-marostegui.json | [production] | 
            
  | 11:05 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: 6572e25: Enable transwiki import from wikidata, frwikisource and hiwikibooks in hiwikisource (T251485) (duration: 01m 12s) | [production] | 
            
  | 10:51 | <mutante> | bromine,vega,miscweb[12]002: rm -rf /srv/org/wikimedia/TransparencyReport-private | [production] | 
            
  | 10:09 | <jayme> | imported helm 2.12.2-4 to main for buster-wikimedia | [production] | 
            
  | 09:53 | <jayme> | imported helm3 3.2.0-1+deb10u1 to main for buster-wikimedia | [production] | 
            
  | 09:47 | <kormat> | reimaging db1077 for testing purposes T251392 | [production] | 
            
  | 08:36 | <XioNoX> | change blackhole term scope on all routers - T226742 | [production] | 
            
  | 07:52 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db2089', diff saved to https://phabricator.wikimedia.org/P11097 and previous config saved to /var/cache/conftool/dbconfig/20200430-075211-marostegui.json | [production] | 
            
  | 07:31 | <marostegui@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 07:29 | <marostegui@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 06:50 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1111', diff saved to https://phabricator.wikimedia.org/P11096 and previous config saved to /var/cache/conftool/dbconfig/20200430-065044-marostegui.json | [production] | 
            
  | 06:50 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1111', diff saved to https://phabricator.wikimedia.org/P11095 and previous config saved to /var/cache/conftool/dbconfig/20200430-065008-marostegui.json | [production] |