| 
      
        2019-10-21
      
      ยง
     | 
  
    
  | 12:58 | 
  <ema> | 
  lvs2006: restart pybal to add new service wdqs-ssl T210411 | 
  [production] | 
            
  | 12:38 | 
  <hashar> | 
  Started zuul-merger on contint2001 | 
  [production] | 
            
  | 12:32 | 
  <hashar> | 
  Stopped zuul-merger on contint2001 | 
  [production] | 
            
  | 12:31 | 
  <hashar> | 
  Started zuul-merger on contint1001 | 
  [production] | 
            
  | 12:16 | 
  <hashar> | 
  Stopped zuul-merger on contint1001 | 
  [production] | 
            
  | 12:02 | 
  <Urbanecm> | 
  EU SWAT finally done | 
  [production] | 
            
  | 12:01 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: e8d70c1: Partial cleanup of InitialiseSettings (T231178) (duration: 01m 00s) | 
  [production] | 
            
  | 12:00 | 
  <Urbanecm> | 
  I'm going to do one last sync for EU SWAT | 
  [production] | 
            
  | 11:57 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: 12e3549: Create Portal namespace for sawikisource (T235343) (duration: 00m 59s) | 
  [production] | 
            
  | 11:55 | 
  <urbanecm@deploy1001> | 
  sync-file aborted: SWAT: 12e3549: Create Portal namespace for sawikisource (duration: 00m 01s) | 
  [production] | 
            
  | 11:54 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: 3b1350b: wgCopyUploadDomains: Add iip.bu.uni.wroc.pl there (T235904) (duration: 00m 59s) | 
  [production] | 
            
  | 11:49 | 
  <Urbanecm> | 
  Reopen EU SWAT | 
  [production] | 
            
  | 11:42 | 
  <awight> | 
  EU SWAT complete | 
  [production] | 
            
  | 11:42 | 
  <awight@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:544855|Put reference previews back into beta mode on beta cluster (T233813)]] (duration: 01m 00s) | 
  [production] | 
            
  | 11:38 | 
  <kartik@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|543764|Enable ContentTranslation out of Beta in Malayalam/Bengali/Mongolian WPs (T233008, T233009, T234317)]] (duration: 01m 00s) | 
  [production] | 
            
  | 11:34 | 
  <moritzm> | 
  installing Java security updates on restbase-dev1004 | 
  [production] | 
            
  | 11:30 | 
  <mobrovac@deploy1001> | 
  Synchronized php-1.35.0-wmf.2/tests/phpunit/includes/Storage/SqlBlobStoreTest.php: SqlBlobStore HOT FIX: remove caching from getBlobBatch; file 3/3 - T235188 (duration: 01m 00s) | 
  [production] | 
            
  | 11:28 | 
  <mobrovac@deploy1001> | 
  Synchronized php-1.35.0-wmf.2/includes/libs/objectcache/wancache/WANObjectCache.php: SqlBlobStore HOT FIX: remove caching from getBlobBatch; file 2/3 - T235188 (duration: 00m 59s) | 
  [production] | 
            
  | 11:25 | 
  <mobrovac@deploy1001> | 
  Synchronized php-1.35.0-wmf.2/includes/Storage/SqlBlobStore.php: SqlBlobStore HOT FIX: remove caching from getBlobBatch; file 1/3 - T235188 (duration: 01m 00s) | 
  [production] | 
            
  | 11:15 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | 
  [production] | 
            
  | 11:14 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.hosts.decommission | 
  [production] | 
            
  | 10:39 | 
  <jdrewniak@deploy1001> | 
  Synchronized portals: Wikimedia Portals Update: [[gerrit:544853| Bumping portals to master (T128546)]] (duration: 01m 00s) | 
  [production] | 
            
  | 10:38 | 
  <jdrewniak@deploy1001> | 
  Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:544853| Bumping portals to master (T128546)]] (duration: 01m 00s) | 
  [production] | 
            
  | 10:19 | 
  <hashar> | 
  contint1001 / contint2001 : marking integration/config zuul merger repo readonly:   sudo chown -R root:root /srv/zuul/git/integration/config | 
  [production] | 
            
  | 10:13 | 
  <hashar> | 
  CI in trouble due to a huge number of changes | 
  [production] | 
            
  | 10:08 | 
  <jmm@cumin2001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 10:06 | 
  <jmm@cumin2001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 09:51 | 
  <Amir1> | 
  maintenance script is done | 
  [production] | 
            
  | 09:35 | 
  <moritzm> | 
  removing PHP 7.0 from deployment servers | 
  [production] | 
            
  | 09:20 | 
  <Amir1> | 
  start of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T234774) | 
  [production] | 
            
  | 09:18 | 
  <moritzm> | 
  installing php7.0 security updates | 
  [production] | 
            
  | 09:11 | 
  <moritzm> | 
  installing subversion updates on Stretch (fixes compatibility with security fix for Apache update) | 
  [production] | 
            
  | 09:07 | 
  <moritzm> | 
  installing jackson-databind security updates | 
  [production] | 
            
  | 09:01 | 
  <moritzm> | 
  installing openjpeg2 security updates | 
  [production] | 
            
  | 08:52 | 
  <godog> | 
  roll-restart logstash to apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/544209 | 
  [production] | 
            
  | 08:34 | 
  <Urbanecm> | 
  Deploy security patch (T234862) | 
  [production] | 
            
  | 08:34 | 
  <vgutierrez> | 
  Switch from nginx to ats-tls on cp2022 - T231627 | 
  [production] | 
            
  | 08:30 | 
  <ema> | 
  pool cp4029 with ATS backend T227432 | 
  [production] | 
            
  | 08:20 | 
  <vgutierrez> | 
  Switch from nginx to ats-tls on cp2020 - T231627 | 
  [production] | 
            
  | 08:09 | 
  <vgutierrez> | 
  Switch from nginx to ats-tls on cp2018 - T231627 | 
  [production] | 
            
  | 08:08 | 
  <godog> | 
  swift eqiad-prod: add weight to ms-be105[1-6] - T232367 | 
  [production] | 
            
  | 08:03 | 
  <godog> | 
  swift codfw-prod: final weight to ms-be205[1-6] - T233638 | 
  [production] | 
            
  | 07:59 | 
  <ema@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 07:57 | 
  <vgutierrez> | 
  Switch from nginx to ats-tls on cp3046 - T231627 | 
  [production] | 
            
  | 07:57 | 
  <ema@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 07:50 | 
  <ema@puppetmaster1001> | 
  conftool action : set/weight=100; selector: name=cp4029.ulsfo.wmnet,service=ats-be | 
  [production] | 
            
  | 07:45 | 
  <moritzm> | 
  installing aspell security updates on jessie | 
  [production] | 
            
  | 07:43 | 
  <vgutierrez> | 
  Switch from nginx to ats-tls on cp3045 - T231627 | 
  [production] | 
            
  | 07:35 | 
  <moritzm> | 
  installing openjdk-11 security updates | 
  [production] | 
            
  | 07:32 | 
  <ema> | 
  depool cp4029 and reimage as text_ats T227432 | 
  [production] |