| 
      
        2021-10-26
      
      ยง
     | 
  
    
  | 15:45 | 
  <lucaswerkmeister-wmde@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . | 
  [production] | 
            
  | 15:41 | 
  <lucaswerkmeister-wmde@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . | 
  [production] | 
            
  | 15:38 | 
  <lucaswerkmeister-wmde@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . | 
  [production] | 
            
  | 15:27 | 
  <cdanis@cumin1001> | 
  END (PASS) - Cookbook sre.network.cf (exit_code=0) | 
  [production] | 
            
  | 15:27 | 
  <cdanis@cumin1001> | 
  START - Cookbook sre.network.cf | 
  [production] | 
            
  | 15:07 | 
  <topranks> | 
  Running homer against cr3-esams to create new temp GRE tunnel to asw1-b12-drmrs | 
  [production] | 
            
  | 15:02 | 
  <cdanis@cumin1001> | 
  END (PASS) - Cookbook sre.network.cf (exit_code=0) | 
  [production] | 
            
  | 15:02 | 
  <cdanis@cumin1001> | 
  START - Cookbook sre.network.cf | 
  [production] | 
            
  | 14:55 | 
  <topranks> | 
  Adding static route on cr3-esams to asw1-b12-drmrs Telia link IP to allow GRE to be built. | 
  [production] | 
            
  | 13:50 | 
  <elukey> | 
  ran "Capirca Host Definition" script on netbox - output https://netbox.wikimedia.org/extras/scripts/results/1787315/ | 
  [production] | 
            
  | 13:45 | 
  <urbanecm@deploy1002> | 
  Synchronized php-1.38.0-wmf.5/extensions/Wikibase: 7723cf724df9ede49129443e43336e93efcd7a41: RecentChangeFactory: Add missing rc_logid value (T293885) (duration: 01m 02s) | 
  [production] | 
            
  | 13:40 | 
  <elukey> | 
  ran "Capirca Host Definition" script on netbox-next to get up-to-date aqs_group host definition - result https://netbox-next.wikimedia.org/extras/scripts/results/894348/ | 
  [production] | 
            
  | 13:24 | 
  <kart_> | 
  Updated cxserver to 2021-10-25-123807-production (T217747, T218217, T292421) | 
  [production] | 
            
  | 13:19 | 
  <kartik@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . | 
  [production] | 
            
  | 13:13 | 
  <kartik@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . | 
  [production] | 
            
  | 13:05 | 
  <kartik@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . | 
  [production] | 
            
  | 13:05 | 
  <hashar@deploy1002> | 
  Pruned MediaWiki: 1.38.0-wmf.4 (duration: 31m 07s) | 
  [production] | 
            
  | 12:35 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 12:35 | 
  <hashar> | 
  scap clean --delete 1.38.0-wmf.4 # T293947 | 
  [production] | 
            
  | 12:32 | 
  <hashar> | 
  Applied security patches to 1.38.0-wmf.6 # T293947 | 
  [production] | 
            
  | 12:32 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 12:31 | 
  <hashar> | 
  scap prep 1.38.0-wmf.6 # T293947 | 
  [production] | 
            
  | 12:16 | 
  <jbond> | 
  upload cas_6.4.2-1+wmf10u3_amd64 | 
  [production] | 
            
  | 12:07 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 12:04 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 11:55 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 11:52 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 11:51 | 
  <urbanecm@deploy1002> | 
  Finished scap: c131f32e5e0804c8f5c2ec768b334c81a1b35151: Add namespace translations for [ami] Amis and [pwn] Paiwan (T292414, T292415) (duration: 02m 25s) | 
  [production] | 
            
  | 11:49 | 
  <urbanecm@deploy1002> | 
  Started scap: c131f32e5e0804c8f5c2ec768b334c81a1b35151: Add namespace translations for [ami] Amis and [pwn] Paiwan (T292414, T292415) | 
  [production] | 
            
  | 11:13 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 11:13 | 
  <urbanecm@deploy1002> | 
  Synchronized logos/config.yaml: 575a6a66b279c3d2d8974ffcc4911cc5b927be47: Fix HD logo size in some wikis (T250731; 2/2) (duration: 00m 55s) | 
  [production] | 
            
  | 11:13 | 
  <urbanecm@deploy1002> | 
  Synchronized static/images/project-logos/: 575a6a66b279c3d2d8974ffcc4911cc5b927be47: Fix HD logo size in some wikis (T250731; 1/2) (duration: 00m 57s) | 
  [production] | 
            
  | 11:09 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 10:46 | 
  <jbond> | 
  upload cas_6.4.2-1+wmf10u2_amd64.deb | 
  [production] | 
            
  | 10:40 | 
  <mvernon@cumin2002> | 
  conftool action : set/pooled=true; selector: name=codfw,dnsdisc=swift | 
  [production] | 
            
  | 10:39 | 
  <mvernon@cumin2002> | 
  conftool action : set/pooled=true; selector: name=codfw,dnsdisc=swift-ro | 
  [production] | 
            
  | 10:09 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 10:07 | 
  <oblivian@deploy1002> | 
  Synchronized tests/WmfConfigServicesTest.php: Switching back graphite to eqiad (duration: 00m 55s) | 
  [production] | 
            
  | 10:06 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 10:06 | 
  <oblivian@deploy1002> | 
  Synchronized wmf-config/ProductionServices.php: Switching back graphite to eqiad (duration: 01m 04s) | 
  [production] | 
            
  | 09:49 | 
  <godog> | 
  bounce superset on an-tool1005 to pick up statsd changes - T247963 | 
  [production] | 
            
  | 09:49 | 
  <godog> | 
  bounce superset on an-tool1010 to pick up statsd changes - T247963 | 
  [production] | 
            
  | 09:47 | 
  <godog> | 
  bounce navtiming on webperf1001 to pick up statsd changes - T247963 | 
  [production] | 
            
  | 09:40 | 
  <godog> | 
  flip back write traffic to graphite1004 (all but mediawiki) - T247963 | 
  [production] | 
            
  | 09:27 | 
  <godog> | 
  move read traffic back to graphite1004 - T247963 | 
  [production] | 
            
  | 08:37 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 08:33 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] | 
            
  | 08:33 | 
  <ema> | 
  upload varnish_6.0.8-1wm2 to component/varnish6 on apt.wm.org T293879 | 
  [production] | 
            
  | 08:31 | 
  <urbanecm@deploy1002> | 
  Synchronized php-1.38.0-wmf.5/extensions/GrowthExperiments/maintenance: 91316ed5714c4426a29fefded5c4db08dbba48bb: Add purgeExpiredMentorStatus.php (T280307) (duration: 00m 56s) | 
  [production] | 
            
  | 08:24 | 
  <mwdebug-deploy@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | 
  [production] |