| 
      
        2020-08-04
      
      §
     | 
  
    
  | 22:41 | 
  <brennen> | 
  restarting php7.2-fpm on mw1404 for opcache issues | 
  [production] | 
            
  | 21:45 | 
  <mholloway-shell@deploy1001> | 
  helmfile [codfw] Ran 'sync' command on namespace 'proton' for release 'production' . | 
  [production] | 
            
  | 21:38 | 
  <mholloway-shell@deploy1001> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'proton' for release 'production' . | 
  [production] | 
            
  | 21:34 | 
  <mholloway-shell@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'proton' for release 'production' . | 
  [production] | 
            
  | 21:03 | 
  <mholloway-shell@deploy1001> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | 
  [production] | 
            
  | 21:03 | 
  <mholloway-shell@deploy1001> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | 
  [production] | 
            
  | 20:55 | 
  <mholloway-shell@deploy1001> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | 
  [production] | 
            
  | 20:55 | 
  <mholloway-shell@deploy1001> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | 
  [production] | 
            
  | 20:52 | 
  <mholloway-shell@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . | 
  [production] | 
            
  | 20:27 | 
  <ebernhardson@deploy1001> | 
  Finished deploy [search/mjolnir/deploy@c80e2e7]: use provided ca certs for elasticsearch (duration: 02m 22s) | 
  [production] | 
            
  | 20:25 | 
  <ebernhardson@deploy1001> | 
  Started deploy [search/mjolnir/deploy@c80e2e7]: use provided ca certs for elasticsearch | 
  [production] | 
            
  | 20:15 | 
  <ebernhardson@deploy1001> | 
  Finished deploy [search/mjolnir/deploy@b17bfd4]: Move mjolnir daemons from cirrus hosts to dedicated instances (duration: 02m 07s) | 
  [production] | 
            
  | 20:12 | 
  <ebernhardson@deploy1001> | 
  Started deploy [search/mjolnir/deploy@b17bfd4]: Move mjolnir daemons from cirrus hosts to dedicated instances | 
  [production] | 
            
  | 19:19 | 
  <brennen@deploy1001> | 
  rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.3 | 
  [production] | 
            
  | 19:11 | 
  <brennen@deploy1001> | 
  Finished scap: testwikis wikis to 1.36.0-wmf.3 (duration: 91m 03s) | 
  [production] | 
            
  | 19:03 | 
  <brennen> | 
  current 1.36.0-wmf.3 train status (T257971): mid scap-cdb-rebuild for testwiki sync; will proceed with group0 when finished. | 
  [production] | 
            
  | 18:55 | 
  <sukhe> | 
  upload pdns-recursor_4.3.3-1~deb10u1 to apt.wm.o (buster) - T252132 | 
  [production] | 
            
  | 18:49 | 
  <mutante> | 
  letting puppet install envoy on all ores1* hosts | 
  [production] | 
            
  | 18:46 | 
  <mutante> | 
  letting puppet install envoy on all ores2* hosts | 
  [production] | 
            
  | 18:37 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 18:26 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 18:19 | 
  <mutante> | 
  temp disabling puppet on all ores hosts to add envoy | 
  [production] | 
            
  | 17:50 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 17:40 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 17:40 | 
  <brennen@deploy1001> | 
  Started scap: testwikis wikis to 1.36.0-wmf.3 | 
  [production] | 
            
  | 17:36 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 17:25 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 17:21 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 17:17 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 17:03 | 
  <brennen> | 
  1.36.0-wmf.3 was branched at 2d0cf09cdf for T257971 | 
  [production] | 
            
  | 16:51 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 16:49 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 16:43 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 16:31 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 16:24 | 
  <hnowlan@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | 
  [production] | 
            
  | 16:18 | 
  <cmjohnson@cumin1001> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 16:15 | 
  <oblivian@deploy1001> | 
  helmfile [codfw] Ran 'sync' command on namespace 'termbox' for release 'production' . | 
  [production] | 
            
  | 16:08 | 
  <cmjohnson@cumin1001> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 16:05 | 
  <oblivian@deploy1001> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'termbox' for release 'production' . | 
  [production] | 
            
  | 16:02 | 
  <oblivian@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'termbox' for release 'staging' . | 
  [production] | 
            
  | 16:02 | 
  <oblivian@deploy1001> | 
  helmfile [staging] Ran 'sync' command on namespace 'termbox' for release 'test' . | 
  [production] | 
            
  | 15:53 | 
  <otto@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: EventStreamConfig - Set default topic_prefixes - T255888 (duration: 00m 58s) | 
  [production] | 
            
  | 15:51 | 
  <ayounsi@cumin1001> | 
  END (PASS) - Cookbook sre.network.prepare-upgrade (exit_code=0) | 
  [production] |