| 2020-08-04
      
      ยง | 
    
  | 22:41 | <brennen> | restarting php7.2-fpm on mw1404 for opcache issues | [production] | 
            
  | 21:45 | <mholloway-shell@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'proton' for release 'production' . | [production] | 
            
  | 21:38 | <mholloway-shell@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'proton' for release 'production' . | [production] | 
            
  | 21:34 | <mholloway-shell@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'proton' for release 'production' . | [production] | 
            
  | 21:03 | <mholloway-shell@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | [production] | 
            
  | 21:03 | <mholloway-shell@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | [production] | 
            
  | 20:55 | <mholloway-shell@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | [production] | 
            
  | 20:55 | <mholloway-shell@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | [production] | 
            
  | 20:52 | <mholloway-shell@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . | [production] | 
            
  | 20:27 | <ebernhardson@deploy1001> | Finished deploy [search/mjolnir/deploy@c80e2e7]: use provided ca certs for elasticsearch (duration: 02m 22s) | [production] | 
            
  | 20:25 | <ebernhardson@deploy1001> | Started deploy [search/mjolnir/deploy@c80e2e7]: use provided ca certs for elasticsearch | [production] | 
            
  | 20:15 | <ebernhardson@deploy1001> | Finished deploy [search/mjolnir/deploy@b17bfd4]: Move mjolnir daemons from cirrus hosts to dedicated instances (duration: 02m 07s) | [production] | 
            
  | 20:12 | <ebernhardson@deploy1001> | Started deploy [search/mjolnir/deploy@b17bfd4]: Move mjolnir daemons from cirrus hosts to dedicated instances | [production] | 
            
  | 19:19 | <brennen@deploy1001> | rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.3 | [production] | 
            
  | 19:11 | <brennen@deploy1001> | Finished scap: testwikis wikis to 1.36.0-wmf.3 (duration: 91m 03s) | [production] | 
            
  | 19:03 | <brennen> | current 1.36.0-wmf.3 train status (T257971): mid scap-cdb-rebuild for testwiki sync; will proceed with group0 when finished. | [production] | 
            
  | 18:55 | <sukhe> | upload pdns-recursor_4.3.3-1~deb10u1 to apt.wm.o (buster) - T252132 | [production] | 
            
  | 18:49 | <mutante> | letting puppet install envoy on all ores1* hosts | [production] | 
            
  | 18:46 | <mutante> | letting puppet install envoy on all ores2* hosts | [production] | 
            
  | 18:37 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 18:26 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 18:19 | <mutante> | temp disabling puppet on all ores hosts to add envoy | [production] | 
            
  | 17:50 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 17:40 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 17:40 | <brennen@deploy1001> | Started scap: testwikis wikis to 1.36.0-wmf.3 | [production] | 
            
  | 17:36 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 17:25 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 17:21 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 17:17 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 17:03 | <brennen> | 1.36.0-wmf.3 was branched at 2d0cf09cdf for T257971 | [production] | 
            
  | 16:51 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 16:49 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 16:43 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 16:31 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 16:24 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 16:18 | <cmjohnson@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:15 | <oblivian@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'termbox' for release 'production' . | [production] | 
            
  | 16:08 | <cmjohnson@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:05 | <oblivian@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'termbox' for release 'production' . | [production] | 
            
  | 16:02 | <oblivian@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'termbox' for release 'staging' . | [production] | 
            
  | 16:02 | <oblivian@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'termbox' for release 'test' . | [production] | 
            
  | 15:53 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: EventStreamConfig - Set default topic_prefixes - T255888 (duration: 00m 58s) | [production] | 
            
  | 15:51 | <ayounsi@cumin1001> | END (PASS) - Cookbook sre.network.prepare-upgrade (exit_code=0) | [production] | 
            
  | 15:39 | <oblivian@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'termbox' for release 'staging' . | [production] | 
            
  | 15:39 | <oblivian@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'termbox' for release 'test' . | [production] | 
            
  | 15:38 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 15:31 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 15:18 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Remove now unused wgEventServiceStreamConfig - T229863 (duration: 00m 58s) | [production] | 
            
  | 15:18 | <moritzm> | installing jackson-databind security issues | [production] | 
            
  | 15:08 | <moritzm> | installing qemu security updates on cloudvirt* Stretch hosts | [production] |