| 2020-09-24
      
      ยง | 
    
  | 21:03 | <cdanis> | reprepro: add backported ipvsadm 1:1.31-1+deb10u1 to buster-wikimedia | [production] | 
            
  | 21:00 | <andrew@deploy1001> | Finished deploy [horizon/deploy@404e205]: (no justification provided) (duration: 01m 05s) | [production] | 
            
  | 20:59 | <andrew@deploy1001> | Started deploy [horizon/deploy@404e205]: (no justification provided) | [production] | 
            
  | 20:41 | <andrew@deploy1001> | Finished deploy [horizon/deploy@24368a5]: (no justification provided) (duration: 02m 10s) | [production] | 
            
  | 20:39 | <andrew@deploy1001> | Started deploy [horizon/deploy@24368a5]: (no justification provided) | [production] | 
            
  | 20:35 | <andrew@deploy1001> | Finished deploy [horizon/deploy@85125d1]: (no justification provided) (duration: 00m 52s) | [production] | 
            
  | 20:34 | <andrew@deploy1001> | Started deploy [horizon/deploy@85125d1]: (no justification provided) | [production] | 
            
  | 19:57 | <mholloway-shell@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . | [production] | 
            
  | 19:55 | <mholloway-shell@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . | [production] | 
            
  | 19:54 | <mholloway-shell@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . | [production] | 
            
  | 19:47 | <ebernhardson@deploy1001> | Synchronized wmf-config/ProductionServices.php: Revert: cloudelastic: envoy sits in front now (duration: 00m 59s) | [production] | 
            
  | 19:41 | <andrew@deploy1001> | Finished deploy [horizon/deploy@e5890b9]: (no justification provided) (duration: 00m 36s) | [production] | 
            
  | 19:41 | <andrew@deploy1001> | Started deploy [horizon/deploy@e5890b9]: (no justification provided) | [production] | 
            
  | 19:39 | <andrew@deploy1001> | Finished deploy [horizon/deploy@e5890b9]: (no justification provided) (duration: 01m 08s) | [production] | 
            
  | 19:38 | <andrew@deploy1001> | Started deploy [horizon/deploy@e5890b9]: (no justification provided) | [production] | 
            
  | 19:30 | <andrew@deploy1001> | Finished deploy [horizon/deploy@e5890b9]: dev (duration: 00m 44s) | [production] | 
            
  | 19:29 | <andrew@deploy1001> | Started deploy [horizon/deploy@e5890b9]: dev | [production] | 
            
  | 19:08 | <dancy@deploy1001> | rebuilt and synchronized wikiversions files: group2 wikis to 1.36.0-wmf.10 | [production] | 
            
  | 19:04 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: bcf9fcbe3b82ab85b8f97206ceca45b64619c362: Enable mobile block notice tracking in MobileFrontend (T260218) (duration: 01m 04s) | [production] | 
            
  | 18:58 | <tchanders@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:627481|Enable Special:Investigate on itwiki and svwiki (T262436)]] (duration: 01m 05s) | [production] | 
            
  | 18:01 | <mutante> | temp. disabled puppet on install4001/install5001 - applying install_server role to new servers, starting with install3001 | [production] | 
            
  | 17:57 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:57 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:57 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:57 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:57 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:57 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:24 | <mholloway-shell@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'proton' for release 'production' . | [production] | 
            
  | 17:21 | <jbond42> | enable puppet fleet wide post update puppetdb postgres logging | [production] | 
            
  | 17:19 | <mholloway-shell@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'proton' for release 'production' . | [production] | 
            
  | 17:17 | <jayme@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'citoid' for release 'production' . | [production] | 
            
  | 17:16 | <jayme@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'citoid' for release 'production' . | [production] | 
            
  | 17:15 | <mholloway-shell@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'proton' for release 'production' . | [production] | 
            
  | 17:15 | <jbond42> | disable puppet fleet wide to update puppetdb postgres loggin | [production] | 
            
  | 17:14 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'staging' . | [production] | 
            
  | 17:14 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'production' . | [production] | 
            
  | 17:14 | <mholloway-shell@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'push-notifications' for release 'main' . | [production] | 
            
  | 17:11 | <mholloway-shell@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'push-notifications' for release 'main' . | [production] | 
            
  | 17:11 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . | [production] | 
            
  | 17:11 | <hnowlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . | [production] | 
            
  | 17:09 | <mholloway-shell@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'push-notifications' for release 'main' . | [production] | 
            
  | 17:04 | <mutante> | syncing facts to puppet compiler hosts | [production] | 
            
  | 17:01 | <jayme@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'citoid' for release 'production' . | [production] | 
            
  | 17:00 | <volans@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:56 | <volans@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:26 | <jayme@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'citoid' for release 'production' . | [production] | 
            
  | 16:26 | <robh> | properly pooled mw1360 this time T262151 | [production] | 
            
  | 16:18 | <jayme@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'citoid' for release 'staging' . | [production] | 
            
  | 16:04 | <XioNoX> | pfw3-eqiad> restart security-log gracefully | [production] | 
            
  | 15:58 | <urbanecm@deploy1001> | Synchronized php-1.36.0-wmf.10/extensions/AbuseFilter/includes/Hooks/AbuseFilterHookRunner.php: 5e88c36fa4111cde33dafb0d7ac31a854b95e5ea: HookRunner: onAbuseFilterGenerateUserVars should run generateUserVars (T263750) (duration: 01m 06s) | [production] |