| 2020-03-25
      
      ยง | 
    
  | 22:05 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . | [production] | 
            
  | 22:05 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . | [production] | 
            
  | 22:05 | <rlazarus> | updating eventgate-logging-external to envoy 1.13.1 T246868 | [production] | 
            
  | 22:00 | <rzl@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . | [production] | 
            
  | 22:00 | <rzl@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . | [production] | 
            
  | 21:59 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@a1c3be4] (dev-cluster): Remove experimental PCS endpoints (duration: 02m 57s) | [production] | 
            
  | 21:56 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@a1c3be4] (dev-cluster): Remove experimental PCS endpoints | [production] | 
            
  | 21:54 | <rzl@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . | [production] | 
            
  | 21:53 | <rzl@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . | [production] | 
            
  | 21:46 | <urandom> | dropping unused Cassandra keyspaces -- T248018 | [production] | 
            
  | 21:45 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . | [production] | 
            
  | 21:44 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . | [production] | 
            
  | 21:44 | <rlazarus> | updating eventgate-analytics-external to envoy 1.13.1 T246868 | [production] | 
            
  | 21:39 | <rzl@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics' for release 'canary' . | [production] | 
            
  | 21:39 | <rzl@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics' for release 'production' . | [production] | 
            
  | 21:27 | <rzl@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics' for release 'canary' . | [production] | 
            
  | 21:27 | <rzl@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics' for release 'production' . | [production] | 
            
  | 21:16 | <rlazarus> | holding off on updating eventgate-analytics until EU time, to check on unexpected helmfile diffs T246868 | [production] | 
            
  | 21:11 | <rzl@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics' for release 'canary' . | [production] | 
            
  | 21:11 | <rzl@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics' for release 'production' . | [production] | 
            
  | 21:10 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics' for release 'canary' . | [production] | 
            
  | 21:10 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics' for release 'production' . | [production] | 
            
  | 21:07 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics' for release 'canary' . | [production] | 
            
  | 21:07 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics' for release 'production' . | [production] | 
            
  | 21:07 | <rlazarus> | updating eventgate-analytics to envoy 1.13.1 T246868 | [production] | 
            
  | 20:36 | <rzl@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . | [production] | 
            
  | 20:32 | <rzl@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . | [production] | 
            
  | 20:22 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . | [production] | 
            
  | 20:22 | <rlazarus> | updating cxserver to envoy 1.13.1 T246868 | [production] | 
            
  | 20:19 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'citoid' for release 'staging' . | [production] | 
            
  | 20:19 | <rlazarus> | updating citoid to envoy 1.13.1 T246868 | [production] | 
            
  | 20:16 | <rzl@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . | [production] | 
            
  | 20:16 | <rzl@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 20:01 | <rzl@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . | [production] | 
            
  | 20:01 | <rzl@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 19:36 | <hasharDinner> | Jenkins restarted on all machines | [production] | 
            
  | 19:30 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . | [production] | 
            
  | 19:30 | <rzl@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . | [production] | 
            
  | 19:29 | <rlazarus> | updating eventstreams to envoy 1.13.1 T246868 | [production] | 
            
  | 19:28 | <twentyafterfour> | group1 looks good after deploying wmf.25 refs T233873 | [production] | 
            
  | 19:27 | <hashar> | upgrading Jenkins # T248122 | [production] | 
            
  | 19:26 | <twentyafterfour@deploy1001> | rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.25  refs T233873 | [production] | 
            
  | 19:26 | <twentyafterfour> | scap sync-proxies failed on mw1251 | [production] | 
            
  | 18:53 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@a1c3be4]: Add restbase202[123] T244178 (duration: 14m 00s) | [production] | 
            
  | 18:39 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@a1c3be4]: Add restbase202[123] T244178 | [production] | 
            
  | 18:39 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@777b881]: Remove experimental PCS endpoints (duration: 14m 28s) | [production] | 
            
  | 18:24 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@777b881]: Remove experimental PCS endpoints | [production] | 
            
  | 18:21 | <tgr@deploy1001> | Synchronized php-1.35.0-wmf.25/extensions/GrowthExperiments/modules/homepage/: re-sync, mw1251 failed (duration: 03m 18s) | [production] | 
            
  | 18:13 | <tgr@deploy1001> | Synchronized php-1.35.0-wmf.25/extensions/GrowthExperiments/modules/homepage/: SWAT: [[gerrit:583393|Mentorship module: Update for root screen refactor (T248422)]] (duration: 03m 23s) | [production] | 
            
  | 18:06 | <ppchelko@deploy1001> | Finished deploy [changeprop/deploy@4bdf55b]: Stop rerendering experimental PCS endpoints (duration: 01m 40s) | [production] |