| 2019-12-18
      
      ยง | 
    
  | 10:00 | <akosiaris> | populate new calico stores for codfw T239835 | [production] | 
            
  | 09:57 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Fully repool es1011', diff saved to https://phabricator.wikimedia.org/P9937 and previous config saved to /var/cache/conftool/dbconfig/20191218-095710-marostegui.json | [production] | 
            
  | 09:45 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool es1011', diff saved to https://phabricator.wikimedia.org/P9936 and previous config saved to /var/cache/conftool/dbconfig/20191218-094540-marostegui.json | [production] | 
            
  | 09:37 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool es1011', diff saved to https://phabricator.wikimedia.org/P9935 and previous config saved to /var/cache/conftool/dbconfig/20191218-093720-marostegui.json | [production] | 
            
  | 09:26 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool es1011', diff saved to https://phabricator.wikimedia.org/P9934 and previous config saved to /var/cache/conftool/dbconfig/20191218-092625-marostegui.json | [production] | 
            
  | 09:24 | <elukey> | execute 'megacli -LDSetProp WT -LAll -aAll' on analytics1057 - T239045 | [production] | 
            
  | 09:22 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool es1011 for upgrade', diff saved to https://phabricator.wikimedia.org/P9933 and previous config saved to /var/cache/conftool/dbconfig/20191218-092228-marostegui.json | [production] | 
            
  | 09:18 | <ema> | repool cp3050 after ats-be restart | [production] | 
            
  | 08:59 | <vgutierrez> | restarting ats-be on cp3050 | [production] | 
            
  | 08:58 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 08:22 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Fully repool es1016', diff saved to https://phabricator.wikimedia.org/P9931 and previous config saved to /var/cache/conftool/dbconfig/20191218-082226-marostegui.json | [production] | 
            
  | 08:21 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 08:20 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 08:13 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool es1016', diff saved to https://phabricator.wikimedia.org/P9930 and previous config saved to /var/cache/conftool/dbconfig/20191218-081256-marostegui.json | [production] | 
            
  | 08:12 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 08:12 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 08:05 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 08:04 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 08:01 | <marostegui> | Upgrade db2109 | [production] | 
            
  | 08:01 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 07:59 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'zotero' for release 'staging' . | [production] | 
            
  | 07:59 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool es1016', diff saved to https://phabricator.wikimedia.org/P9929 and previous config saved to /var/cache/conftool/dbconfig/20191218-075919-marostegui.json | [production] | 
            
  | 07:59 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . | [production] | 
            
  | 07:58 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'staging' . | [production] | 
            
  | 07:58 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'termbox' for release 'test' . | [production] | 
            
  | 07:58 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Fully repool db1105:3311, db1105:3312', diff saved to https://phabricator.wikimedia.org/P9928 and previous config saved to /var/cache/conftool/dbconfig/20191218-075828-marostegui.json | [production] | 
            
  | 07:58 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'sessionstore' for release 'staging' . | [production] | 
            
  | 07:57 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . | [production] | 
            
  | 07:57 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'mathoid' for release 'staging' . | [production] | 
            
  | 07:56 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . | [production] | 
            
  | 07:56 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-main' for release 'main' . | [production] | 
            
  | 07:55 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'logging-external' . | [production] | 
            
  | 07:54 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics' for release 'analytics' . | [production] | 
            
  | 07:54 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'echostore' for release 'staging' . | [production] | 
            
  | 07:53 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'cxserver' for release 'staging' . | [production] | 
            
  | 07:53 | <akosiaris> | run helmfile sync for all staging deployments T239835 | [production] | 
            
  | 07:53 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'citoid' for release 'staging' . | [production] | 
            
  | 07:53 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . | [production] | 
            
  | 07:46 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1105:3311, db1105:3312', diff saved to https://phabricator.wikimedia.org/P9927 and previous config saved to /var/cache/conftool/dbconfig/20191218-074642-marostegui.json | [production] | 
            
  | 07:40 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool es1016', diff saved to https://phabricator.wikimedia.org/P9926 and previous config saved to /var/cache/conftool/dbconfig/20191218-074032-marostegui.json | [production] | 
            
  | 07:30 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool es1016 for upgrade', diff saved to https://phabricator.wikimedia.org/P9925 and previous config saved to /var/cache/conftool/dbconfig/20191218-073002-marostegui.json | [production] | 
            
  | 07:18 | <andrew@deploy1001> | Finished deploy [horizon/deploy@f77e91b]: Fix for T240979 (duration: 03m 24s) | [production] | 
            
  | 07:14 | <andrew@deploy1001> | Started deploy [horizon/deploy@f77e91b]: Fix for T240979 | [production] | 
            
  | 06:53 | <marostegui> | Upgrade db2132, db2133, db2134 | [production] | 
            
  | 06:51 | <marostegui> | Upgrade db2135 | [production] | 
            
  | 06:48 | <volker-e@deploy1001> | Finished deploy [design/style-guide@d13b55d]: Deploy design/style-guide:  (duration: 00m 07s) | [production] | 
            
  | 06:48 | <volker-e@deploy1001> | Started deploy [design/style-guide@d13b55d]: Deploy design/style-guide: | [production] | 
            
  | 06:45 | <onimisionipe> | running replicate-osm on maps1004 after failed osm sync - T239728 | [production] | 
            
  | 06:45 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1105:3311, db1105:3312', diff saved to https://phabricator.wikimedia.org/P9924 and previous config saved to /var/cache/conftool/dbconfig/20191218-064510-marostegui.json | [production] | 
            
  | 06:38 | <moritzm> | upgrading debmonitor-client to 0.2.0 fleet-wide | [production] |