| 
      
        2019-12-17
      
      ยง
     | 
  
    
  | 11:37 | 
  <akosiaris@deploy1001> | 
  helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | 
  [production] | 
            
  | 11:34 | 
  <addshore> | 
  finished my last maint script run early after https://phabricator.wikimedia.org/P9914 | 
  [production] | 
            
  | 11:27 | 
  <addshore> | 
  addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --batch-size=1 # T237984 | 
  [production] | 
            
  | 11:21 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1091', diff saved to https://phabricator.wikimedia.org/P9913 and previous config saved to /var/cache/conftool/dbconfig/20191217-112134-marostegui.json | 
  [production] | 
            
  | 11:14 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1091', diff saved to https://phabricator.wikimedia.org/P9912 and previous config saved to /var/cache/conftool/dbconfig/20191217-111400-marostegui.json | 
  [production] | 
            
  | 11:06 | 
  <dcausse@deploy1001> | 
  Finished deploy [wdqs/wdqs@665d9d3]: (no justification provided) (duration: 00m 25s) | 
  [production] | 
            
  | 11:06 | 
  <dcausse@deploy1001> | 
  Started deploy [wdqs/wdqs@665d9d3]: (no justification provided) | 
  [production] | 
            
  | 11:05 | 
  <jforrester@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T234318 ContentTranslation: Make available by default for new Wikipedias (duration: 00m 58s) | 
  [production] | 
            
  | 11:03 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Fully repool db1134', diff saved to https://phabricator.wikimedia.org/P9911 and previous config saved to /var/cache/conftool/dbconfig/20191217-110322-marostegui.json | 
  [production] | 
            
  | 10:54 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1134', diff saved to https://phabricator.wikimedia.org/P9910 and previous config saved to /var/cache/conftool/dbconfig/20191217-105425-marostegui.json | 
  [production] | 
            
  | 10:45 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1134', diff saved to https://phabricator.wikimedia.org/P9908 and previous config saved to /var/cache/conftool/dbconfig/20191217-104530-marostegui.json | 
  [production] | 
            
  | 10:38 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1134', diff saved to https://phabricator.wikimedia.org/P9907 and previous config saved to /var/cache/conftool/dbconfig/20191217-103810-marostegui.json | 
  [production] | 
            
  | 10:29 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Depool db1134 - s1 candidate master for  upgrade', diff saved to https://phabricator.wikimedia.org/P9905 and previous config saved to /var/cache/conftool/dbconfig/20191217-102907-marostegui.json | 
  [production] | 
            
  | 10:13 | 
  <volans@deploy1001> | 
  Finished deploy [homer/deploy@996f7be]: Homer release v0.1.0 - T228388 (duration: 00m 32s) | 
  [production] | 
            
  | 10:13 | 
  <volans@deploy1001> | 
  Started deploy [homer/deploy@996f7be]: Homer release v0.1.0 - T228388 | 
  [production] | 
            
  | 10:11 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Fully repool db1075', diff saved to https://phabricator.wikimedia.org/P9902 and previous config saved to /var/cache/conftool/dbconfig/20191217-101125-marostegui.json | 
  [production] | 
            
  | 10:02 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1075', diff saved to https://phabricator.wikimedia.org/P9901 and previous config saved to /var/cache/conftool/dbconfig/20191217-100250-marostegui.json | 
  [production] | 
            
  | 09:51 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1075', diff saved to https://phabricator.wikimedia.org/P9900 and previous config saved to /var/cache/conftool/dbconfig/20191217-095152-marostegui.json | 
  [production] | 
            
  | 09:44 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Slowly repool db1075', diff saved to https://phabricator.wikimedia.org/P9899 and previous config saved to /var/cache/conftool/dbconfig/20191217-094418-marostegui.json | 
  [production] | 
            
  | 09:30 | 
  <oblivian@deploy1001> | 
  helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . | 
  [production] | 
            
  | 09:25 | 
  <oblivian@deploy1001> | 
  helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . | 
  [production] | 
            
  | 09:15 | 
  <akosiaris> | 
  delete all namespaces in kubernetes staging cluster for initialization with etcd3 backing datastore. T239835 | 
  [production] | 
            
  | 09:13 | 
  <marostegui@cumin1001> | 
  dbctl commit (dc=all): 'Depool db1075 s3 candidate master for upgrade', diff saved to https://phabricator.wikimedia.org/P9896 and previous config saved to /var/cache/conftool/dbconfig/20191217-091316-marostegui.json | 
  [production] | 
            
  | 08:56 | 
  <oblivian@deploy1001> | 
  helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . | 
  [production] | 
            
  | 08:45 | 
  <oblivian@deploy1001> | 
  helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . | 
  [production] | 
            
  | 08:45 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1252.eqiad.wmnet | 
  [production] | 
            
  | 08:45 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1251.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1250.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1249.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1248.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1247.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1246.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1245.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1244.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1243.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1242.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1241.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1240.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1239.eqiad.wmnet | 
  [production] | 
            
  | 08:44 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=20; selector: dc=eqiad,cluster=appserver,service=nginx,name=mw1238.eqiad.wmnet | 
  [production] | 
            
  | 08:31 | 
  <marostegui> | 
  Repool labsdb1010 T238399 | 
  [production] | 
            
  | 07:29 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@ff67a19]: Updating to Horizon version 'train' again (with fresh venvs) (duration: 03m 43s) | 
  [production] | 
            
  | 07:25 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@ff67a19]: Updating to Horizon version 'train' again (with fresh venvs) | 
  [production] | 
            
  | 07:24 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@ff67a19]: Updating to Horizon version 'train' again (with fresh venvs) (duration: 00m 10s) | 
  [production] | 
            
  | 07:24 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@ff67a19]: Updating to Horizon version 'train' again (with fresh venvs) | 
  [production] | 
            
  | 07:23 | 
  <marostegui> | 
  Upgrade candidate masters in codfw db2080 db2103 db2104 db2110 db2113 db2121 db2127 | 
  [production] | 
            
  | 07:21 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@ff67a19]: Updating to Horizon version 'train' (duration: 03m 46s) | 
  [production] | 
            
  | 07:18 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@ff67a19]: Updating to Horizon version 'train' | 
  [production] | 
            
  | 07:15 | 
  <marostegui> | 
  Upgrade db2100 | 
  [production] | 
            
  | 07:11 | 
  <oblivian@deploy1001> | 
  helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . | 
  [production] |