| 
      
        2023-11-23
      
      ยง
     | 
  
    
  | 13:53 | 
  <marostegui@cumin1001> | 
  END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dbproxy2004.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 13:53 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2181 (re)pooling @ 50%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53768 and previous config saved to /var/cache/conftool/dbconfig/20231123-135300-arnaudb.json | 
  [production] | 
            
  | 13:49 | 
  <jmm@cumin2002> | 
  END (FAIL) - Cookbook sre.puppet.migrate-host (exit_code=99) for host irc2002.wikimedia.org | 
  [production] | 
            
  | 13:45 | 
  <arnaudb@cumin1001> | 
  START - Cookbook sre.mysql.clone of db2131.codfw.wmnet onto db2191.codfw.wmnet | 
  [production] | 
            
  | 13:43 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db1243 (re)pooling @ 20%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53767 and previous config saved to /var/cache/conftool/dbconfig/20231123-134345-arnaudb.json | 
  [production] | 
            
  | 13:43 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'Cloning db2131 in db2191 for T343674', diff saved to https://phabricator.wikimedia.org/P53766 and previous config saved to /var/cache/conftool/dbconfig/20231123-134316-arnaudb.json | 
  [production] | 
            
  | 13:41 | 
  <arnaudb@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2191.codfw.wmnet with reason: provisionning db2191.codfw.wmnet - T343674 | 
  [production] | 
            
  | 13:41 | 
  <arnaudb@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2191.codfw.wmnet with reason: provisionning db2191.codfw.wmnet - T343674 | 
  [production] | 
            
  | 13:41 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2146 (re)pooling @ 70%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53765 and previous config saved to /var/cache/conftool/dbconfig/20231123-134124-arnaudb.json | 
  [production] | 
            
  | 13:41 | 
  <arnaudb@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2131.codfw.wmnet with reason: provisionning db2191.codfw.wmnet - T343674 | 
  [production] | 
            
  | 13:41 | 
  <arnaudb@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2131.codfw.wmnet with reason: provisionning db2191.codfw.wmnet - T343674 | 
  [production] | 
            
  | 13:40 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2175 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53764 and previous config saved to /var/cache/conftool/dbconfig/20231123-134052-arnaudb.json | 
  [production] | 
            
  | 13:39 | 
  <stevemunene@cumin1001> | 
  END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host druid1008.eqiad.wmnet with OS bullseye | 
  [production] | 
            
  | 13:37 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2181 (re)pooling @ 40%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53763 and previous config saved to /var/cache/conftool/dbconfig/20231123-133755-arnaudb.json | 
  [production] | 
            
  | 13:30 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.puppet.migrate-host for host irc2002.wikimedia.org | 
  [production] | 
            
  | 13:28 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db1243 (re)pooling @ 10%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53762 and previous config saved to /var/cache/conftool/dbconfig/20231123-132840-arnaudb.json | 
  [production] | 
            
  | 13:26 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2146 (re)pooling @ 60%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53761 and previous config saved to /var/cache/conftool/dbconfig/20231123-132619-arnaudb.json | 
  [production] | 
            
  | 13:25 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2175 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53760 and previous config saved to /var/cache/conftool/dbconfig/20231123-132547-arnaudb.json | 
  [production] | 
            
  | 13:22 | 
  <marostegui@cumin1001> | 
  START - Cookbook sre.hosts.reimage for host dbproxy2004.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 13:22 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2181 (re)pooling @ 30%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53759 and previous config saved to /var/cache/conftool/dbconfig/20231123-132250-arnaudb.json | 
  [production] | 
            
  | 13:22 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2149 (re)pooling @ 100%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53758 and previous config saved to /var/cache/conftool/dbconfig/20231123-132215-arnaudb.json | 
  [production] | 
            
  | 13:21 | 
  <marostegui@cumin1001> | 
  END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dbproxy2004.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 13:11 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2146 (re)pooling @ 50%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53757 and previous config saved to /var/cache/conftool/dbconfig/20231123-131114-arnaudb.json | 
  [production] | 
            
  | 13:10 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2175 (re)pooling @ 20%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53756 and previous config saved to /var/cache/conftool/dbconfig/20231123-131042-arnaudb.json | 
  [production] | 
            
  | 13:07 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2181 (re)pooling @ 20%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53755 and previous config saved to /var/cache/conftool/dbconfig/20231123-130745-arnaudb.json | 
  [production] | 
            
  | 13:07 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2149 (re)pooling @ 90%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53754 and previous config saved to /var/cache/conftool/dbconfig/20231123-130710-arnaudb.json | 
  [production] | 
            
  | 12:56 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2146 (re)pooling @ 40%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53753 and previous config saved to /var/cache/conftool/dbconfig/20231123-125609-arnaudb.json | 
  [production] | 
            
  | 12:55 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2175 (re)pooling @ 10%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53752 and previous config saved to /var/cache/conftool/dbconfig/20231123-125537-arnaudb.json | 
  [production] | 
            
  | 12:52 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2181 (re)pooling @ 10%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53751 and previous config saved to /var/cache/conftool/dbconfig/20231123-125240-arnaudb.json | 
  [production] | 
            
  | 12:52 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2149 (re)pooling @ 80%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53750 and previous config saved to /var/cache/conftool/dbconfig/20231123-125205-arnaudb.json | 
  [production] | 
            
  | 12:45 | 
  <arnaudb@cumin1001> | 
  END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2181.codfw.wmnet onto db2195.codfw.wmnet | 
  [production] | 
            
  | 12:41 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2146 (re)pooling @ 30%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53749 and previous config saved to /var/cache/conftool/dbconfig/20231123-124104-arnaudb.json | 
  [production] | 
            
  | 12:40 | 
  <marostegui@cumin1001> | 
  START - Cookbook sre.hosts.reimage for host dbproxy2004.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 12:37 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2149 (re)pooling @ 70%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53748 and previous config saved to /var/cache/conftool/dbconfig/20231123-123700-arnaudb.json | 
  [production] | 
            
  | 12:30 | 
  <vgutierrez> | 
  depooling ncredir4001 till puppet is fixed | 
  [production] | 
            
  | 12:26 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2146 (re)pooling @ 20%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53747 and previous config saved to /var/cache/conftool/dbconfig/20231123-122559-arnaudb.json | 
  [production] | 
            
  | 12:21 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2149 (re)pooling @ 60%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53746 and previous config saved to /var/cache/conftool/dbconfig/20231123-122155-arnaudb.json | 
  [production] | 
            
  | 12:19 | 
  <stevemunene@cumin1001> | 
  START - Cookbook sre.hosts.reimage for host druid1008.eqiad.wmnet with OS bullseye | 
  [production] | 
            
  | 12:11 | 
  <stevemunene@cumin1001> | 
  END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host druid1008.eqiad.wmnet with OS bullseye | 
  [production] | 
            
  | 12:10 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2146 (re)pooling @ 10%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53745 and previous config saved to /var/cache/conftool/dbconfig/20231123-121054-arnaudb.json | 
  [production] | 
            
  | 12:08 | 
  <arnaudb@cumin1001> | 
  END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2146.codfw.wmnet onto db2188.codfw.wmnet | 
  [production] | 
            
  | 12:06 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2149 (re)pooling @ 50%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53744 and previous config saved to /var/cache/conftool/dbconfig/20231123-120650-arnaudb.json | 
  [production] | 
            
  | 11:51 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2149 (re)pooling @ 40%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53743 and previous config saved to /var/cache/conftool/dbconfig/20231123-115145-arnaudb.json | 
  [production] | 
            
  | 11:36 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2149 (re)pooling @ 30%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53742 and previous config saved to /var/cache/conftool/dbconfig/20231123-113640-arnaudb.json | 
  [production] | 
            
  | 11:30 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host lists1004.eqiad.wmnet | 
  [production] | 
            
  | 11:25 | 
  <stevemunene@cumin1001> | 
  START - Cookbook sre.hosts.reimage for host druid1008.eqiad.wmnet with OS bullseye | 
  [production] | 
            
  | 11:24 | 
  <arnaudb@cumin1001> | 
  END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2175.codfw.wmnet onto db2189.codfw.wmnet | 
  [production] | 
            
  | 11:23 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.puppet.migrate-host for host lists1004.eqiad.wmnet | 
  [production] | 
            
  | 11:21 | 
  <arnaudb@cumin1001> | 
  dbctl commit (dc=all): 'db2149 (re)pooling @ 20%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53741 and previous config saved to /var/cache/conftool/dbconfig/20231123-112135-arnaudb.json | 
  [production] | 
            
  | 11:16 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dborch1001.wikimedia.org | 
  [production] |