|
2023-11-23
ยง
|
| 13:40 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2175 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53764 and previous config saved to /var/cache/conftool/dbconfig/20231123-134052-arnaudb.json |
[production] |
| 13:39 |
<stevemunene@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host druid1008.eqiad.wmnet with OS bullseye |
[production] |
| 13:37 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2181 (re)pooling @ 40%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53763 and previous config saved to /var/cache/conftool/dbconfig/20231123-133755-arnaudb.json |
[production] |
| 13:30 |
<jmm@cumin2002> |
START - Cookbook sre.puppet.migrate-host for host irc2002.wikimedia.org |
[production] |
| 13:28 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db1243 (re)pooling @ 10%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53762 and previous config saved to /var/cache/conftool/dbconfig/20231123-132840-arnaudb.json |
[production] |
| 13:26 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2146 (re)pooling @ 60%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53761 and previous config saved to /var/cache/conftool/dbconfig/20231123-132619-arnaudb.json |
[production] |
| 13:25 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2175 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53760 and previous config saved to /var/cache/conftool/dbconfig/20231123-132547-arnaudb.json |
[production] |
| 13:22 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.reimage for host dbproxy2004.codfw.wmnet with OS bookworm |
[production] |
| 13:22 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2181 (re)pooling @ 30%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53759 and previous config saved to /var/cache/conftool/dbconfig/20231123-132250-arnaudb.json |
[production] |
| 13:22 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 100%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53758 and previous config saved to /var/cache/conftool/dbconfig/20231123-132215-arnaudb.json |
[production] |
| 13:21 |
<marostegui@cumin1001> |
END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dbproxy2004.codfw.wmnet with OS bookworm |
[production] |
| 13:11 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2146 (re)pooling @ 50%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53757 and previous config saved to /var/cache/conftool/dbconfig/20231123-131114-arnaudb.json |
[production] |
| 13:10 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2175 (re)pooling @ 20%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53756 and previous config saved to /var/cache/conftool/dbconfig/20231123-131042-arnaudb.json |
[production] |
| 13:07 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2181 (re)pooling @ 20%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53755 and previous config saved to /var/cache/conftool/dbconfig/20231123-130745-arnaudb.json |
[production] |
| 13:07 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 90%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53754 and previous config saved to /var/cache/conftool/dbconfig/20231123-130710-arnaudb.json |
[production] |
| 12:56 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2146 (re)pooling @ 40%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53753 and previous config saved to /var/cache/conftool/dbconfig/20231123-125609-arnaudb.json |
[production] |
| 12:55 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2175 (re)pooling @ 10%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53752 and previous config saved to /var/cache/conftool/dbconfig/20231123-125537-arnaudb.json |
[production] |
| 12:52 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2181 (re)pooling @ 10%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53751 and previous config saved to /var/cache/conftool/dbconfig/20231123-125240-arnaudb.json |
[production] |
| 12:52 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 80%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53750 and previous config saved to /var/cache/conftool/dbconfig/20231123-125205-arnaudb.json |
[production] |
| 12:45 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2181.codfw.wmnet onto db2195.codfw.wmnet |
[production] |
| 12:41 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2146 (re)pooling @ 30%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53749 and previous config saved to /var/cache/conftool/dbconfig/20231123-124104-arnaudb.json |
[production] |
| 12:40 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.reimage for host dbproxy2004.codfw.wmnet with OS bookworm |
[production] |
| 12:37 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 70%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53748 and previous config saved to /var/cache/conftool/dbconfig/20231123-123700-arnaudb.json |
[production] |
| 12:30 |
<vgutierrez> |
depooling ncredir4001 till puppet is fixed |
[production] |
| 12:26 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2146 (re)pooling @ 20%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53747 and previous config saved to /var/cache/conftool/dbconfig/20231123-122559-arnaudb.json |
[production] |
| 12:21 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 60%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53746 and previous config saved to /var/cache/conftool/dbconfig/20231123-122155-arnaudb.json |
[production] |
| 12:19 |
<stevemunene@cumin1001> |
START - Cookbook sre.hosts.reimage for host druid1008.eqiad.wmnet with OS bullseye |
[production] |
| 12:11 |
<stevemunene@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host druid1008.eqiad.wmnet with OS bullseye |
[production] |
| 12:10 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2146 (re)pooling @ 10%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53745 and previous config saved to /var/cache/conftool/dbconfig/20231123-121054-arnaudb.json |
[production] |
| 12:08 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2146.codfw.wmnet onto db2188.codfw.wmnet |
[production] |
| 12:06 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 50%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53744 and previous config saved to /var/cache/conftool/dbconfig/20231123-120650-arnaudb.json |
[production] |
| 11:51 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 40%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53743 and previous config saved to /var/cache/conftool/dbconfig/20231123-115145-arnaudb.json |
[production] |
| 11:36 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 30%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53742 and previous config saved to /var/cache/conftool/dbconfig/20231123-113640-arnaudb.json |
[production] |
| 11:30 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host lists1004.eqiad.wmnet |
[production] |
| 11:25 |
<stevemunene@cumin1001> |
START - Cookbook sre.hosts.reimage for host druid1008.eqiad.wmnet with OS bullseye |
[production] |
| 11:24 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2175.codfw.wmnet onto db2189.codfw.wmnet |
[production] |
| 11:23 |
<jmm@cumin2002> |
START - Cookbook sre.puppet.migrate-host for host lists1004.eqiad.wmnet |
[production] |
| 11:21 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2149 (re)pooling @ 20%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P53741 and previous config saved to /var/cache/conftool/dbconfig/20231123-112135-arnaudb.json |
[production] |
| 11:16 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dborch1001.wikimedia.org |
[production] |
| 11:13 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host dborch1001.wikimedia.org |
[production] |
| 11:12 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . |
[production] |
| 11:12 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . |
[production] |
| 11:12 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . |
[production] |
| 11:12 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-draftquality' for release 'main' . |
[production] |
| 11:12 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
| 11:11 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articletopic' for release 'main' . |
[production] |
| 11:11 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . |
[production] |
| 11:11 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . |
[production] |
| 11:11 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . |
[production] |
| 11:11 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . |
[production] |