|
2023-11-24
ยง
|
| 09:55 |
<jayme@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2425.codfw.wmnet with reason: host reimage |
[production] |
| 09:55 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2190 (re)pooling @ 70%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53878 and previous config saved to /var/cache/conftool/dbconfig/20231124-095508-arnaudb.json |
[production] |
| 09:54 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2425.codfw.wmnet with reason: host reimage |
[production] |
| 09:54 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2431.codfw.wmnet with reason: host reimage |
[production] |
| 09:54 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'es2032 (re)pooling @ 50%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53877 and previous config saved to /var/cache/conftool/dbconfig/20231124-095423-arnaudb.json |
[production] |
| 09:54 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2421.codfw.wmnet with reason: host reimage |
[production] |
| 09:53 |
<jayme@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1472.eqiad.wmnet with reason: host reimage |
[production] |
| 09:53 |
<jayme@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1473.eqiad.wmnet with reason: host reimage |
[production] |
| 09:52 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2189 (re)pooling @ 70%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53876 and previous config saved to /var/cache/conftool/dbconfig/20231124-095238-arnaudb.json |
[production] |
| 09:51 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1475.eqiad.wmnet with reason: host reimage |
[production] |
| 09:51 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2188 (re)pooling @ 70%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53875 and previous config saved to /var/cache/conftool/dbconfig/20231124-095145-arnaudb.json |
[production] |
| 09:51 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1474.eqiad.wmnet with reason: host reimage |
[production] |
| 09:50 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1473.eqiad.wmnet with reason: host reimage |
[production] |
| 09:50 |
<klausman@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . |
[production] |
| 09:50 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1472.eqiad.wmnet with reason: host reimage |
[production] |
| 09:47 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2195 (re)pooling @ 60%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53874 and previous config saved to /var/cache/conftool/dbconfig/20231124-094713-arnaudb.json |
[production] |
| 09:46 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2131 (re)pooling @ 60%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53873 and previous config saved to /var/cache/conftool/dbconfig/20231124-094614-arnaudb.json |
[production] |
| 09:40 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2190 (re)pooling @ 60%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53872 and previous config saved to /var/cache/conftool/dbconfig/20231124-094001-arnaudb.json |
[production] |
| 09:39 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'es2032 (re)pooling @ 45%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53871 and previous config saved to /var/cache/conftool/dbconfig/20231124-093918-arnaudb.json |
[production] |
| 09:39 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reimage for host mw1475.eqiad.wmnet with OS bullseye |
[production] |
| 09:39 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reimage for host mw1474.eqiad.wmnet with OS bullseye |
[production] |
| 09:38 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reimage for host mw1473.eqiad.wmnet with OS bullseye |
[production] |
| 09:37 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reimage for host mw1472.eqiad.wmnet with OS bullseye |
[production] |
| 09:37 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2189 (re)pooling @ 60%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53870 and previous config saved to /var/cache/conftool/dbconfig/20231124-093733-arnaudb.json |
[production] |
| 09:37 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reimage for host mw2431.codfw.wmnet with OS bullseye |
[production] |
| 09:37 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reimage for host mw2425.codfw.wmnet with OS bullseye |
[production] |
| 09:36 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reimage for host mw2421.codfw.wmnet with OS bullseye |
[production] |
| 09:36 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2188 (re)pooling @ 60%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53869 and previous config saved to /var/cache/conftool/dbconfig/20231124-093640-arnaudb.json |
[production] |
| 09:32 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2195 (re)pooling @ 50%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53868 and previous config saved to /var/cache/conftool/dbconfig/20231124-093207-arnaudb.json |
[production] |
| 09:31 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2131 (re)pooling @ 50%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53867 and previous config saved to /var/cache/conftool/dbconfig/20231124-093109-arnaudb.json |
[production] |
| 09:24 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2190 (re)pooling @ 50%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53866 and previous config saved to /var/cache/conftool/dbconfig/20231124-092456-arnaudb.json |
[production] |
| 09:24 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'es2032 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53865 and previous config saved to /var/cache/conftool/dbconfig/20231124-092413-arnaudb.json |
[production] |
| 09:22 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2189 (re)pooling @ 50%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53864 and previous config saved to /var/cache/conftool/dbconfig/20231124-092228-arnaudb.json |
[production] |
| 09:21 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2188 (re)pooling @ 50%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53862 and previous config saved to /var/cache/conftool/dbconfig/20231124-092135-arnaudb.json |
[production] |
| 09:17 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2195 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53861 and previous config saved to /var/cache/conftool/dbconfig/20231124-091702-arnaudb.json |
[production] |
| 09:16 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2193 (re)pooling @ 100%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53860 and previous config saved to /var/cache/conftool/dbconfig/20231124-091639-arnaudb.json |
[production] |
| 09:16 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2180 (re)pooling @ 100%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53859 and previous config saved to /var/cache/conftool/dbconfig/20231124-091621-arnaudb.json |
[production] |
| 09:16 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2131 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53858 and previous config saved to /var/cache/conftool/dbconfig/20231124-091604-arnaudb.json |
[production] |
| 09:16 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2181 (re)pooling @ 100%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53857 and previous config saved to /var/cache/conftool/dbconfig/20231124-091601-arnaudb.json |
[production] |
| 09:09 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2190 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53856 and previous config saved to /var/cache/conftool/dbconfig/20231124-090951-arnaudb.json |
[production] |
| 09:09 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'es2032 (re)pooling @ 35%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53855 and previous config saved to /var/cache/conftool/dbconfig/20231124-090908-arnaudb.json |
[production] |
| 09:07 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2189 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53854 and previous config saved to /var/cache/conftool/dbconfig/20231124-090723-arnaudb.json |
[production] |
| 09:06 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2188 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53853 and previous config saved to /var/cache/conftool/dbconfig/20231124-090630-arnaudb.json |
[production] |
| 09:01 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2195 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53852 and previous config saved to /var/cache/conftool/dbconfig/20231124-090157-arnaudb.json |
[production] |
| 09:01 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2193 (re)pooling @ 80%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53851 and previous config saved to /var/cache/conftool/dbconfig/20231124-090134-arnaudb.json |
[production] |
| 09:01 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2180 (re)pooling @ 80%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53850 and previous config saved to /var/cache/conftool/dbconfig/20231124-090116-arnaudb.json |
[production] |
| 09:01 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2131 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53849 and previous config saved to /var/cache/conftool/dbconfig/20231124-090059-arnaudb.json |
[production] |
| 09:00 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2181 (re)pooling @ 80%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53848 and previous config saved to /var/cache/conftool/dbconfig/20231124-090056-arnaudb.json |
[production] |
| 08:54 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'db2190 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53847 and previous config saved to /var/cache/conftool/dbconfig/20231124-085446-arnaudb.json |
[production] |
| 08:54 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'es2032 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53846 and previous config saved to /var/cache/conftool/dbconfig/20231124-085403-arnaudb.json |
[production] |