|
2024-09-16
ยง
|
| 17:27 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2227 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69194 and previous config saved to /var/cache/conftool/dbconfig/20240916-172701-arnaudb.json |
[production] |
| 17:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2225 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69193 and previous config saved to /var/cache/conftool/dbconfig/20240916-172656-arnaudb.json |
[production] |
| 17:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2224 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69192 and previous config saved to /var/cache/conftool/dbconfig/20240916-172651-arnaudb.json |
[production] |
| 17:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2222 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69191 and previous config saved to /var/cache/conftool/dbconfig/20240916-172646-arnaudb.json |
[production] |
| 17:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2221 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69190 and previous config saved to /var/cache/conftool/dbconfig/20240916-172641-arnaudb.json |
[production] |
| 17:22 |
<mfossati@deploy1003> |
Finished deploy [airflow-dags/platform_eng@5ad6710]: (no justification provided) (duration: 00m 44s) |
[production] |
| 17:21 |
<mfossati@deploy1003> |
Started deploy [airflow-dags/platform_eng@5ad6710]: (no justification provided) |
[production] |
| 17:16 |
<dancy@deploy1003> |
Finished deploy [releng/phatality@b1a2a70]: testing (duration: 00m 05s) |
[production] |
| 17:16 |
<dancy@deploy1003> |
Started deploy [releng/phatality@b1a2a70]: testing |
[production] |
| 17:14 |
<dancy@deploy1003> |
Installation of scap version "4.101.3" completed for 2 hosts |
[production] |
| 17:12 |
<dancy@deploy1003> |
Installing scap version "4.101.3" for 2 hosts |
[production] |
| 17:12 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2238 (re)pooling @ 75%: T374623', diff saved to https://phabricator.wikimedia.org/P69189 and previous config saved to /var/cache/conftool/dbconfig/20240916-171206-arnaudb.json |
[production] |
| 17:12 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2237 (re)pooling @ 75%: T374623', diff saved to https://phabricator.wikimedia.org/P69188 and previous config saved to /var/cache/conftool/dbconfig/20240916-171201-arnaudb.json |
[production] |
| 17:11 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2227 (re)pooling @ 75%: T374623', diff saved to https://phabricator.wikimedia.org/P69187 and previous config saved to /var/cache/conftool/dbconfig/20240916-171155-arnaudb.json |
[production] |
| 17:11 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2225 (re)pooling @ 75%: T374623', diff saved to https://phabricator.wikimedia.org/P69186 and previous config saved to /var/cache/conftool/dbconfig/20240916-171150-arnaudb.json |
[production] |
| 17:11 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2224 (re)pooling @ 75%: T374623', diff saved to https://phabricator.wikimedia.org/P69185 and previous config saved to /var/cache/conftool/dbconfig/20240916-171146-arnaudb.json |
[production] |
| 17:11 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2222 (re)pooling @ 75%: T374623', diff saved to https://phabricator.wikimedia.org/P69184 and previous config saved to /var/cache/conftool/dbconfig/20240916-171140-arnaudb.json |
[production] |
| 17:11 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2221 (re)pooling @ 75%: T374623', diff saved to https://phabricator.wikimedia.org/P69183 and previous config saved to /var/cache/conftool/dbconfig/20240916-171136-arnaudb.json |
[production] |
| 17:08 |
<dancy@deploy1003> |
Installing scap version "4.101.3" for 1 hosts |
[production] |
| 17:03 |
<elukey@cumin1002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1002" |
[production] |
| 17:03 |
<dancy@deploy1003> |
Installing scap version "4.101.3" for 211 hosts |
[production] |
| 16:58 |
<dancy@deploy1003> |
Installation of scap version "4.102.0" completed for 211 hosts |
[production] |
| 16:57 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2238 (re)pooling @ 50%: T374623', diff saved to https://phabricator.wikimedia.org/P69182 and previous config saved to /var/cache/conftool/dbconfig/20240916-165700-arnaudb.json |
[production] |
| 16:56 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2237 (re)pooling @ 50%: T374623', diff saved to https://phabricator.wikimedia.org/P69181 and previous config saved to /var/cache/conftool/dbconfig/20240916-165655-arnaudb.json |
[production] |
| 16:56 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2227 (re)pooling @ 50%: T374623', diff saved to https://phabricator.wikimedia.org/P69180 and previous config saved to /var/cache/conftool/dbconfig/20240916-165650-arnaudb.json |
[production] |
| 16:56 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2225 (re)pooling @ 50%: T374623', diff saved to https://phabricator.wikimedia.org/P69179 and previous config saved to /var/cache/conftool/dbconfig/20240916-165645-arnaudb.json |
[production] |
| 16:56 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2224 (re)pooling @ 50%: T374623', diff saved to https://phabricator.wikimedia.org/P69178 and previous config saved to /var/cache/conftool/dbconfig/20240916-165640-arnaudb.json |
[production] |
| 16:56 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2222 (re)pooling @ 50%: T374623', diff saved to https://phabricator.wikimedia.org/P69177 and previous config saved to /var/cache/conftool/dbconfig/20240916-165635-arnaudb.json |
[production] |
| 16:56 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2221 (re)pooling @ 50%: T374623', diff saved to https://phabricator.wikimedia.org/P69176 and previous config saved to /var/cache/conftool/dbconfig/20240916-165630-arnaudb.json |
[production] |
| 16:54 |
<dancy@deploy1003> |
Installing scap version "4.102.0" for 211 hosts |
[production] |
| 16:48 |
<elukey@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage |
[production] |
| 16:45 |
<elukey@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage |
[production] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2238 (re)pooling @ 25%: T374623', diff saved to https://phabricator.wikimedia.org/P69175 and previous config saved to /var/cache/conftool/dbconfig/20240916-164154-arnaudb.json |
[production] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2237 (re)pooling @ 25%: T374623', diff saved to https://phabricator.wikimedia.org/P69174 and previous config saved to /var/cache/conftool/dbconfig/20240916-164149-arnaudb.json |
[production] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2227 (re)pooling @ 25%: T374623', diff saved to https://phabricator.wikimedia.org/P69173 and previous config saved to /var/cache/conftool/dbconfig/20240916-164144-arnaudb.json |
[production] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2225 (re)pooling @ 25%: T374623', diff saved to https://phabricator.wikimedia.org/P69172 and previous config saved to /var/cache/conftool/dbconfig/20240916-164139-arnaudb.json |
[production] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2224 (re)pooling @ 25%: T374623', diff saved to https://phabricator.wikimedia.org/P69171 and previous config saved to /var/cache/conftool/dbconfig/20240916-164134-arnaudb.json |
[production] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2222 (re)pooling @ 25%: T374623', diff saved to https://phabricator.wikimedia.org/P69170 and previous config saved to /var/cache/conftool/dbconfig/20240916-164129-arnaudb.json |
[production] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2221 (re)pooling @ 25%: T374623', diff saved to https://phabricator.wikimedia.org/P69169 and previous config saved to /var/cache/conftool/dbconfig/20240916-164124-arnaudb.json |
[production] |
| 16:33 |
<elukey@cumin1002> |
START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm |
[production] |
| 16:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2238 (re)pooling @ 16%: T374623', diff saved to https://phabricator.wikimedia.org/P69168 and previous config saved to /var/cache/conftool/dbconfig/20240916-162649-arnaudb.json |
[production] |
| 16:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2237 (re)pooling @ 16%: T374623', diff saved to https://phabricator.wikimedia.org/P69167 and previous config saved to /var/cache/conftool/dbconfig/20240916-162644-arnaudb.json |
[production] |
| 16:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2227 (re)pooling @ 16%: T374623', diff saved to https://phabricator.wikimedia.org/P69166 and previous config saved to /var/cache/conftool/dbconfig/20240916-162638-arnaudb.json |
[production] |
| 16:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2225 (re)pooling @ 16%: T374623', diff saved to https://phabricator.wikimedia.org/P69165 and previous config saved to /var/cache/conftool/dbconfig/20240916-162633-arnaudb.json |
[production] |
| 16:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2224 (re)pooling @ 16%: T374623', diff saved to https://phabricator.wikimedia.org/P69164 and previous config saved to /var/cache/conftool/dbconfig/20240916-162629-arnaudb.json |
[production] |
| 16:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2222 (re)pooling @ 16%: T374623', diff saved to https://phabricator.wikimedia.org/P69163 and previous config saved to /var/cache/conftool/dbconfig/20240916-162623-arnaudb.json |
[production] |
| 16:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2221 (re)pooling @ 16%: T374623', diff saved to https://phabricator.wikimedia.org/P69162 and previous config saved to /var/cache/conftool/dbconfig/20240916-162618-arnaudb.json |
[production] |
| 16:22 |
<ebernhardson@deploy1003> |
Finished deploy [airflow-dags/search@5ad6710]: standardize created file permissions (duration: 00m 22s) |
[production] |
| 16:22 |
<ebernhardson@deploy1003> |
Started deploy [airflow-dags/search@5ad6710]: standardize created file permissions |
[production] |
| 16:12 |
<rzl> |
rzl@cumin1002:~$ sudo cumin logstash[2023,2025,2030-2032].codfw.wmnet,logstash[1025,1030,1032].eqiad.wmnet 'systemctl restart opensearch-dashboards' # only hosts where status is failed |
[production] |