|
2024-09-19
ยง
|
| 16:46 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api (T341066) |
[tools] |
| 16:45 |
<wmbot~dcaro@urcuchillay> |
END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component jobs-api |
[tools] |
| 16:44 |
<vgutierrez> |
uploaded purged 0.24 to apt.wm.o (bullseye-wikimedia) |
[production] |
| 16:43 |
<wmbot~dcaro@urcuchillay> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[tools] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'es2040 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69356 and previous config saved to /var/cache/conftool/dbconfig/20240919-164111-arnaudb.json |
[production] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2220 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69355 and previous config saved to /var/cache/conftool/dbconfig/20240919-164106-arnaudb.json |
[production] |
| 16:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2219 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69354 and previous config saved to /var/cache/conftool/dbconfig/20240919-164101-arnaudb.json |
[production] |
| 16:40 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2195 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69353 and previous config saved to /var/cache/conftool/dbconfig/20240919-164056-arnaudb.json |
[production] |
| 16:40 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2182 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69352 and previous config saved to /var/cache/conftool/dbconfig/20240919-164051-arnaudb.json |
[production] |
| 16:40 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2181 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69351 and previous config saved to /var/cache/conftool/dbconfig/20240919-164046-arnaudb.json |
[production] |
| 16:40 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2174 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69350 and previous config saved to /var/cache/conftool/dbconfig/20240919-164041-arnaudb.json |
[production] |
| 16:40 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2173 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69349 and previous config saved to /var/cache/conftool/dbconfig/20240919-164036-arnaudb.json |
[production] |
| 16:40 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2152 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69348 and previous config saved to /var/cache/conftool/dbconfig/20240919-164031-arnaudb.json |
[production] |
| 16:40 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2131 (re)pooling @ 50%: T373105', diff saved to https://phabricator.wikimedia.org/P69347 and previous config saved to /var/cache/conftool/dbconfig/20240919-164026-arnaudb.json |
[production] |
| 16:38 |
<swfrench@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host parse2020.codfw.wmnet |
[production] |
| 16:38 |
<swfrench@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node pool for host parse2020.codfw.wmnet |
[production] |
| 16:38 |
<topranks> |
disable LAG interface from asw-d-codfw to ssw1-dX-codfw |
[production] |
| 16:38 |
<swfrench@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host parse2019.codfw.wmnet |
[production] |
| 16:38 |
<swfrench@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node pool for host parse2019.codfw.wmnet |
[production] |
| 16:38 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api (T341066) |
[tools] |
| 16:37 |
<swfrench@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host parse2018.codfw.wmnet |
[production] |
| 16:37 |
<swfrench@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node pool for host parse2018.codfw.wmnet |
[production] |
| 16:37 |
<swfrench@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2282.codfw.wmnet |
[production] |
| 16:37 |
<swfrench@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node pool for host mw2282.codfw.wmnet |
[production] |
| 16:37 |
<swfrench@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubernetes2053.codfw.wmnet |
[production] |
| 16:37 |
<swfrench@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node pool for host kubernetes2053.codfw.wmnet |
[production] |
| 16:37 |
<swfrench@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubernetes2052.codfw.wmnet |
[production] |
| 16:36 |
<swfrench@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node pool for host kubernetes2052.codfw.wmnet |
[production] |
| 16:34 |
<effie> |
restarting confd on all servers on: codfw, ulsof, eqsin - T373105 |
[production] |
| 16:33 |
<vgutierrez> |
testing purged 0.24 in cp2037 - T334078 |
[production] |
| 16:27 |
<Emperor> |
restart swift-object-replicator on thanos-be2002 |
[production] |
| 16:27 |
<sukhe@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=(cp2041|cp2042).codfw.wmnet [reason: T373105 is done] |
[production] |
| 16:26 |
<sukhe@cumin1002> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2042.codfw.wmnet |
[production] |
| 16:26 |
<sukhe@cumin1002> |
START - Cookbook sre.hosts.remove-downtime for cp2042.codfw.wmnet |
[production] |
| 16:26 |
<sukhe@cumin1002> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2041.codfw.wmnet |
[production] |
| 16:26 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api (T341066) |
[tools] |
| 16:26 |
<sukhe@cumin1002> |
START - Cookbook sre.hosts.remove-downtime for cp2041.codfw.wmnet |
[production] |
| 16:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'es2040 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69346 and previous config saved to /var/cache/conftool/dbconfig/20240919-162606-arnaudb.json |
[production] |
| 16:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2220 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69345 and previous config saved to /var/cache/conftool/dbconfig/20240919-162601-arnaudb.json |
[production] |
| 16:25 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2219 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69344 and previous config saved to /var/cache/conftool/dbconfig/20240919-162556-arnaudb.json |
[production] |
| 16:25 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2195 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69343 and previous config saved to /var/cache/conftool/dbconfig/20240919-162551-arnaudb.json |
[production] |
| 16:25 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2182 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69342 and previous config saved to /var/cache/conftool/dbconfig/20240919-162546-arnaudb.json |
[production] |
| 16:25 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2181 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69341 and previous config saved to /var/cache/conftool/dbconfig/20240919-162541-arnaudb.json |
[production] |
| 16:25 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2174 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69340 and previous config saved to /var/cache/conftool/dbconfig/20240919-162536-arnaudb.json |
[production] |
| 16:25 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2173 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69339 and previous config saved to /var/cache/conftool/dbconfig/20240919-162531-arnaudb.json |
[production] |
| 16:25 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2152 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69338 and previous config saved to /var/cache/conftool/dbconfig/20240919-162526-arnaudb.json |
[production] |
| 16:25 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2131 (re)pooling @ 25%: T373105', diff saved to https://phabricator.wikimedia.org/P69337 and previous config saved to /var/cache/conftool/dbconfig/20240919-162521-arnaudb.json |
[production] |
| 16:17 |
<topranks> |
migrating server uplinks in codfw rack D8 to new top-of-rack switch T373105 |
[production] |
| 16:16 |
<cmooney@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:25:00 on 25 hosts with reason: Move server uplinks in codfw rack D8 |
[production] |
| 16:16 |
<cmooney@cumin1002> |
START - Cookbook sre.hosts.downtime for 0:25:00 on 25 hosts with reason: Move server uplinks in codfw rack D8 |
[production] |