|
2026-11-05
ยง
|
| 04:33 |
<btullis@cumin1004> |
END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1042.eqiad.wmnet |
[production] |
| 04:31 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1042.eqiad.wmnet |
[production] |
| 04:31 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1041.eqiad.wmnet |
[production] |
| 04:31 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1041.eqiad.wmnet |
[production] |
| 04:27 |
<ryankemper@cumin2003> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1026.eqiad.wmnet, repooling both afterwards |
[production] |
| 04:26 |
<ryankemper@cumin2003> |
START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2020.codfw.wmnet, repooling both afterwards |
[production] |
| 04:26 |
<ryankemper@cumin2003> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2019.codfw.wmnet, repooling both afterwards |
[production] |
| 04:26 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1041.eqiad.wmnet |
[production] |
| 04:19 |
<ryankemper@cumin2003> |
START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1026.eqiad.wmnet, repooling both afterwards |
[production] |
| 04:19 |
<ryankemper@cumin2003> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1025.eqiad.wmnet, repooling both afterwards |
[production] |
| 04:18 |
<ryankemper@cumin2003> |
START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2019.codfw.wmnet, repooling both afterwards |
[production] |
| 04:18 |
<ryankemper@cumin2003> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2018.codfw.wmnet, repooling both afterwards |
[production] |
| 04:11 |
<ryankemper@cumin2003> |
START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1025.eqiad.wmnet, repooling both afterwards |
[production] |
| 04:11 |
<ryankemper@cumin2003> |
START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2018.codfw.wmnet, repooling both afterwards |
[production] |
| 03:56 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1041.eqiad.wmnet |
[production] |
| 03:56 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1040.eqiad.wmnet |
[production] |
| 03:56 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1040.eqiad.wmnet |
[production] |
| 03:46 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1040.eqiad.wmnet |
[production] |
| 03:16 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1040.eqiad.wmnet |
[production] |
| 03:16 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1039.eqiad.wmnet |
[production] |
| 03:16 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1039.eqiad.wmnet |
[production] |
| 03:11 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1039.eqiad.wmnet |
[production] |
| 03:10 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1039.eqiad.wmnet |
[production] |
| 03:10 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1028.eqiad.wmnet |
[production] |
| 03:10 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1028.eqiad.wmnet |
[production] |
| 03:02 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1028.eqiad.wmnet |
[production] |
| 02:35 |
<dani@deploy2003> |
helmfile [codfw] DONE helmfile.d/services/miscweb: apply |
[production] |
| 02:35 |
<dani@deploy2003> |
helmfile [codfw] START helmfile.d/services/miscweb: apply |
[production] |
| 02:35 |
<dani@deploy2003> |
helmfile [eqiad] DONE helmfile.d/services/miscweb: apply |
[production] |
| 02:35 |
<dani@deploy2003> |
helmfile [eqiad] START helmfile.d/services/miscweb: apply |
[production] |
| 02:34 |
<dani@deploy2003> |
helmfile [staging] DONE helmfile.d/services/miscweb: apply |
[production] |
| 02:34 |
<dani@deploy2003> |
helmfile [staging] START helmfile.d/services/miscweb: apply |
[production] |
| 02:32 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1028.eqiad.wmnet |
[production] |
| 02:32 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1027.eqiad.wmnet |
[production] |
| 02:32 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1027.eqiad.wmnet |
[production] |
| 02:24 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1027.eqiad.wmnet |
[production] |
| 02:23 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1027.eqiad.wmnet |
[production] |
| 02:23 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1026.eqiad.wmnet |
[production] |
| 02:23 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1026.eqiad.wmnet |
[production] |
| 02:22 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97334 and previous config saved to /var/cache/conftool/dbconfig/20261105-022159-ladsgroup.json |
[production] |
| 02:11 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2228', diff saved to https://phabricator.wikimedia.org/P97333 and previous config saved to /var/cache/conftool/dbconfig/20261105-021157-ladsgroup.json |
[production] |
| 02:10 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1026.eqiad.wmnet |
[production] |
| 02:09 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1026.eqiad.wmnet |
[production] |
| 02:09 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1025.eqiad.wmnet |
[production] |
| 02:09 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1025.eqiad.wmnet |
[production] |
| 02:09 |
<mwpresync@deploy2003> |
Finished scap build-images: Publishing wmf/next image (duration: 07m 31s) |
[production] |
| 02:01 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2228', diff saved to https://phabricator.wikimedia.org/P97332 and previous config saved to /var/cache/conftool/dbconfig/20261105-020155-ladsgroup.json |
[production] |
| 02:01 |
<mwpresync@deploy2003> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 02:01 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1025.eqiad.wmnet |
[production] |
| 01:51 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97331 and previous config saved to /var/cache/conftool/dbconfig/20261105-015153-ladsgroup.json |
[production] |