|
2026-07-27
§
|
| 14:01 |
<jiji@cumin1003> |
END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=1) Renumbering for host wikikube-worker1136.eqiad.wmnet |
[production] |
| 14:01 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1136.eqiad.wmnet |
[production] |
| 14:01 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1136.eqiad.wmnet |
[production] |
| 11:27 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1035: testing |
[production] |
| 11:27 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool es1035: testing |
[production] |
| 11:26 |
<ayounsi@cumin1003> |
END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool ulsfo [reason: router upgrade, T431752] |
[production] |
| 11:26 |
<ayounsi@cumin1003> |
START - Cookbook sre.dns.admin DNS admin: depool ulsfo [reason: router upgrade, T431752] |
[production] |
| 11:26 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1038: testing |
[production] |
| 11:24 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool es1038: testing |
[production] |
| 11:22 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1050: testing |
[production] |
| 11:22 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool es1050: testing |
[production] |
| 08:43 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1136.eqiad.wmnet |
[production] |
| 08:43 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1136.eqiad.wmnet |
[production] |
| 08:43 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1136.eqiad.wmnet |
[production] |
|
2026-07-24
§
|
| 17:21 |
<jiji@cumin1003> |
END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=1) Renumbering for host wikikube-worker1135.eqiad.wmnet |
[production] |
| 17:21 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1135.eqiad.wmnet |
[production] |
| 17:21 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1135.eqiad.wmnet |
[production] |
| 14:14 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1135.eqiad.wmnet |
[production] |
| 14:13 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1135.eqiad.wmnet |
[production] |
| 14:13 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1135.eqiad.wmnet |
[production] |
| 14:10 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1072.eqiad.wmnet |
[production] |
| 14:10 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1072.eqiad.wmnet |
[production] |
| 14:10 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1072.eqiad.wmnet |
[production] |
| 14:10 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1072.eqiad.wmnet |
[production] |
| 14:09 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1071.eqiad.wmnet |
[production] |
| 14:09 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1071.eqiad.wmnet |
[production] |
| 14:09 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1071.eqiad.wmnet |
[production] |
| 14:09 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1071.eqiad.wmnet |
[production] |
|
2026-07-23
§
|
| 17:09 |
<cwilliams@cumin1003> |
dbctl commit (dc=all): 'Depool db2215 T432986', diff saved to https://phabricator.wikimedia.org/P95126 and previous config saved to /var/cache/conftool/dbconfig/20260723-170903-cwilliams.json |
[production] |
| 16:28 |
<jiji@cumin1003> |
END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=99) Renumbering for host wikikube-worker1072.eqiad.wmnet |
[production] |
| 15:36 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1072.eqiad.wmnet |
[production] |
| 15:35 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1072.eqiad.wmnet |
[production] |
| 15:35 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1072.eqiad.wmnet |
[production] |
| 15:11 |
<jiji@cumin1003> |
END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=99) Renumbering for host wikikube-worker1071.eqiad.wmnet |
[production] |
| 15:02 |
<cmooney@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage2002.codfw.wmnet |
[production] |
| 15:02 |
<cmooney@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node pool for host kubestage2002.codfw.wmnet |
[production] |
| 15:01 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2035-2036,2087-2090,2286-2291].codfw.wmnet |
[production] |
| 15:01 |
<cmooney@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2035-2036,2087-2090,2286-2291].codfw.wmnet |
[production] |
| 14:25 |
<cmooney@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage2002.codfw.wmnet |
[production] |
| 14:23 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2035-2036,2087-2090,2286-2291].codfw.wmnet |
[production] |
| 14:22 |
<cmooney@cumin2003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2052: codfw rack B8 depool for maintenance |
[production] |
| 14:21 |
<cmooney@cumin2003> |
START - Cookbook sre.mysql.depool depool es2052: codfw rack B8 depool for maintenance |
[production] |
| 14:21 |
<cmooney@cumin2003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2249: codfw rack B8 depool for maintenance |
[production] |
| 14:21 |
<cmooney@cumin2003> |
START - Cookbook sre.mysql.depool depool db2249: codfw rack B8 depool for maintenance |
[production] |
| 14:21 |
<cmooney@cumin2003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2189: codfw rack B8 depool for maintenance |
[production] |
| 14:20 |
<cmooney@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node depool for host kubestage2002.codfw.wmnet |
[production] |