|
2026-04-21
§
|
| 13:55 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2142: Cloning |
[production] |
| 13:55 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db2142: Cloning |
[production] |
| 10:37 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2143: Reimage to Trixie |
[production] |
| 10:37 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db2143: Reimage to Trixie |
[production] |
| 09:05 |
<jayme> |
kubectl delete node $(nodeset -e wikikube-worker[1002-1005,1011-1012,1019-1020,1029-1031,1058-1063,1082-1083,1088-1092,1096-1112,1166-1168].eqiad.wmnet) - T423863 |
[production] |
| 08:45 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1153: Reimage to Trixie |
[production] |
| 08:45 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db1153: Reimage to Trixie |
[production] |
| 07:39 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1011: Reimage to Trixie |
[production] |
| 07:39 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc1011: Reimage to Trixie |
[production] |
| 07:05 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc2011: Cloning pc2021 |
[production] |
| 07:05 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc2011: Cloning pc2021 |
[production] |
| 06:12 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2144: Reimage to Trixie |
[production] |
| 06:12 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db2144: Reimage to Trixie |
[production] |
|
2026-04-20
§
|
| 15:50 |
<cgoubert@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2188.codfw.wmnet |
[production] |
| 15:50 |
<cgoubert@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2188.codfw.wmnet |
[production] |
| 15:13 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2036: Moving to another rack |
[production] |
| 15:13 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool es2036: Moving to another rack |
[production] |
| 14:00 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1151: Reimage to Trixie |
[production] |
| 14:00 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db1151: Reimage to Trixie |
[production] |
| 12:58 |
<jayme@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1002-1005,1011-1012,1019-1020,1029-1031,1058-1063,1082-1083,1088-1092,1096,1098-1112,1166-1168].eqiad.wmnet |
[production] |
| 12:28 |
<jayme@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1002-1005,1011-1012,1019-1020,1029-1031,1058-1063,1082-1083,1088-1092,1096,1098-1112,1166-1168].eqiad.wmnet |
[production] |
| 12:15 |
<jayme@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1328-1334,1360-1374].eqiad.wmnet |
[production] |
| 12:15 |
<jayme@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1328-1334,1360-1374].eqiad.wmnet |
[production] |
| 11:49 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5006.eqsin.wmnet |
[production] |
| 09:26 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5006.eqsin.wmnet |
[production] |
| 09:26 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5006.eqsin.wmnet |
[production] |
| 09:25 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5006.eqsin.wmnet |
[production] |
| 08:27 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1165: Reimage to Trixie |
[production] |
| 08:27 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db1165: Reimage to Trixie |
[production] |
| 08:14 |
<cgoubert@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2188.codfw.wmnet |
[production] |
| 08:14 |
<cgoubert@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2188.codfw.wmnet |
[production] |
| 06:50 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2229: Reimage to Trixie |
[production] |
| 06:50 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db2229: Reimage to Trixie |
[production] |
| 06:40 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depool db2229 T423837', diff saved to https://phabricator.wikimedia.org/P91129 and previous config saved to /var/cache/conftool/dbconfig/20260420-064042-marostegui.json |
[production] |
| 05:32 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2151: Reimage to Trixie |
[production] |
| 05:32 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db2151: Reimage to Trixie |
[production] |
|
2026-04-17
§
|
| 08:51 |
<topranks> |
depool esams due to connectivity issues |
[production] |
| 08:51 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool esams [reason: no reason specified, no task ID specified] |
[production] |
| 08:51 |
<cmooney@cumin1003> |
START - Cookbook sre.dns.admin DNS admin: depool esams [reason: no reason specified, no task ID specified] |
[production] |
| 06:07 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1201: Reimage to Trixie |
[production] |
| 06:06 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db1201: Reimage to Trixie |
[production] |
| 05:13 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2158: Reimage to Trixie |
[production] |
| 05:13 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool db2158: Reimage to Trixie |
[production] |