|
2026-06-24
§
|
| 07:50 |
<cwilliams@cumin1003> |
START - Cookbook sre.mysql.depool depool db1199: Upgrading db1199.eqiad.wmnet |
[production] |
| 07:11 |
<jmm@cumin2003> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet |
[production] |
| 07:09 |
<jmm@cumin2003> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2028.codfw.wmnet |
[production] |
| 07:08 |
<jmm@cumin2003> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet |
[production] |
| 06:54 |
<jmm@cumin2003> |
END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2046.codfw.wmnet |
[production] |
| 06:54 |
<jmm@cumin2003> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2046.codfw.wmnet |
[production] |
| 06:54 |
<jmm@cumin2003> |
END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2028.codfw.wmnet |
[production] |
| 06:53 |
<jmm@cumin2003> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet |
[production] |
| 05:56 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1035: Upgrading es1035.eqiad.wmnet |
[production] |
| 05:55 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool es1035: Upgrading es1035.eqiad.wmnet |
[production] |
| 05:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depool es1035 T429867', diff saved to https://phabricator.wikimedia.org/P94395 and previous config saved to /var/cache/conftool/dbconfig/20260624-054547-marostegui.json |
[production] |
|
2026-06-23
§
|
| 15:18 |
<cwilliams@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2172: Upgrading db2172.codfw.wmnet |
[production] |
| 15:17 |
<cwilliams@cumin1003> |
START - Cookbook sre.mysql.depool depool db2172: Upgrading db2172.codfw.wmnet |
[production] |
| 14:35 |
<cwilliams@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1190: Upgrading db1190.eqiad.wmnet |
[production] |
| 14:34 |
<cwilliams@cumin1003> |
START - Cookbook sre.mysql.depool depool db1190: Upgrading db1190.eqiad.wmnet |
[production] |
| 12:55 |
<cwilliams@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2155: Upgrading db2155.codfw.wmnet |
[production] |
| 12:55 |
<cwilliams@cumin1003> |
START - Cookbook sre.mysql.depool depool db2155: Upgrading db2155.codfw.wmnet |
[production] |
| 12:49 |
<cwilliams@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1160: Upgrading db1160.eqiad.wmnet |
[production] |
| 12:49 |
<cwilliams@cumin1003> |
START - Cookbook sre.mysql.depool depool db1160: Upgrading db1160.eqiad.wmnet |
[production] |
| 12:22 |
<klausman@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging-ctrl2002.codfw.wmnet |
[production] |
| 12:22 |
<klausman@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging-ctrl2002.codfw.wmnet |
[production] |
| 12:18 |
<klausman@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging-ctrl2002.codfw.wmnet |
[production] |
| 12:18 |
<klausman@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging-ctrl2002.codfw.wmnet |
[production] |
| 12:18 |
<klausman@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging-ctrl2001.codfw.wmnet |
[production] |
| 12:18 |
<klausman@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging-ctrl2001.codfw.wmnet |
[production] |
| 12:15 |
<klausman@cumin2002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging-ctrl2001.codfw.wmnet |
[production] |
| 12:15 |
<klausman@cumin2002> |
START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging-ctrl2001.codfw.wmnet |
[production] |
| 08:33 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1018: Maintenance on pc8 |
[production] |
| 08:33 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc1018: Maintenance on pc8 |
[production] |
| 07:34 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1018: Maintenance on pc2 |
[production] |
| 07:34 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc1018: Maintenance on pc2 |
[production] |
| 06:32 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1018: Reimage to Trixie |
[production] |
| 06:32 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc1018: Reimage to Trixie |
[production] |
| 06:14 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depool db1201 T429868', diff saved to https://phabricator.wikimedia.org/P94338 and previous config saved to /var/cache/conftool/dbconfig/20260623-061416-fceratto.json |
[production] |
| 05:41 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc2018: Reimage to Trixie |
[production] |
| 05:41 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc2018: Reimage to Trixie |
[production] |
| 05:12 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2038: Upgrading es2038.codfw.wmnet |
[production] |
| 05:12 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool es2038: Upgrading es2038.codfw.wmnet |
[production] |
| 05:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depool es2038 T429794', diff saved to https://phabricator.wikimedia.org/P94332 and previous config saved to /var/cache/conftool/dbconfig/20260623-051012-marostegui.json |
[production] |
|
2026-06-22
§
|
| 13:25 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1039: Upgrading es1039.eqiad.wmnet |
[production] |
| 13:25 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool es1039: Upgrading es1039.eqiad.wmnet |
[production] |
| 11:02 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1040: Upgrading es1040.eqiad.wmnet |
[production] |
| 10:59 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool es1040: Upgrading es1040.eqiad.wmnet |
[production] |
| 09:09 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1017: Reimage to Trixie |
[production] |
| 09:09 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc1017: Reimage to Trixie |
[production] |
| 08:21 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc2017: Reimage to Trixie |
[production] |
| 08:21 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc2017: Reimage to Trixie |
[production] |
| 08:15 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1048: Upgrading es1048.eqiad.wmnet |
[production] |
| 08:12 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc2017: pc7 migration to debian trixie |
[production] |
| 08:12 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc2017: pc7 migration to debian trixie |
[production] |