|
2025-08-11
§
|
| 15:06 |
<klausman@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve2003.codfw.wmnet |
[production] |
| 14:36 |
<klausman@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve2003.codfw.wmnet |
[production] |
| 14:36 |
<klausman@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve2003.codfw.wmnet |
[production] |
| 14:35 |
<klausman@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve2002.codfw.wmnet |
[production] |
| 14:35 |
<klausman@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve2002.codfw.wmnet |
[production] |
| 14:20 |
<klausman@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve2002.codfw.wmnet |
[production] |
| 14:20 |
<klausman@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve2002.codfw.wmnet |
[production] |
| 14:20 |
<klausman@cumin1003> |
END (ERROR) - Cookbook sre.k8s.pool-depool-node (exit_code=97) depool for host ml-serve2002.codfw.wmnet |
[production] |
| 14:10 |
<klausman@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve2002.codfw.wmnet |
[production] |
| 14:08 |
<klausman@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve2001.codfw.wmnet |
[production] |
| 14:08 |
<klausman@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve2001.codfw.wmnet |
[production] |
| 13:53 |
<klausman@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve2001.codfw.wmnet |
[production] |
| 13:53 |
<klausman@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve2001.codfw.wmnet |
[production] |
|
2025-07-22
§
|
| 10:12 |
<cgoubert@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1243.eqiad.wmnet |
[production] |
| 10:12 |
<cgoubert@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1243.eqiad.wmnet |
[production] |
| 10:00 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db1253 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79566 and previous config saved to /var/cache/conftool/dbconfig/20250722-100040-marostegui.json |
[production] |
| 09:54 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db2208 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79565 and previous config saved to /var/cache/conftool/dbconfig/20250722-095402-marostegui.json |
[production] |
| 06:54 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool es2035 T399927', diff saved to https://phabricator.wikimedia.org/P79550 and previous config saved to /var/cache/conftool/dbconfig/20250722-065454-root.json |
[production] |
| 00:26 |
<bking@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on cirrussearch1081.eqiad.wmnet with reason: bad cluster node/MSS issue |
[production] |
|
2025-07-21
§
|
| 11:50 |
<XioNoX> |
depool ncredir7004 for ganeti7002 bird upgrade |
[production] |
| 11:30 |
<XioNoX> |
depool and move ncredir7003 to ganeti7003 |
[production] |
| 09:51 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db2182 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79503 and previous config saved to /var/cache/conftool/dbconfig/20250721-095112-marostegui.json |
[production] |
| 09:42 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db1194 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79499 and previous config saved to /var/cache/conftool/dbconfig/20250721-094221-marostegui.json |
[production] |
| 08:57 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db1191 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79491 and previous config saved to /var/cache/conftool/dbconfig/20250721-085719-marostegui.json |
[production] |
| 08:53 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db2168 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79490 and previous config saved to /var/cache/conftool/dbconfig/20250721-085333-marostegui.json |
[production] |
| 08:09 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db2209 T399930', diff saved to https://phabricator.wikimedia.org/P79479 and previous config saved to /var/cache/conftool/dbconfig/20250721-080951-marostegui.json |
[production] |
| 07:52 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db2159 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79472 and previous config saved to /var/cache/conftool/dbconfig/20250721-075256-marostegui.json |
[production] |
| 07:50 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db1174 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79470 and previous config saved to /var/cache/conftool/dbconfig/20250721-075025-marostegui.json |
[production] |
| 07:20 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool es1037', diff saved to https://phabricator.wikimedia.org/P79465 and previous config saved to /var/cache/conftool/dbconfig/20250721-072037-root.json |
[production] |
| 06:47 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool es1039', diff saved to https://phabricator.wikimedia.org/P79453 and previous config saved to /var/cache/conftool/dbconfig/20250721-064755-root.json |
[production] |
| 06:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db1170 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79447 and previous config saved to /var/cache/conftool/dbconfig/20250721-061606-marostegui.json |
[production] |
| 06:09 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db2150 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P79446 and previous config saved to /var/cache/conftool/dbconfig/20250721-060923-marostegui.json |
[production] |