|
2026-01-08
ยง
|
| 08:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P86802 and previous config saved to /var/cache/conftool/dbconfig/20260108-081953-marostegui.json |
[production] |
| 08:16 |
<jelto@cumin1003> |
END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 08:09 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P86801 and previous config saved to /var/cache/conftool/dbconfig/20260108-080945-marostegui.json |
[production] |
| 08:07 |
<jelto@cumin1003> |
START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 08:05 |
<jelto@cumin1003> |
END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 07:59 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180 (T413525)', diff saved to https://phabricator.wikimedia.org/P86800 and previous config saved to /var/cache/conftool/dbconfig/20260108-075937-marostegui.json |
[production] |
| 07:55 |
<jelto@cumin1003> |
START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 07:52 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1180 (T413525)', diff saved to https://phabricator.wikimedia.org/P86799 and previous config saved to /var/cache/conftool/dbconfig/20260108-075220-marostegui.json |
[production] |
| 07:52 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1180.eqiad.wmnet with reason: Maintenance |
[production] |
| 07:51 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173 (T413525)', diff saved to https://phabricator.wikimedia.org/P86798 and previous config saved to /var/cache/conftool/dbconfig/20260108-075155-marostegui.json |
[production] |
| 07:41 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173', diff saved to https://phabricator.wikimedia.org/P86797 and previous config saved to /var/cache/conftool/dbconfig/20260108-074147-marostegui.json |
[production] |
| 07:31 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173', diff saved to https://phabricator.wikimedia.org/P86796 and previous config saved to /var/cache/conftool/dbconfig/20260108-073139-marostegui.json |
[production] |
| 07:21 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173 (T413525)', diff saved to https://phabricator.wikimedia.org/P86795 and previous config saved to /var/cache/conftool/dbconfig/20260108-072130-marostegui.json |
[production] |
| 07:14 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1173 (T413525)', diff saved to https://phabricator.wikimedia.org/P86794 and previous config saved to /var/cache/conftool/dbconfig/20260108-071413-marostegui.json |
[production] |
| 07:14 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1173.eqiad.wmnet with reason: Maintenance |
[production] |
| 07:14 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168 (T413525)', diff saved to https://phabricator.wikimedia.org/P86793 and previous config saved to /var/cache/conftool/dbconfig/20260108-071359-marostegui.json |
[production] |
| 07:03 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P86792 and previous config saved to /var/cache/conftool/dbconfig/20260108-070351-marostegui.json |
[production] |
| 06:53 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P86791 and previous config saved to /var/cache/conftool/dbconfig/20260108-065342-marostegui.json |
[production] |
| 06:43 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168 (T413525)', diff saved to https://phabricator.wikimedia.org/P86790 and previous config saved to /var/cache/conftool/dbconfig/20260108-064333-marostegui.json |
[production] |
| 06:36 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1168 (T413525)', diff saved to https://phabricator.wikimedia.org/P86789 and previous config saved to /var/cache/conftool/dbconfig/20260108-063642-marostegui.json |
[production] |
| 06:36 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:36 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1165 (T413525)', diff saved to https://phabricator.wikimedia.org/P86788 and previous config saved to /var/cache/conftool/dbconfig/20260108-063616-marostegui.json |
[production] |
| 06:26 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P86787 and previous config saved to /var/cache/conftool/dbconfig/20260108-062608-marostegui.json |
[production] |
| 06:16 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P86786 and previous config saved to /var/cache/conftool/dbconfig/20260108-061600-marostegui.json |
[production] |
| 06:05 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1165 (T413525)', diff saved to https://phabricator.wikimedia.org/P86785 and previous config saved to /var/cache/conftool/dbconfig/20260108-060551-marostegui.json |
[production] |
| 06:05 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newpool (exit_code=0) pool db2144: test |
[production] |
| 06:05 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 06:05 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 06:05 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newpool pool db2144: test |
[production] |
| 06:05 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newdepool (exit_code=0) depool db2144: test |
[production] |
| 06:05 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 06:05 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 06:05 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newdepool depool db2144: test |
[production] |
| 06:04 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newpool (exit_code=0) pool pc1013: test |
[production] |
| 06:04 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 06:03 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 06:03 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newpool pool pc1013: test |
[production] |
| 06:02 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newdepool (exit_code=0) depool pc1013: test |
[production] |
| 06:02 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 06:02 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 06:02 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newdepool depool pc1013: test |
[production] |
| 05:59 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1165 (T413525)', diff saved to https://phabricator.wikimedia.org/P86780 and previous config saved to /var/cache/conftool/dbconfig/20260108-055901-marostegui.json |
[production] |
| 05:58 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance |
[production] |
| 05:58 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1165.eqiad.wmnet with reason: Maintenance |
[production] |
| 05:51 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db2231 - Depool db2231.codfw.wmnet to then clone it to db2249.codfw.wmnet - marostegui@cumin1003 |
[production] |
| 05:51 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool db2231 - Depool db2231.codfw.wmnet to then clone it to db2249.codfw.wmnet - marostegui@cumin1003 |
[production] |
| 05:51 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.clone of db2231.codfw.wmnet onto db2249.codfw.wmnet |
[production] |
| 05:34 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2147 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86778 and previous config saved to /var/cache/conftool/dbconfig/20260108-053449-marostegui.json |
[production] |
| 05:34 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2147.codfw.wmnet with reason: Maintenance |
[production] |
| 05:34 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1150.eqiad.wmnet with reason: Maintenance |
[production] |