|
2026-01-08
ยง
|
| 11:16 |
<cgoubert@deploy2002> |
helmfile [codfw] START helmfile.d/services/rest-gateway: apply |
[production] |
| 11:15 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2158 (T413525)', diff saved to https://phabricator.wikimedia.org/P86816 and previous config saved to /var/cache/conftool/dbconfig/20260108-111537-marostegui.json |
[production] |
| 11:10 |
<cgoubert@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply |
[production] |
| 11:10 |
<cgoubert@deploy2002> |
helmfile [eqiad] START helmfile.d/services/rest-gateway: apply |
[production] |
| 10:57 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2158 (T413525)', diff saved to https://phabricator.wikimedia.org/P86815 and previous config saved to /var/cache/conftool/dbconfig/20260108-105703-marostegui.json |
[production] |
| 10:56 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2158.codfw.wmnet with reason: Maintenance |
[production] |
| 10:56 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2151 (T413525)', diff saved to https://phabricator.wikimedia.org/P86814 and previous config saved to /var/cache/conftool/dbconfig/20260108-105639-marostegui.json |
[production] |
| 10:46 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2151', diff saved to https://phabricator.wikimedia.org/P86812 and previous config saved to /var/cache/conftool/dbconfig/20260108-104630-marostegui.json |
[production] |
| 10:39 |
<cgoubert@deploy2002> |
helmfile [staging] DONE helmfile.d/services/rest-gateway: apply |
[production] |
| 10:39 |
<cgoubert@deploy2002> |
helmfile [staging] START helmfile.d/services/rest-gateway: apply |
[production] |
| 10:36 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2151', diff saved to https://phabricator.wikimedia.org/P86811 and previous config saved to /var/cache/conftool/dbconfig/20260108-103622-marostegui.json |
[production] |
| 10:35 |
<mutante> |
wikitech wiki - made lsobanski an admin - T414065 |
[production] |
| 10:26 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2151 (T413525)', diff saved to https://phabricator.wikimedia.org/P86810 and previous config saved to /var/cache/conftool/dbconfig/20260108-102613-marostegui.json |
[production] |
| 10:23 |
<btullis@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply |
[production] |
| 10:13 |
<btullis@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply |
[production] |
| 10:07 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2151 (T413525)', diff saved to https://phabricator.wikimedia.org/P86809 and previous config saved to /var/cache/conftool/dbconfig/20260108-100757-marostegui.json |
[production] |
| 10:07 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2151.codfw.wmnet with reason: Maintenance |
[production] |
| 09:59 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1201.eqiad.wmnet with reason: Maintenance |
[production] |
| 09:46 |
<claime> |
Rebuilding ratelimit image - T414002 |
[production] |
| 09:38 |
<jelto@cumin1003> |
END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab |
[production] |
| 09:31 |
<XioNoX> |
remove pybal BGP group on pfw1-codfw (replaced with Bird) - T414015 |
[production] |
| 09:08 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1225.eqiad.wmnet with reason: Maintenance |
[production] |
| 09:08 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187 (T413525)', diff saved to https://phabricator.wikimedia.org/P86808 and previous config saved to /var/cache/conftool/dbconfig/20260108-090759-marostegui.json |
[production] |
| 08:57 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P86807 and previous config saved to /var/cache/conftool/dbconfig/20260108-085751-marostegui.json |
[production] |
| 08:47 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P86806 and previous config saved to /var/cache/conftool/dbconfig/20260108-084742-marostegui.json |
[production] |
| 08:37 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187 (T413525)', diff saved to https://phabricator.wikimedia.org/P86805 and previous config saved to /var/cache/conftool/dbconfig/20260108-083734-marostegui.json |
[production] |
| 08:30 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1187 (T413525)', diff saved to https://phabricator.wikimedia.org/P86804 and previous config saved to /var/cache/conftool/dbconfig/20260108-083026-marostegui.json |
[production] |
| 08:30 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1187.eqiad.wmnet with reason: Maintenance |
[production] |
| 08:30 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180 (T413525)', diff saved to https://phabricator.wikimedia.org/P86803 and previous config saved to /var/cache/conftool/dbconfig/20260108-083001-marostegui.json |
[production] |
| 08:20 |
<jelto@cumin1003> |
START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab |
[production] |
| 08:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P86802 and previous config saved to /var/cache/conftool/dbconfig/20260108-081953-marostegui.json |
[production] |
| 08:16 |
<jelto@cumin1003> |
END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 08:09 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P86801 and previous config saved to /var/cache/conftool/dbconfig/20260108-080945-marostegui.json |
[production] |
| 08:07 |
<jelto@cumin1003> |
START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 08:05 |
<jelto@cumin1003> |
END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 07:59 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180 (T413525)', diff saved to https://phabricator.wikimedia.org/P86800 and previous config saved to /var/cache/conftool/dbconfig/20260108-075937-marostegui.json |
[production] |
| 07:55 |
<jelto@cumin1003> |
START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 07:52 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1180 (T413525)', diff saved to https://phabricator.wikimedia.org/P86799 and previous config saved to /var/cache/conftool/dbconfig/20260108-075220-marostegui.json |
[production] |
| 07:52 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1180.eqiad.wmnet with reason: Maintenance |
[production] |
| 07:51 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173 (T413525)', diff saved to https://phabricator.wikimedia.org/P86798 and previous config saved to /var/cache/conftool/dbconfig/20260108-075155-marostegui.json |
[production] |
| 07:41 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173', diff saved to https://phabricator.wikimedia.org/P86797 and previous config saved to /var/cache/conftool/dbconfig/20260108-074147-marostegui.json |
[production] |
| 07:31 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173', diff saved to https://phabricator.wikimedia.org/P86796 and previous config saved to /var/cache/conftool/dbconfig/20260108-073139-marostegui.json |
[production] |
| 07:21 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173 (T413525)', diff saved to https://phabricator.wikimedia.org/P86795 and previous config saved to /var/cache/conftool/dbconfig/20260108-072130-marostegui.json |
[production] |
| 07:14 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1173 (T413525)', diff saved to https://phabricator.wikimedia.org/P86794 and previous config saved to /var/cache/conftool/dbconfig/20260108-071413-marostegui.json |
[production] |
| 07:14 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1173.eqiad.wmnet with reason: Maintenance |
[production] |
| 07:14 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168 (T413525)', diff saved to https://phabricator.wikimedia.org/P86793 and previous config saved to /var/cache/conftool/dbconfig/20260108-071359-marostegui.json |
[production] |
| 07:03 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P86792 and previous config saved to /var/cache/conftool/dbconfig/20260108-070351-marostegui.json |
[production] |
| 06:53 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P86791 and previous config saved to /var/cache/conftool/dbconfig/20260108-065342-marostegui.json |
[production] |
| 06:43 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168 (T413525)', diff saved to https://phabricator.wikimedia.org/P86790 and previous config saved to /var/cache/conftool/dbconfig/20260108-064333-marostegui.json |
[production] |
| 06:36 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1168 (T413525)', diff saved to https://phabricator.wikimedia.org/P86789 and previous config saved to /var/cache/conftool/dbconfig/20260108-063642-marostegui.json |
[production] |