|
2026-01-10
§
|
| 20:27 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2149', diff saved to https://phabricator.wikimedia.org/P87062 and previous config saved to /var/cache/conftool/dbconfig/20260110-202722-marostegui.json |
[production] |
| 20:21 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1166 (T413525)', diff saved to https://phabricator.wikimedia.org/P87061 and previous config saved to /var/cache/conftool/dbconfig/20260110-202138-marostegui.json |
[production] |
| 20:17 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2149 (T413525)', diff saved to https://phabricator.wikimedia.org/P87060 and previous config saved to /var/cache/conftool/dbconfig/20260110-201714-marostegui.json |
[production] |
| 20:06 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1166 (T413525)', diff saved to https://phabricator.wikimedia.org/P87059 and previous config saved to /var/cache/conftool/dbconfig/20260110-200615-marostegui.json |
[production] |
| 20:06 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1166.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:06 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1157 (T413525)', diff saved to https://phabricator.wikimedia.org/P87058 and previous config saved to /var/cache/conftool/dbconfig/20260110-200601-marostegui.json |
[production] |
| 19:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P87057 and previous config saved to /var/cache/conftool/dbconfig/20260110-195553-marostegui.json |
[production] |
| 19:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P87056 and previous config saved to /var/cache/conftool/dbconfig/20260110-194544-marostegui.json |
[production] |
| 19:37 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for all services |
[admin] |
| 19:35 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1157 (T413525)', diff saved to https://phabricator.wikimedia.org/P87055 and previous config saved to /var/cache/conftool/dbconfig/20260110-193536-marostegui.json |
[production] |
| 19:34 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services |
[admin] |
| 19:29 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment codfw1dev for all services |
[admin] |
| 19:27 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services |
[admin] |
| 19:27 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2149 (T413525)', diff saved to https://phabricator.wikimedia.org/P87054 and previous config saved to /var/cache/conftool/dbconfig/20260110-192742-marostegui.json |
[production] |
| 19:27 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2149.codfw.wmnet with reason: Maintenance |
[production] |
| 19:20 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1157 (T413525)', diff saved to https://phabricator.wikimedia.org/P87053 and previous config saved to /var/cache/conftool/dbconfig/20260110-192058-marostegui.json |
[production] |
| 19:20 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1157.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:42 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1150.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:13 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1222.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:31 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2210 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87052 and previous config saved to /var/cache/conftool/dbconfig/20260110-113128-marostegui.json |
[production] |
| 11:31 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2210.codfw.wmnet with reason: Maintenance |
[production] |
| 11:31 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1241 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87051 and previous config saved to /var/cache/conftool/dbconfig/20260110-113110-marostegui.json |
[production] |
| 11:31 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2206 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87050 and previous config saved to /var/cache/conftool/dbconfig/20260110-113104-marostegui.json |
[production] |
| 11:31 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1241.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:30 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1238 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87049 and previous config saved to /var/cache/conftool/dbconfig/20260110-113045-marostegui.json |
[production] |
| 11:20 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2206', diff saved to https://phabricator.wikimedia.org/P87048 and previous config saved to /var/cache/conftool/dbconfig/20260110-112055-marostegui.json |
[production] |
| 11:20 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P87047 and previous config saved to /var/cache/conftool/dbconfig/20260110-112037-marostegui.json |
[production] |
| 11:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2206', diff saved to https://phabricator.wikimedia.org/P87046 and previous config saved to /var/cache/conftool/dbconfig/20260110-111047-marostegui.json |
[production] |
| 11:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P87045 and previous config saved to /var/cache/conftool/dbconfig/20260110-111028-marostegui.json |
[production] |
| 11:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2206 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87044 and previous config saved to /var/cache/conftool/dbconfig/20260110-110039-marostegui.json |
[production] |
| 11:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1238 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87043 and previous config saved to /var/cache/conftool/dbconfig/20260110-110020-marostegui.json |
[production] |
| 01:55 |
<zabe@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply |
[production] |
| 01:54 |
<zabe@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-experimental: apply |
[production] |
| 01:15 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1238 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87042 and previous config saved to /var/cache/conftool/dbconfig/20260110-011558-marostegui.json |
[production] |
| 01:15 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1238.eqiad.wmnet with reason: Maintenance |
[production] |
| 01:15 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1221 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87041 and previous config saved to /var/cache/conftool/dbconfig/20260110-011534-marostegui.json |
[production] |
| 01:13 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 13m 00s) |
[production] |
| 01:05 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P87040 and previous config saved to /var/cache/conftool/dbconfig/20260110-010525-marostegui.json |
[production] |
| 01:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 00:59 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2206 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87039 and previous config saved to /var/cache/conftool/dbconfig/20260110-005937-marostegui.json |
[production] |
| 00:59 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2206.codfw.wmnet with reason: Maintenance |
[production] |
| 00:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P87038 and previous config saved to /var/cache/conftool/dbconfig/20260110-005517-marostegui.json |
[production] |
| 00:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1221 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87037 and previous config saved to /var/cache/conftool/dbconfig/20260110-004509-marostegui.json |
[production] |
| 00:25 |
<bd808> |
Unblock 91.160.0.0/12 (T414190) |
[releng] |