|
2026-01-10
§
|
| 19:35 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1157 (T413525)', diff saved to https://phabricator.wikimedia.org/P87055 and previous config saved to /var/cache/conftool/dbconfig/20260110-193536-marostegui.json |
[production] |
| 19:34 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services |
[admin] |
| 19:29 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment codfw1dev for all services |
[admin] |
| 19:27 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services |
[admin] |
| 19:27 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2149 (T413525)', diff saved to https://phabricator.wikimedia.org/P87054 and previous config saved to /var/cache/conftool/dbconfig/20260110-192742-marostegui.json |
[production] |
| 19:27 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2149.codfw.wmnet with reason: Maintenance |
[production] |
| 19:20 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1157 (T413525)', diff saved to https://phabricator.wikimedia.org/P87053 and previous config saved to /var/cache/conftool/dbconfig/20260110-192058-marostegui.json |
[production] |
| 19:20 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1157.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:42 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1150.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:13 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1222.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:31 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2210 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87052 and previous config saved to /var/cache/conftool/dbconfig/20260110-113128-marostegui.json |
[production] |
| 11:31 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2210.codfw.wmnet with reason: Maintenance |
[production] |
| 11:31 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1241 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87051 and previous config saved to /var/cache/conftool/dbconfig/20260110-113110-marostegui.json |
[production] |
| 11:31 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2206 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87050 and previous config saved to /var/cache/conftool/dbconfig/20260110-113104-marostegui.json |
[production] |
| 11:31 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1241.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:30 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1238 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87049 and previous config saved to /var/cache/conftool/dbconfig/20260110-113045-marostegui.json |
[production] |
| 11:20 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2206', diff saved to https://phabricator.wikimedia.org/P87048 and previous config saved to /var/cache/conftool/dbconfig/20260110-112055-marostegui.json |
[production] |
| 11:20 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P87047 and previous config saved to /var/cache/conftool/dbconfig/20260110-112037-marostegui.json |
[production] |
| 11:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2206', diff saved to https://phabricator.wikimedia.org/P87046 and previous config saved to /var/cache/conftool/dbconfig/20260110-111047-marostegui.json |
[production] |
| 11:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P87045 and previous config saved to /var/cache/conftool/dbconfig/20260110-111028-marostegui.json |
[production] |
| 11:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2206 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87044 and previous config saved to /var/cache/conftool/dbconfig/20260110-110039-marostegui.json |
[production] |
| 11:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1238 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87043 and previous config saved to /var/cache/conftool/dbconfig/20260110-110020-marostegui.json |
[production] |
| 01:55 |
<zabe@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply |
[production] |
| 01:54 |
<zabe@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-experimental: apply |
[production] |
| 01:15 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1238 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87042 and previous config saved to /var/cache/conftool/dbconfig/20260110-011558-marostegui.json |
[production] |
| 01:15 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1238.eqiad.wmnet with reason: Maintenance |
[production] |
| 01:15 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1221 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87041 and previous config saved to /var/cache/conftool/dbconfig/20260110-011534-marostegui.json |
[production] |
| 01:13 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 13m 00s) |
[production] |
| 01:05 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P87040 and previous config saved to /var/cache/conftool/dbconfig/20260110-010525-marostegui.json |
[production] |
| 01:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 00:59 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2206 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87039 and previous config saved to /var/cache/conftool/dbconfig/20260110-005937-marostegui.json |
[production] |
| 00:59 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2206.codfw.wmnet with reason: Maintenance |
[production] |
| 00:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P87038 and previous config saved to /var/cache/conftool/dbconfig/20260110-005517-marostegui.json |
[production] |
| 00:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1221 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87037 and previous config saved to /var/cache/conftool/dbconfig/20260110-004509-marostegui.json |
[production] |
| 00:25 |
<bd808> |
Unblock 91.160.0.0/12 (T414190) |
[releng] |
|
2026-01-09
§
|
| 21:57 |
<wmbot~urbanecm@tools-bastion-15> |
Deploy 02d1ed7 |
[tools.stewardbots-legacy] |
| 21:28 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:28 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259 (T413525)', diff saved to https://phabricator.wikimedia.org/P87035 and previous config saved to /var/cache/conftool/dbconfig/20260109-212830-marostegui.json |
[production] |
| 21:18 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to https://phabricator.wikimedia.org/P87034 and previous config saved to /var/cache/conftool/dbconfig/20260109-211822-marostegui.json |
[production] |
| 21:08 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to https://phabricator.wikimedia.org/P87033 and previous config saved to /var/cache/conftool/dbconfig/20260109-210813-marostegui.json |
[production] |
| 20:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259 (T413525)', diff saved to https://phabricator.wikimedia.org/P87032 and previous config saved to /var/cache/conftool/dbconfig/20260109-205805-marostegui.json |
[production] |
| 20:28 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1259 (T413525)', diff saved to https://phabricator.wikimedia.org/P87031 and previous config saved to /var/cache/conftool/dbconfig/20260109-202821-marostegui.json |
[production] |
| 20:28 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1259.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:27 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1254 (T413525)', diff saved to https://phabricator.wikimedia.org/P87030 and previous config saved to /var/cache/conftool/dbconfig/20260109-202756-marostegui.json |
[production] |
| 20:23 |
<jhathaway@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on wdqs1029.eqiad.wmnet with reason: T412451 |
[production] |
| 20:21 |
<andrew@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcontrol1008-dev.eqiad.wmnet with OS trixie |
[production] |
| 20:19 |
<jhathaway@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1029.eqiad.wmnet with OS trixie |
[production] |
| 20:17 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P87029 and previous config saved to /var/cache/conftool/dbconfig/20260109-201748-marostegui.json |
[production] |
| 20:07 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P87028 and previous config saved to /var/cache/conftool/dbconfig/20260109-200739-marostegui.json |
[production] |
| 20:02 |
<andrew@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcontrol1008-dev.eqiad.wmnet with reason: host reimage |
[production] |