|
2026-01-19
§
|
| 07:44 |
<bwojtowicz@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-descriptions' for release 'main' . |
[production] |
| 06:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2176 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87736 and previous config saved to /var/cache/conftool/dbconfig/20260119-064555-marostegui.json |
[production] |
| 06:45 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2176.codfw.wmnet with reason: Maintenance |
[production] |
| 06:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2174 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87735 and previous config saved to /var/cache/conftool/dbconfig/20260119-064531-marostegui.json |
[production] |
| 06:35 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P87734 and previous config saved to /var/cache/conftool/dbconfig/20260119-063522-marostegui.json |
[production] |
| 06:29 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2248 (T413525)', diff saved to https://phabricator.wikimedia.org/P87733 and previous config saved to /var/cache/conftool/dbconfig/20260119-062926-marostegui.json |
[production] |
| 06:29 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2248.codfw.wmnet with reason: Maintenance |
[production] |
| 06:28 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1262 (T413525)', diff saved to https://phabricator.wikimedia.org/P87732 and previous config saved to /var/cache/conftool/dbconfig/20260119-062813-marostegui.json |
[production] |
| 06:28 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1262.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:25 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P87731 and previous config saved to /var/cache/conftool/dbconfig/20260119-062514-marostegui.json |
[production] |
| 06:15 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2174 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87730 and previous config saved to /var/cache/conftool/dbconfig/20260119-061506-marostegui.json |
[production] |
| 05:33 |
<eileen> |
civicrm upgraded from fbd59466 to 9cdb1915 |
[production] |
| 04:22 |
<eileen> |
civicrm upgraded from 8a0e4548 to fbd59466 |
[production] |
| 03:38 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1206 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87729 and previous config saved to /var/cache/conftool/dbconfig/20260119-033806-marostegui.json |
[production] |
| 03:37 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1206.eqiad.wmnet with reason: Maintenance |
[production] |
| 03:37 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1196 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87728 and previous config saved to /var/cache/conftool/dbconfig/20260119-033742-marostegui.json |
[production] |
| 03:27 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1196', diff saved to https://phabricator.wikimedia.org/P87727 and previous config saved to /var/cache/conftool/dbconfig/20260119-032733-marostegui.json |
[production] |
| 03:17 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1196', diff saved to https://phabricator.wikimedia.org/P87726 and previous config saved to /var/cache/conftool/dbconfig/20260119-031725-marostegui.json |
[production] |
| 03:07 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1196 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87725 and previous config saved to /var/cache/conftool/dbconfig/20260119-030716-marostegui.json |
[production] |
| 01:14 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 13m 28s) |
[production] |
| 01:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2026-01-18
§
|
| 17:06 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2174 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87724 and previous config saved to /var/cache/conftool/dbconfig/20260118-170604-marostegui.json |
[production] |
| 17:05 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2174.codfw.wmnet with reason: Maintenance |
[production] |
| 17:05 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2173 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87723 and previous config saved to /var/cache/conftool/dbconfig/20260118-170540-marostegui.json |
[production] |
| 16:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2173', diff saved to https://phabricator.wikimedia.org/P87722 and previous config saved to /var/cache/conftool/dbconfig/20260118-165531-marostegui.json |
[production] |
| 16:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2173', diff saved to https://phabricator.wikimedia.org/P87721 and previous config saved to /var/cache/conftool/dbconfig/20260118-164523-marostegui.json |
[production] |
| 16:35 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2173 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87720 and previous config saved to /var/cache/conftool/dbconfig/20260118-163514-marostegui.json |
[production] |
| 15:51 |
<sukhe> |
downtime cp5022 as host is down: T414411 |
[production] |
| 15:51 |
<sukhe@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on cp5022.eqsin.wmnet with reason: host down |
[production] |
| 12:59 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1196 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87719 and previous config saved to /var/cache/conftool/dbconfig/20260118-125913-marostegui.json |
[production] |
| 12:59 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance |
[production] |
| 12:58 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1196.eqiad.wmnet with reason: Maintenance |
[production] |
| 12:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1195 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87718 and previous config saved to /var/cache/conftool/dbconfig/20260118-125829-marostegui.json |
[production] |
| 12:48 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1195', diff saved to https://phabricator.wikimedia.org/P87717 and previous config saved to /var/cache/conftool/dbconfig/20260118-124820-marostegui.json |
[production] |
| 12:38 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1195', diff saved to https://phabricator.wikimedia.org/P87716 and previous config saved to /var/cache/conftool/dbconfig/20260118-123812-marostegui.json |
[production] |
| 12:28 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1195 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87715 and previous config saved to /var/cache/conftool/dbconfig/20260118-122804-marostegui.json |
[production] |
| 08:05 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance |
[production] |
| 08:05 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1263 (T413525)', diff saved to https://phabricator.wikimedia.org/P87714 and previous config saved to /var/cache/conftool/dbconfig/20260118-080510-marostegui.json |
[production] |
| 07:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1263', diff saved to https://phabricator.wikimedia.org/P87713 and previous config saved to /var/cache/conftool/dbconfig/20260118-075502-marostegui.json |
[production] |
| 07:44 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1263', diff saved to https://phabricator.wikimedia.org/P87712 and previous config saved to /var/cache/conftool/dbconfig/20260118-074453-marostegui.json |
[production] |
| 07:34 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1263 (T413525)', diff saved to https://phabricator.wikimedia.org/P87711 and previous config saved to /var/cache/conftool/dbconfig/20260118-073445-marostegui.json |
[production] |
| 03:42 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1263 (T413525)', diff saved to https://phabricator.wikimedia.org/P87710 and previous config saved to /var/cache/conftool/dbconfig/20260118-034228-marostegui.json |
[production] |
| 03:42 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1263.eqiad.wmnet with reason: Maintenance |
[production] |
| 03:42 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1261 (T413525)', diff saved to https://phabricator.wikimedia.org/P87709 and previous config saved to /var/cache/conftool/dbconfig/20260118-034214-marostegui.json |
[production] |
| 03:32 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1261', diff saved to https://phabricator.wikimedia.org/P87708 and previous config saved to /var/cache/conftool/dbconfig/20260118-033205-marostegui.json |
[production] |
| 03:21 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1261', diff saved to https://phabricator.wikimedia.org/P87707 and previous config saved to /var/cache/conftool/dbconfig/20260118-032157-marostegui.json |
[production] |
| 03:11 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1261 (T413525)', diff saved to https://phabricator.wikimedia.org/P87706 and previous config saved to /var/cache/conftool/dbconfig/20260118-031149-marostegui.json |
[production] |
| 02:47 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2173 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87705 and previous config saved to /var/cache/conftool/dbconfig/20260118-024705-marostegui.json |
[production] |
| 02:46 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2173.codfw.wmnet with reason: Maintenance |
[production] |
| 02:46 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2170 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87704 and previous config saved to /var/cache/conftool/dbconfig/20260118-024640-marostegui.json |
[production] |