2025-08-28
§
|
05:36 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2151 (T402925)', diff saved to https://phabricator.wikimedia.org/P81957 and previous config saved to /var/cache/conftool/dbconfig/20250828-053605-ladsgroup.json |
[production] |
05:18 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db2151 (T402925)', diff saved to https://phabricator.wikimedia.org/P81956 and previous config saved to /var/cache/conftool/dbconfig/20250828-051805-ladsgroup.json |
[production] |
05:17 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2151.codfw.wmnet with reason: Maintenance |
[production] |
05:01 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance |
[production] |
05:01 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1231 (T402925)', diff saved to https://phabricator.wikimedia.org/P81955 and previous config saved to /var/cache/conftool/dbconfig/20250828-050117-ladsgroup.json |
[production] |
04:46 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1231', diff saved to https://phabricator.wikimedia.org/P81954 and previous config saved to /var/cache/conftool/dbconfig/20250828-044610-ladsgroup.json |
[production] |
04:31 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1231', diff saved to https://phabricator.wikimedia.org/P81953 and previous config saved to /var/cache/conftool/dbconfig/20250828-043102-ladsgroup.json |
[production] |
04:15 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1231 (T402925)', diff saved to https://phabricator.wikimedia.org/P81952 and previous config saved to /var/cache/conftool/dbconfig/20250828-041555-ladsgroup.json |
[production] |
04:13 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1231 (T402925)', diff saved to https://phabricator.wikimedia.org/P81951 and previous config saved to /var/cache/conftool/dbconfig/20250828-041345-ladsgroup.json |
[production] |
04:13 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1231.eqiad.wmnet with reason: Maintenance |
[production] |
03:56 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1225.eqiad.wmnet with reason: Maintenance |
[production] |
03:56 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187 (T402925)', diff saved to https://phabricator.wikimedia.org/P81950 and previous config saved to /var/cache/conftool/dbconfig/20250828-035653-ladsgroup.json |
[production] |
03:41 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P81949 and previous config saved to /var/cache/conftool/dbconfig/20250828-034146-ladsgroup.json |
[production] |
03:26 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P81948 and previous config saved to /var/cache/conftool/dbconfig/20250828-032638-ladsgroup.json |
[production] |
03:11 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1187 (T402925)', diff saved to https://phabricator.wikimedia.org/P81947 and previous config saved to /var/cache/conftool/dbconfig/20250828-031131-ladsgroup.json |
[production] |
03:10 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1187 (T402925)', diff saved to https://phabricator.wikimedia.org/P81946 and previous config saved to /var/cache/conftool/dbconfig/20250828-031022-ladsgroup.json |
[production] |
03:10 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1187.eqiad.wmnet with reason: Maintenance |
[production] |
03:09 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180 (T402925)', diff saved to https://phabricator.wikimedia.org/P81945 and previous config saved to /var/cache/conftool/dbconfig/20250828-030959-ladsgroup.json |
[production] |
02:54 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P81944 and previous config saved to /var/cache/conftool/dbconfig/20250828-025451-ladsgroup.json |
[production] |
02:39 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P81943 and previous config saved to /var/cache/conftool/dbconfig/20250828-023944-ladsgroup.json |
[production] |
02:24 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1180 (T402925)', diff saved to https://phabricator.wikimedia.org/P81942 and previous config saved to /var/cache/conftool/dbconfig/20250828-022436-ladsgroup.json |
[production] |
02:23 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1180 (T402925)', diff saved to https://phabricator.wikimedia.org/P81941 and previous config saved to /var/cache/conftool/dbconfig/20250828-022326-ladsgroup.json |
[production] |
02:23 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1180.eqiad.wmnet with reason: Maintenance |
[production] |
02:23 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173 (T402925)', diff saved to https://phabricator.wikimedia.org/P81940 and previous config saved to /var/cache/conftool/dbconfig/20250828-022304-ladsgroup.json |
[production] |
02:07 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173', diff saved to https://phabricator.wikimedia.org/P81939 and previous config saved to /var/cache/conftool/dbconfig/20250828-020756-ladsgroup.json |
[production] |
01:52 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173', diff saved to https://phabricator.wikimedia.org/P81938 and previous config saved to /var/cache/conftool/dbconfig/20250828-015249-ladsgroup.json |
[production] |
01:37 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1173 (T402925)', diff saved to https://phabricator.wikimedia.org/P81937 and previous config saved to /var/cache/conftool/dbconfig/20250828-013741-ladsgroup.json |
[production] |
01:34 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1173 (T402925)', diff saved to https://phabricator.wikimedia.org/P81936 and previous config saved to /var/cache/conftool/dbconfig/20250828-013431-ladsgroup.json |
[production] |
01:34 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1173.eqiad.wmnet with reason: Maintenance |
[production] |
01:34 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168 (T402925)', diff saved to https://phabricator.wikimedia.org/P81935 and previous config saved to /var/cache/conftool/dbconfig/20250828-013408-ladsgroup.json |
[production] |
01:19 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P81934 and previous config saved to /var/cache/conftool/dbconfig/20250828-011900-ladsgroup.json |
[production] |
01:12 |
<mwpresync@deploy1003> |
Finished scap build-images: Publishing wmf/next image (duration: 11m 43s) |
[production] |
01:03 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P81933 and previous config saved to /var/cache/conftool/dbconfig/20250828-010353-ladsgroup.json |
[production] |
01:00 |
<mwpresync@deploy1003> |
Started scap build-images: Publishing wmf/next image |
[production] |
00:48 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1168 (T402925)', diff saved to https://phabricator.wikimedia.org/P81932 and previous config saved to /var/cache/conftool/dbconfig/20250828-004845-ladsgroup.json |
[production] |
00:45 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1168 (T402925)', diff saved to https://phabricator.wikimedia.org/P81931 and previous config saved to /var/cache/conftool/dbconfig/20250828-004536-ladsgroup.json |
[production] |
00:45 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1168.eqiad.wmnet with reason: Maintenance |
[production] |
00:45 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1165 (T402925)', diff saved to https://phabricator.wikimedia.org/P81930 and previous config saved to /var/cache/conftool/dbconfig/20250828-004513-ladsgroup.json |
[production] |
00:30 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P81929 and previous config saved to /var/cache/conftool/dbconfig/20250828-003005-ladsgroup.json |
[production] |
00:14 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P81928 and previous config saved to /var/cache/conftool/dbconfig/20250828-001458-ladsgroup.json |
[production] |
2025-08-27
§
|
23:59 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1165 (T402925)', diff saved to https://phabricator.wikimedia.org/P81927 and previous config saved to /var/cache/conftool/dbconfig/20250827-235950-ladsgroup.json |
[production] |
23:55 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1165 (T402925)', diff saved to https://phabricator.wikimedia.org/P81926 and previous config saved to /var/cache/conftool/dbconfig/20250827-235540-ladsgroup.json |
[production] |
23:55 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance |
[production] |
23:55 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1165.eqiad.wmnet with reason: Maintenance |
[production] |
23:30 |
<rzl@deploy1003> |
Finished scap sync-world: https://gerrit.wikimedia.org/r/1182666 (duration: 03m 03s) |
[production] |
23:28 |
<rzl@deploy1003> |
Started scap sync-world: https://gerrit.wikimedia.org/r/1182666 |
[production] |
23:25 |
<rzl@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/mw-debug: apply |
[production] |
23:23 |
<rzl@deploy1003> |
helmfile [codfw] START helmfile.d/services/mw-debug: apply |
[production] |
23:22 |
<rzl@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply |
[production] |
23:18 |
<rzl@deploy1003> |
helmfile [eqiad] START helmfile.d/services/mw-debug: apply |
[production] |