|
2025-02-01
§
|
| 07:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1234', diff saved to https://phabricator.wikimedia.org/P72989 and previous config saved to /var/cache/conftool/dbconfig/20250201-071609-marostegui.json |
[production] |
| 07:01 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1234', diff saved to https://phabricator.wikimedia.org/P72988 and previous config saved to /var/cache/conftool/dbconfig/20250201-070103-marostegui.json |
[production] |
| 06:45 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1234 (T384592)', diff saved to https://phabricator.wikimedia.org/P72987 and previous config saved to /var/cache/conftool/dbconfig/20250201-064555-marostegui.json |
[production] |
| 05:30 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1234 (T384592)', diff saved to https://phabricator.wikimedia.org/P72986 and previous config saved to /var/cache/conftool/dbconfig/20250201-053027-marostegui.json |
[production] |
| 05:30 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7:00:00 on db1234.eqiad.wmnet with reason: Maintenance |
[production] |
| 05:30 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1232 (T384592)', diff saved to https://phabricator.wikimedia.org/P72985 and previous config saved to /var/cache/conftool/dbconfig/20250201-053005-marostegui.json |
[production] |
| 05:14 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1232', diff saved to https://phabricator.wikimedia.org/P72984 and previous config saved to /var/cache/conftool/dbconfig/20250201-051458-marostegui.json |
[production] |
| 04:59 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1232', diff saved to https://phabricator.wikimedia.org/P72983 and previous config saved to /var/cache/conftool/dbconfig/20250201-045951-marostegui.json |
[production] |
| 04:44 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1232 (T384592)', diff saved to https://phabricator.wikimedia.org/P72982 and previous config saved to /var/cache/conftool/dbconfig/20250201-044444-marostegui.json |
[production] |
| 03:34 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1232 (T384592)', diff saved to https://phabricator.wikimedia.org/P72981 and previous config saved to /var/cache/conftool/dbconfig/20250201-033412-marostegui.json |
[production] |
| 03:34 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7:00:00 on db1232.eqiad.wmnet with reason: Maintenance |
[production] |
| 03:33 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1219 (T384592)', diff saved to https://phabricator.wikimedia.org/P72980 and previous config saved to /var/cache/conftool/dbconfig/20250201-033350-marostegui.json |
[production] |
| 03:18 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1219', diff saved to https://phabricator.wikimedia.org/P72979 and previous config saved to /var/cache/conftool/dbconfig/20250201-031843-marostegui.json |
[production] |
| 03:03 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1219', diff saved to https://phabricator.wikimedia.org/P72978 and previous config saved to /var/cache/conftool/dbconfig/20250201-030337-marostegui.json |
[production] |
| 02:48 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1219 (T384592)', diff saved to https://phabricator.wikimedia.org/P72977 and previous config saved to /var/cache/conftool/dbconfig/20250201-024829-marostegui.json |
[production] |
| 01:37 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1219 (T384592)', diff saved to https://phabricator.wikimedia.org/P72976 and previous config saved to /var/cache/conftool/dbconfig/20250201-013748-marostegui.json |
[production] |
| 01:37 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7:00:00 on db1219.eqiad.wmnet with reason: Maintenance |
[production] |
| 01:37 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1218 (T384592)', diff saved to https://phabricator.wikimedia.org/P72975 and previous config saved to /var/cache/conftool/dbconfig/20250201-013726-marostegui.json |
[production] |
| 01:25 |
<brett> |
import ncmonitor 1.3.1 into bookworm-wikimedia |
[production] |
| 01:22 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1218', diff saved to https://phabricator.wikimedia.org/P72974 and previous config saved to /var/cache/conftool/dbconfig/20250201-012219-marostegui.json |
[production] |
| 01:07 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1218', diff saved to https://phabricator.wikimedia.org/P72973 and previous config saved to /var/cache/conftool/dbconfig/20250201-010712-marostegui.json |
[production] |
| 00:52 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1218 (T384592)', diff saved to https://phabricator.wikimedia.org/P72971 and previous config saved to /var/cache/conftool/dbconfig/20250201-005205-marostegui.json |
[production] |
|
2025-01-31
§
|
| 23:45 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1218 (T384592)', diff saved to https://phabricator.wikimedia.org/P72970 and previous config saved to /var/cache/conftool/dbconfig/20250131-234543-marostegui.json |
[production] |
| 23:45 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7:00:00 on db1218.eqiad.wmnet with reason: Maintenance |
[production] |
| 23:45 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1207 (T384592)', diff saved to https://phabricator.wikimedia.org/P72969 and previous config saved to /var/cache/conftool/dbconfig/20250131-234521-marostegui.json |
[production] |
| 23:30 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1207', diff saved to https://phabricator.wikimedia.org/P72968 and previous config saved to /var/cache/conftool/dbconfig/20250131-233014-marostegui.json |
[production] |
| 23:15 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1207', diff saved to https://phabricator.wikimedia.org/P72967 and previous config saved to /var/cache/conftool/dbconfig/20250131-231507-marostegui.json |
[production] |
| 23:00 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1207 (T384592)', diff saved to https://phabricator.wikimedia.org/P72966 and previous config saved to /var/cache/conftool/dbconfig/20250131-230000-marostegui.json |
[production] |
| 21:38 |
<mforns@deploy2002> |
Finished deploy [airflow-dags/analytics@16e825c]: update commons impact metrics category allow list (duration: 01m 10s) |
[production] |
| 21:37 |
<mforns@deploy2002> |
Started deploy [airflow-dags/analytics@16e825c]: update commons impact metrics category allow list |
[production] |
| 21:29 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1207 (T384592)', diff saved to https://phabricator.wikimedia.org/P72964 and previous config saved to /var/cache/conftool/dbconfig/20250131-212934-marostegui.json |
[production] |
| 21:29 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7:00:00 on db1207.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:29 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1206 (T384592)', diff saved to https://phabricator.wikimedia.org/P72963 and previous config saved to /var/cache/conftool/dbconfig/20250131-212912-marostegui.json |
[production] |
| 21:14 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P72962 and previous config saved to /var/cache/conftool/dbconfig/20250131-211406-marostegui.json |
[production] |
| 20:59 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P72961 and previous config saved to /var/cache/conftool/dbconfig/20250131-205859-marostegui.json |
[production] |
| 20:43 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1206 (T384592)', diff saved to https://phabricator.wikimedia.org/P72960 and previous config saved to /var/cache/conftool/dbconfig/20250131-204353-marostegui.json |
[production] |
| 19:59 |
<jhathaway@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on ms-be2088.codfw.wmnet with reason: T381919 |
[production] |
| 19:23 |
<aokoth@deploy2002> |
helmfile [staging] DONE helmfile.d/services/miscweb: apply |
[production] |
| 19:23 |
<aokoth@deploy2002> |
helmfile [staging] START helmfile.d/services/miscweb: apply |
[production] |
| 19:06 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1206 (T384592)', diff saved to https://phabricator.wikimedia.org/P72959 and previous config saved to /var/cache/conftool/dbconfig/20250131-190627-marostegui.json |
[production] |
| 19:06 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7:00:00 on db1206.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:06 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1196 (T384592)', diff saved to https://phabricator.wikimedia.org/P72958 and previous config saved to /var/cache/conftool/dbconfig/20250131-190605-marostegui.json |
[production] |
| 18:57 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1233 (re)pooling @ 100%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P72957 and previous config saved to /var/cache/conftool/dbconfig/20250131-185722-root.json |
[production] |
| 18:57 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2225 (re)pooling @ 100%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P72956 and previous config saved to /var/cache/conftool/dbconfig/20250131-185715-root.json |
[production] |
| 18:50 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1196', diff saved to https://phabricator.wikimedia.org/P72955 and previous config saved to /var/cache/conftool/dbconfig/20250131-185058-marostegui.json |
[production] |
| 18:42 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1233 (re)pooling @ 75%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P72954 and previous config saved to /var/cache/conftool/dbconfig/20250131-184217-root.json |
[production] |
| 18:42 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2225 (re)pooling @ 75%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P72953 and previous config saved to /var/cache/conftool/dbconfig/20250131-184210-root.json |
[production] |
| 18:35 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1196', diff saved to https://phabricator.wikimedia.org/P72952 and previous config saved to /var/cache/conftool/dbconfig/20250131-183551-marostegui.json |
[production] |
| 18:28 |
<dwisehaupt@dns1004> |
END - running authdns-update |
[production] |
| 18:27 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1233 (re)pooling @ 50%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P72951 and previous config saved to /var/cache/conftool/dbconfig/20250131-182712-root.json |
[production] |