2025-08-13
ยง
|
08:30 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2153', diff saved to https://phabricator.wikimedia.org/P81227 and previous config saved to /var/cache/conftool/dbconfig/20250813-083023-ladsgroup.json |
[production] |
08:16 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2153', diff saved to https://phabricator.wikimedia.org/P81226 and previous config saved to /var/cache/conftool/dbconfig/20250813-081516-ladsgroup.json |
[production] |
08:00 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2153 (T400854)', diff saved to https://phabricator.wikimedia.org/P81225 and previous config saved to /var/cache/conftool/dbconfig/20250813-080008-ladsgroup.json |
[production] |
07:57 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Depooling db2153 (T400854)', diff saved to https://phabricator.wikimedia.org/P81224 and previous config saved to /var/cache/conftool/dbconfig/20250813-075721-ladsgroup.json |
[production] |
07:57 |
<ladsgroup@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2153.codfw.wmnet with reason: Maintenance |
[production] |
07:56 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2146 (T400854)', diff saved to https://phabricator.wikimedia.org/P81223 and previous config saved to /var/cache/conftool/dbconfig/20250813-075658-ladsgroup.json |
[production] |
07:52 |
<fabfur> |
manually upgrading haproxykafka on cp1111 to test new metrics (T400978) |
[production] |
07:49 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve1012.eqiad.wmnet |
[production] |
07:48 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1003.eqiad.wmnet |
[production] |
07:43 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host sretest1003.eqiad.wmnet |
[production] |
07:42 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ml-serve1012.eqiad.wmnet |
[production] |
07:41 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P81222 and previous config saved to /var/cache/conftool/dbconfig/20250813-074150-ladsgroup.json |
[production] |
07:26 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P81221 and previous config saved to /var/cache/conftool/dbconfig/20250813-072643-ladsgroup.json |
[production] |
07:15 |
<kartik@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1178036|Section Translation: Add Arakan Wikipedia (T392490)]] (duration: 11m 06s) |
[production] |
07:11 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2146 (T400854)', diff saved to https://phabricator.wikimedia.org/P81220 and previous config saved to /var/cache/conftool/dbconfig/20250813-071135-ladsgroup.json |
[production] |
07:10 |
<kartik@deploy1003> |
kartik: Continuing with sync |
[production] |
07:08 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Depooling db2146 (T400854)', diff saved to https://phabricator.wikimedia.org/P81219 and previous config saved to /var/cache/conftool/dbconfig/20250813-070849-ladsgroup.json |
[production] |
07:08 |
<ladsgroup@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2146.codfw.wmnet with reason: Maintenance |
[production] |
07:08 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2145 (T400854)', diff saved to https://phabricator.wikimedia.org/P81218 and previous config saved to /var/cache/conftool/dbconfig/20250813-070826-ladsgroup.json |
[production] |
07:06 |
<kartik@deploy1003> |
kartik: Backport for [[gerrit:1178036|Section Translation: Add Arakan Wikipedia (T392490)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
07:04 |
<kartik@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1178036|Section Translation: Add Arakan Wikipedia (T392490)]] |
[production] |
06:53 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P81216 and previous config saved to /var/cache/conftool/dbconfig/20250813-065318-ladsgroup.json |
[production] |
06:38 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P81215 and previous config saved to /var/cache/conftool/dbconfig/20250813-063811-ladsgroup.json |
[production] |
06:23 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2145 (T400854)', diff saved to https://phabricator.wikimedia.org/P81214 and previous config saved to /var/cache/conftool/dbconfig/20250813-062303-ladsgroup.json |
[production] |
06:20 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Depooling db2145 (T400854)', diff saved to https://phabricator.wikimedia.org/P81213 and previous config saved to /var/cache/conftool/dbconfig/20250813-062018-ladsgroup.json |
[production] |
06:20 |
<ladsgroup@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2145.codfw.wmnet with reason: Maintenance |
[production] |
06:19 |
<ladsgroup@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance |
[production] |
06:18 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1251 (T400854)', diff saved to https://phabricator.wikimedia.org/P81212 and previous config saved to /var/cache/conftool/dbconfig/20250813-061854-ladsgroup.json |
[production] |
06:03 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1251', diff saved to https://phabricator.wikimedia.org/P81211 and previous config saved to /var/cache/conftool/dbconfig/20250813-060347-ladsgroup.json |
[production] |
05:48 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1251', diff saved to https://phabricator.wikimedia.org/P81210 and previous config saved to /var/cache/conftool/dbconfig/20250813-054839-ladsgroup.json |
[production] |
05:33 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1251 (T400854)', diff saved to https://phabricator.wikimedia.org/P81209 and previous config saved to /var/cache/conftool/dbconfig/20250813-053330-ladsgroup.json |
[production] |
05:30 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Depooling db1251 (T400854)', diff saved to https://phabricator.wikimedia.org/P81208 and previous config saved to /var/cache/conftool/dbconfig/20250813-053052-ladsgroup.json |
[production] |
05:30 |
<ladsgroup@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1251.eqiad.wmnet with reason: Maintenance |
[production] |
05:29 |
<ladsgroup@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1239.eqiad.wmnet with reason: Maintenance |
[production] |
05:29 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1235 (T400854)', diff saved to https://phabricator.wikimedia.org/P81207 and previous config saved to /var/cache/conftool/dbconfig/20250813-052930-ladsgroup.json |
[production] |
05:14 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1235', diff saved to https://phabricator.wikimedia.org/P81206 and previous config saved to /var/cache/conftool/dbconfig/20250813-051422-ladsgroup.json |
[production] |
05:10 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Depooling db2210 (T399249)', diff saved to https://phabricator.wikimedia.org/P81205 and previous config saved to /var/cache/conftool/dbconfig/20250813-051045-fceratto.json |
[production] |
05:10 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2210.codfw.wmnet with reason: Maintenance |
[production] |
05:10 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2206 (T399249)', diff saved to https://phabricator.wikimedia.org/P81204 and previous config saved to /var/cache/conftool/dbconfig/20250813-051022-fceratto.json |
[production] |
04:59 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1235', diff saved to https://phabricator.wikimedia.org/P81203 and previous config saved to /var/cache/conftool/dbconfig/20250813-045915-ladsgroup.json |
[production] |
04:55 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2206', diff saved to https://phabricator.wikimedia.org/P81202 and previous config saved to /var/cache/conftool/dbconfig/20250813-045514-fceratto.json |
[production] |
04:44 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1235 (T400854)', diff saved to https://phabricator.wikimedia.org/P81201 and previous config saved to /var/cache/conftool/dbconfig/20250813-044408-ladsgroup.json |
[production] |
04:41 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Depooling db1235 (T400854)', diff saved to https://phabricator.wikimedia.org/P81200 and previous config saved to /var/cache/conftool/dbconfig/20250813-044138-ladsgroup.json |
[production] |
04:41 |
<ladsgroup@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1235.eqiad.wmnet with reason: Maintenance |
[production] |
04:41 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1234 (T400854)', diff saved to https://phabricator.wikimedia.org/P81199 and previous config saved to /var/cache/conftool/dbconfig/20250813-044115-ladsgroup.json |
[production] |
04:40 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2206', diff saved to https://phabricator.wikimedia.org/P81198 and previous config saved to /var/cache/conftool/dbconfig/20250813-044006-fceratto.json |
[production] |
04:26 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1234', diff saved to https://phabricator.wikimedia.org/P81197 and previous config saved to /var/cache/conftool/dbconfig/20250813-042607-ladsgroup.json |
[production] |
04:24 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2206 (T399249)', diff saved to https://phabricator.wikimedia.org/P81196 and previous config saved to /var/cache/conftool/dbconfig/20250813-042458-fceratto.json |
[production] |
04:11 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1234', diff saved to https://phabricator.wikimedia.org/P81195 and previous config saved to /var/cache/conftool/dbconfig/20250813-041100-ladsgroup.json |
[production] |
03:37 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1232', diff saved to https://phabricator.wikimedia.org/P81191 and previous config saved to /var/cache/conftool/dbconfig/20250813-033745-ladsgroup.json |
[production] |