|
2026-04-12
§
|
| 21:21 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2198.codfw.wmnet with reason: Maintenance |
[production] |
| 21:20 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2182 (T410589)', diff saved to https://phabricator.wikimedia.org/P90464 and previous config saved to /var/cache/conftool/dbconfig/20260412-212043-ladsgroup.json |
[production] |
| 21:10 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P90463 and previous config saved to /var/cache/conftool/dbconfig/20260412-211036-ladsgroup.json |
[production] |
| 21:00 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P90462 and previous config saved to /var/cache/conftool/dbconfig/20260412-210028-ladsgroup.json |
[production] |
| 20:55 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1194 (T410589)', diff saved to https://phabricator.wikimedia.org/P90461 and previous config saved to /var/cache/conftool/dbconfig/20260412-205525-ladsgroup.json |
[production] |
| 20:55 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1194.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:55 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1191 (T410589)', diff saved to https://phabricator.wikimedia.org/P90460 and previous config saved to /var/cache/conftool/dbconfig/20260412-205500-ladsgroup.json |
[production] |
| 20:50 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2182 (T410589)', diff saved to https://phabricator.wikimedia.org/P90459 and previous config saved to /var/cache/conftool/dbconfig/20260412-205020-ladsgroup.json |
[production] |
| 20:44 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P90458 and previous config saved to /var/cache/conftool/dbconfig/20260412-204451-ladsgroup.json |
[production] |
| 20:34 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P90457 and previous config saved to /var/cache/conftool/dbconfig/20260412-203443-ladsgroup.json |
[production] |
| 20:24 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1191 (T410589)', diff saved to https://phabricator.wikimedia.org/P90456 and previous config saved to /var/cache/conftool/dbconfig/20260412-202435-ladsgroup.json |
[production] |
| 18:21 |
<James_F> |
jforrester@contint1002:~$ sudo /usr/sbin/service zuul restart && tail -f -n100 /var/log/zuul/zuul.log # T423027 |
[releng] |
| 14:32 |
<cgoubert@dns2004> |
START - running authdns-update |
[production] |
| 11:51 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1191 (T410589)', diff saved to https://phabricator.wikimedia.org/P90452 and previous config saved to /var/cache/conftool/dbconfig/20260412-115148-ladsgroup.json |
[production] |
| 11:51 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1191.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:51 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1174 (T410589)', diff saved to https://phabricator.wikimedia.org/P90451 and previous config saved to /var/cache/conftool/dbconfig/20260412-115124-ladsgroup.json |
[production] |
| 11:41 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P90450 and previous config saved to /var/cache/conftool/dbconfig/20260412-114116-ladsgroup.json |
[production] |
| 11:31 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P90449 and previous config saved to /var/cache/conftool/dbconfig/20260412-113108-ladsgroup.json |
[production] |
| 11:21 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1174 (T410589)', diff saved to https://phabricator.wikimedia.org/P90448 and previous config saved to /var/cache/conftool/dbconfig/20260412-112100-ladsgroup.json |
[production] |
| 09:25 |
<wmbot~peterbowman@tools-bastion-14> |
Ignore details inside <references> |
[tools.pbbot] |
| 07:06 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db2182 (T410589)', diff saved to https://phabricator.wikimedia.org/P90447 and previous config saved to /var/cache/conftool/dbconfig/20260412-070649-ladsgroup.json |
[production] |
| 07:06 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2182.codfw.wmnet with reason: Maintenance |
[production] |
| 07:06 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T410589)', diff saved to https://phabricator.wikimedia.org/P90446 and previous config saved to /var/cache/conftool/dbconfig/20260412-070624-ladsgroup.json |
[production] |
| 06:56 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P90445 and previous config saved to /var/cache/conftool/dbconfig/20260412-065616-ladsgroup.json |
[production] |
| 06:46 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P90444 and previous config saved to /var/cache/conftool/dbconfig/20260412-064608-ladsgroup.json |
[production] |
| 06:36 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T410589)', diff saved to https://phabricator.wikimedia.org/P90443 and previous config saved to /var/cache/conftool/dbconfig/20260412-063600-ladsgroup.json |
[production] |
| 02:44 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1174 (T410589)', diff saved to https://phabricator.wikimedia.org/P90442 and previous config saved to /var/cache/conftool/dbconfig/20260412-024415-ladsgroup.json |
[production] |
| 02:44 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1174.eqiad.wmnet with reason: Maintenance |
[production] |
| 02:07 |
<mwpresync@deploy1003> |
Finished scap build-images: Publishing wmf/next image (duration: 06m 19s) |
[production] |
| 02:01 |
<mwpresync@deploy1003> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2026-04-11
§
|
| 22:40 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 16735 |
[production] |
| 22:38 |
<cmooney@cumin1003> |
START - Cookbook sre.network.peering with action 'configure' for AS: 16735 |
[production] |
| 22:38 |
<cmooney@cumin1003> |
END (FAIL) - Cookbook sre.network.peering (exit_code=99) with action 'configure' for AS: 16735 |
[production] |
| 22:37 |
<cmooney@cumin1003> |
START - Cookbook sre.network.peering with action 'configure' for AS: 16735 |
[production] |
| 19:52 |
<wmbot~jeanfred@tools-bastion-15> |
Deploy 3f3c90198 (Fix query performance by using subquery instead of JOIN for linktarget) for T420408 |
[tools.wikiloves] |
| 18:50 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2248 (T419635)', diff saved to https://phabricator.wikimedia.org/P90441 and previous config saved to /var/cache/conftool/dbconfig/20260411-185048-fceratto.json |
[production] |
| 18:40 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2248', diff saved to https://phabricator.wikimedia.org/P90440 and previous config saved to /var/cache/conftool/dbconfig/20260411-184000-fceratto.json |
[production] |
| 18:29 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2248', diff saved to https://phabricator.wikimedia.org/P90439 and previous config saved to /var/cache/conftool/dbconfig/20260411-182912-fceratto.json |
[production] |
| 18:26 |
<wmbot~jeanfred@tools-bastion-15> |
Deploy 1f12fc8 (Update database query following categorylinks normalization) for T420408 |
[tools.wikiloves] |
| 18:18 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2248 (T419635)', diff saved to https://phabricator.wikimedia.org/P90438 and previous config saved to /var/cache/conftool/dbconfig/20260411-181823-fceratto.json |
[production] |
| 17:23 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db2168 (T410589)', diff saved to https://phabricator.wikimedia.org/P90437 and previous config saved to /var/cache/conftool/dbconfig/20260411-172321-ladsgroup.json |
[production] |
| 17:23 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2168.codfw.wmnet with reason: Maintenance |
[production] |
| 17:22 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T410589)', diff saved to https://phabricator.wikimedia.org/P90436 and previous config saved to /var/cache/conftool/dbconfig/20260411-172257-ladsgroup.json |
[production] |
| 17:12 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P90435 and previous config saved to /var/cache/conftool/dbconfig/20260411-171248-ladsgroup.json |
[production] |
| 17:02 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P90434 and previous config saved to /var/cache/conftool/dbconfig/20260411-170240-ladsgroup.json |
[production] |
| 17:02 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Depooling db2248 (T419635)', diff saved to https://phabricator.wikimedia.org/P90433 and previous config saved to /var/cache/conftool/dbconfig/20260411-170233-fceratto.json |
[production] |
| 17:01 |
<fceratto@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2248.codfw.wmnet with reason: Maintenance |
[production] |
| 17:01 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2247 (T419635)', diff saved to https://phabricator.wikimedia.org/P90432 and previous config saved to /var/cache/conftool/dbconfig/20260411-170138-fceratto.json |
[production] |
| 16:52 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T410589)', diff saved to https://phabricator.wikimedia.org/P90431 and previous config saved to /var/cache/conftool/dbconfig/20260411-165232-ladsgroup.json |
[production] |
| 16:50 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2247', diff saved to https://phabricator.wikimedia.org/P90430 and previous config saved to /var/cache/conftool/dbconfig/20260411-165049-fceratto.json |
[production] |