|
2026-10-19
ยง
|
| 19:19 |
<ssastry@deploy1003> |
helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply |
[production] |
| 19:06 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 18:59 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 18:12 |
<wmbot~lucaswerkmeister@tools-bastion-15> |
deployed 1161d3e..40f18f1: l10n updates (skr-arab) |
[tools.ranker] |
| 18:10 |
<wmbot~lucaswerkmeister@tools-bastion-15> |
deployed 51c233f..8cbfa07: l10n updates (skr-arab) |
[tools.lexeme-forms] |
| 18:08 |
<wmbot~lucaswerkmeister@tools-bastion-15> |
deployed 9ac1608..f23674a: l10n updates (skr-arab) |
[tools.wd-image-positions] |
| 17:56 |
<marostegui@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db1221 (T441197)', diff saved to https://phabricator.wikimedia.org/P96857 and previous config saved to /var/cache/conftool/dbconfig/20261019-175642-marostegui.json |
[production] |
| 17:43 |
<krinkle@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1356887|GlobalFunctions: Remove Microsoft IIS 7.5 workaround from wfUrlencode (T441517)]] (1.47.0-wmf.24), [[gerrit:1356885|VisualEditorResourceModule: Remove unused Message::exists() check (T441253)]] (1.47.0-wmf.24) (duration: 11m 49s) |
[production] |
| 17:41 |
<marostegui@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P96856 and previous config saved to /var/cache/conftool/dbconfig/20261019-174140-marostegui.json |
[production] |
| 17:37 |
<krinkle@deploy1003> |
krinkle: Continuing with deployment |
[production] |
| 17:35 |
<krinkle@deploy1003> |
krinkle: Backport for [[gerrit:1356887|GlobalFunctions: Remove Microsoft IIS 7.5 workaround from wfUrlencode (T441517)]] (1.47.0-wmf.24), [[gerrit:1356885|VisualEditorResourceModule: Remove unused Message::exists() check (T441253)]] (1.47.0-wmf.24) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 17:31 |
<krinkle@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1356887|GlobalFunctions: Remove Microsoft IIS 7.5 workaround from wfUrlencode (T441517)]] (1.47.0-wmf.24), [[gerrit:1356885|VisualEditorResourceModule: Remove unused Message::exists() check (T441253)]] (1.47.0-wmf.24) |
[production] |
| 17:31 |
<herron@deploy1003> |
Finished scap sync-world: bump rsyslog to 8.2608.0-4 T438375 (duration: 10m 45s) |
[production] |
| 17:28 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2223 (T441633)', diff saved to https://phabricator.wikimedia.org/P96855 and previous config saved to /var/cache/conftool/dbconfig/20261019-172847-ladsgroup.json |
[production] |
| 17:28 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.druid.reboot-workers (exit_code=0) for Druid public cluster: Reboot Druid nodes |
[production] |
| 17:28 |
<mutante> |
sre.host.reboot-single fails entirely if the linked task isn't public so it cant update it |
[production] |
| 17:27 |
<dzahn@cumin1004> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host zuul1005.eqiad.wmnet |
[production] |
| 17:27 |
<dzahn@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host zuul1005.eqiad.wmnet |
[production] |
| 17:27 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup2020.codfw.wmnet |
[production] |
| 17:26 |
<marostegui@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P96854 and previous config saved to /var/cache/conftool/dbconfig/20261019-172638-marostegui.json |
[production] |
| 17:25 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup1020.eqiad.wmnet |
[production] |
| 17:24 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup2020.codfw.wmnet |
[production] |
| 17:23 |
<dzahn@cumin1004> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host zuul1004.eqiad.wmnet |
[production] |
| 17:23 |
<dzahn@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host zuul1004.eqiad.wmnet |
[production] |
| 17:22 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup2019.codfw.wmnet |
[production] |
| 17:22 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup1020.eqiad.wmnet |
[production] |
| 17:22 |
<herron@deploy1003> |
Started scap sync-world: bump rsyslog to 8.2608.0-4 T438375 |
[production] |
| 17:21 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup1019.eqiad.wmnet |
[production] |
| 17:20 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup2019.codfw.wmnet |
[production] |
| 17:18 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup2018.codfw.wmnet |
[production] |
| 17:18 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2223', diff saved to https://phabricator.wikimedia.org/P96853 and previous config saved to /var/cache/conftool/dbconfig/20261019-171846-ladsgroup.json |
[production] |
| 17:18 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup1019.eqiad.wmnet |
[production] |
| 17:17 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup1018.eqiad.wmnet |
[production] |
| 17:15 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup2018.codfw.wmnet |
[production] |
| 17:14 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup2017.codfw.wmnet |
[production] |
| 17:14 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup1018.eqiad.wmnet |
[production] |
| 17:13 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup1017.eqiad.wmnet |
[production] |
| 17:11 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup2017.codfw.wmnet |
[production] |
| 17:11 |
<marostegui@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db1221 (T441197)', diff saved to https://phabricator.wikimedia.org/P96852 and previous config saved to /var/cache/conftool/dbconfig/20261019-171136-marostegui.json |
[production] |
| 17:10 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup2016.codfw.wmnet |
[production] |
| 17:10 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup1017.eqiad.wmnet |
[production] |
| 17:09 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup1016.eqiad.wmnet |
[production] |
| 17:08 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2223', diff saved to https://phabricator.wikimedia.org/P96851 and previous config saved to /var/cache/conftool/dbconfig/20261019-170844-ladsgroup.json |
[production] |
| 17:07 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup2016.codfw.wmnet |
[production] |
| 17:06 |
<cwilliams@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host backup2015.codfw.wmnet |
[production] |
| 17:06 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup1016.eqiad.wmnet |
[production] |
| 17:04 |
<cwilliams@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host backup2015.codfw.wmnet |
[production] |
| 17:03 |
<marostegui@cumin1004> |
dbctl commit (dc=all): 'Depooling db1221 (T441197)', diff saved to https://phabricator.wikimedia.org/P96850 and previous config saved to /var/cache/conftool/dbconfig/20261019-170345-marostegui.json |
[production] |
| 17:03 |
<marostegui@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on 6 hosts with reason: Maintenance |
[production] |
| 17:03 |
<marostegui@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db1221.eqiad.wmnet with reason: Maintenance |
[production] |