|
2026-01-12
ยง
|
| 11:23 |
<ladsgroup@deploy2002> |
cjming, ladsgroup: Continuing with sync |
[production] |
| 11:22 |
<ladsgroup@deploy2002> |
cjming, ladsgroup: Backport for [[gerrit:1216847|extension-list: Add Test Kitchen (T407806)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 11:13 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P87326 and previous config saved to /var/cache/conftool/dbconfig/20260112-111332-marostegui.json |
[production] |
| 11:09 |
<moritzm> |
uploaded dnsmasq 2.92-rc3 to bookworm-wikimedia/main T396864 |
[production] |
| 11:08 |
<cgoubert@deploy2002> |
helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 11:08 |
<cgoubert@deploy2002> |
helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. |
[production] |
| 11:07 |
<cgoubert@deploy2002> |
helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 11:06 |
<cgoubert@deploy2002> |
helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 11:03 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P87325 and previous config saved to /var/cache/conftool/dbconfig/20260112-110324-marostegui.json |
[production] |
| 11:01 |
<Dreamy_Jazz> |
Deployed security patch for T414011 |
[production] |
| 10:58 |
<ladsgroup@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1216847|extension-list: Add Test Kitchen (T407806)]] |
[production] |
| 10:57 |
<urbanecm@deploy2002> |
mwscript-k8s job started: CentralAuth:emptyGlobalUserGroup.php --wiki=metawiki oathauth-tester # T411360 |
[production] |
| 10:53 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1169 (T413525)', diff saved to https://phabricator.wikimedia.org/P87323 and previous config saved to /var/cache/conftool/dbconfig/20260112-105316-marostegui.json |
[production] |
| 10:49 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2166 gradually with 4 steps - repooling |
[production] |
| 10:49 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2145 (T413525)', diff saved to https://phabricator.wikimedia.org/P87321 and previous config saved to /var/cache/conftool/dbconfig/20260112-104941-marostegui.json |
[production] |
| 10:49 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2145.codfw.wmnet with reason: Maintenance |
[production] |
| 10:41 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1203 gradually with 4 steps - repooling |
[production] |
| 10:34 |
<vgutierrez@cumin1003> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on P{cp[7008,7016].*} and A:cp - test haproxy 2.8.18 upgrade (T414318) |
[production] |
| 10:22 |
<vgutierrez@cumin1003> |
START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on P{cp[7008,7016].*} and A:cp - test haproxy 2.8.18 upgrade (T414318) |
[production] |
| 10:20 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1169 (T413525)', diff saved to https://phabricator.wikimedia.org/P87313 and previous config saved to /var/cache/conftool/dbconfig/20260112-102044-marostegui.json |
[production] |
| 10:20 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1169.eqiad.wmnet with reason: Maintenance |
[production] |
| 10:20 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2141.codfw.wmnet with reason: Maintenance |
[production] |
| 10:19 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.pool db2166 gradually with 4 steps - repooling |
[production] |
| 10:18 |
<vgutierrez> |
fetch HAProxy 2.8.18 on thirdparty/haproxy28-bullseye (apt.wm.o) - T414318 |
[production] |
| 10:15 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2166 (T413525)', diff saved to https://phabricator.wikimedia.org/P87310 and previous config saved to /var/cache/conftool/dbconfig/20260112-101520-marostegui.json |
[production] |
| 10:11 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.pool db1203 gradually with 4 steps - repooling |
[production] |
| 10:08 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2166 (T413525)', diff saved to https://phabricator.wikimedia.org/P87308 and previous config saved to /var/cache/conftool/dbconfig/20260112-100821-marostegui.json |
[production] |
| 10:08 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2166.codfw.wmnet with reason: Maintenance |
[production] |
| 10:07 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2165 (T413525)', diff saved to https://phabricator.wikimedia.org/P87307 and previous config saved to /var/cache/conftool/dbconfig/20260112-100756-marostegui.json |
[production] |
| 10:01 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1203 (T413525)', diff saved to https://phabricator.wikimedia.org/P87305 and previous config saved to /var/cache/conftool/dbconfig/20260112-100112-marostegui.json |
[production] |
| 09:57 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to https://phabricator.wikimedia.org/P87304 and previous config saved to /var/cache/conftool/dbconfig/20260112-095748-marostegui.json |
[production] |
| 09:56 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1203 (T413525)', diff saved to https://phabricator.wikimedia.org/P87303 and previous config saved to /var/cache/conftool/dbconfig/20260112-095610-marostegui.json |
[production] |
| 09:56 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1203.eqiad.wmnet with reason: Maintenance |
[production] |
| 09:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1193 (T413525)', diff saved to https://phabricator.wikimedia.org/P87302 and previous config saved to /var/cache/conftool/dbconfig/20260112-095545-marostegui.json |
[production] |
| 09:47 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to https://phabricator.wikimedia.org/P87301 and previous config saved to /var/cache/conftool/dbconfig/20260112-094740-marostegui.json |
[production] |
| 09:47 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.pool db2249 slowly with 10 steps - repooling |
[production] |
| 09:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1193', diff saved to https://phabricator.wikimedia.org/P87299 and previous config saved to /var/cache/conftool/dbconfig/20260112-094537-marostegui.json |
[production] |
| 09:37 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2165 (T413525)', diff saved to https://phabricator.wikimedia.org/P87298 and previous config saved to /var/cache/conftool/dbconfig/20260112-093731-marostegui.json |
[production] |
| 09:35 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1193', diff saved to https://phabricator.wikimedia.org/P87297 and previous config saved to /var/cache/conftool/dbconfig/20260112-093528-marostegui.json |
[production] |
| 09:32 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2165 (T413525)', diff saved to https://phabricator.wikimedia.org/P87296 and previous config saved to /var/cache/conftool/dbconfig/20260112-093237-marostegui.json |
[production] |
| 09:32 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2165.codfw.wmnet with reason: Maintenance |
[production] |
| 09:32 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2164 (T413525)', diff saved to https://phabricator.wikimedia.org/P87295 and previous config saved to /var/cache/conftool/dbconfig/20260112-093223-marostegui.json |
[production] |
| 09:25 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1193 (T413525)', diff saved to https://phabricator.wikimedia.org/P87294 and previous config saved to /var/cache/conftool/dbconfig/20260112-092520-marostegui.json |
[production] |
| 09:22 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P87293 and previous config saved to /var/cache/conftool/dbconfig/20260112-092215-marostegui.json |
[production] |
| 09:20 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1193 (T413525)', diff saved to https://phabricator.wikimedia.org/P87292 and previous config saved to /var/cache/conftool/dbconfig/20260112-092016-marostegui.json |
[production] |
| 09:20 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1193.eqiad.wmnet with reason: Maintenance |
[production] |
| 09:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1192 (T413525)', diff saved to https://phabricator.wikimedia.org/P87291 and previous config saved to /var/cache/conftool/dbconfig/20260112-091950-marostegui.json |
[production] |
| 09:12 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P87290 and previous config saved to /var/cache/conftool/dbconfig/20260112-091206-marostegui.json |
[production] |
| 09:10 |
<dzahn@dns1004> |
END - running authdns-update |
[production] |
| 09:10 |
<mutante> |
DNS - adding new language code 'kai' - https://en.wikipedia.org/wiki/Karai-karai |
[production] |