|
2026-02-03
§
|
| 06:04 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set db2213 with weight 0 T415900', diff saved to https://phabricator.wikimedia.org/P88444 and previous config saved to /var/cache/conftool/dbconfig/20260203-060411-marostegui.json |
[production] |
| 06:03 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2214.codfw.wmnet with reason: Maintenance |
[production] |
| 06:00 |
<marostegui@dns1006> |
END - running authdns-update |
[production] |
| 06:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depool db2214 T415862', diff saved to https://phabricator.wikimedia.org/P88443 and previous config saved to /var/cache/conftool/dbconfig/20260203-060000-marostegui.json |
[production] |
| 05:59 |
<marostegui@dns1006> |
START - running authdns-update |
[production] |
| 05:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Promote db2229 to s6 primary and set section read-write T415862', diff saved to https://phabricator.wikimedia.org/P88442 and previous config saved to /var/cache/conftool/dbconfig/20260203-055844-marostegui.json |
[production] |
| 05:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set s6 codfw as read-only for maintenance - T415862', diff saved to https://phabricator.wikimedia.org/P88441 and previous config saved to /var/cache/conftool/dbconfig/20260203-055823-marostegui.json |
[production] |
| 05:51 |
<marostegui> |
Starting s6 codfw failover from db2214 to db2229 - T415862 |
[production] |
| 05:50 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 22 hosts with reason: Primary switchover s6 T415862 |
[production] |
| 05:50 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set db2229 with weight 0 T415862', diff saved to https://phabricator.wikimedia.org/P88440 and previous config saved to /var/cache/conftool/dbconfig/20260203-055010-marostegui.json |
[production] |
| 05:49 |
<eileen> |
config revision changed from f348441d to 23b2d9b6 |
[fundraising] |
| 05:48 |
<eileen> |
civicrm upgraded from a097bb3d to 10ab3659 |
[fundraising] |
| 05:02 |
<mwpresync@deploy2002> |
Pruned MediaWiki: 1.46.0-wmf.11 (duration: 02m 53s) |
[production] |
| 04:48 |
<mwpresync@deploy2002> |
Finished scap sync-world: testwikis to 1.46.0-wmf.14 refs T413805 (duration: 44m 29s) |
[production] |
| 04:03 |
<mwpresync@deploy2002> |
Started scap sync-world: testwikis to 1.46.0-wmf.14 refs T413805 |
[production] |
| 03:07 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2239.codfw.wmnet with reason: Maintenance |
[production] |
| 03:06 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227 (T415786)', diff saved to https://phabricator.wikimedia.org/P88439 and previous config saved to /var/cache/conftool/dbconfig/20260203-030644-marostegui.json |
[production] |
| 02:51 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227', diff saved to https://phabricator.wikimedia.org/P88438 and previous config saved to /var/cache/conftool/dbconfig/20260203-025135-marostegui.json |
[production] |
| 02:36 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227', diff saved to https://phabricator.wikimedia.org/P88437 and previous config saved to /var/cache/conftool/dbconfig/20260203-023627-marostegui.json |
[production] |
| 02:21 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227 (T415786)', diff saved to https://phabricator.wikimedia.org/P88436 and previous config saved to /var/cache/conftool/dbconfig/20260203-022119-marostegui.json |
[production] |
| 02:13 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 12m 39s) |
[production] |
| 02:05 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance |
[production] |
| 02:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 01:16 |
<wfan> |
civicrm upgraded from 5b9f3cd4 to a097bb3d |
[fundraising] |
| 00:24 |
<wfan> |
donorwiki upgraded from 3ffc70f0 to 53bfb05b |
[fundraising] |
| 00:15 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2227 (T415786)', diff saved to https://phabricator.wikimedia.org/P88435 and previous config saved to /var/cache/conftool/dbconfig/20260203-001511-marostegui.json |
[production] |
| 00:15 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2227.codfw.wmnet with reason: Maintenance |
[production] |
| 00:14 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2209 (T415786)', diff saved to https://phabricator.wikimedia.org/P88434 and previous config saved to /var/cache/conftool/dbconfig/20260203-001445-marostegui.json |
[production] |
| 00:04 |
<robh> |
eqsin cp5022 troubleshooting onsite in progress |
[production] |
|
2026-02-02
§
|
| 23:59 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2209', diff saved to https://phabricator.wikimedia.org/P88433 and previous config saved to /var/cache/conftool/dbconfig/20260202-235937-marostegui.json |
[production] |
| 23:50 |
<wfan> |
payments-wiki upgraded from c035aa84 to 53bfb05b |
[fundraising] |
| 23:44 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2209', diff saved to https://phabricator.wikimedia.org/P88432 and previous config saved to /var/cache/conftool/dbconfig/20260202-234429-marostegui.json |
[production] |
| 23:29 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2209 (T415786)', diff saved to https://phabricator.wikimedia.org/P88431 and previous config saved to /var/cache/conftool/dbconfig/20260202-232921-marostegui.json |
[production] |
| 22:40 |
<herron> |
added 500G to the lv on mwlog1002 |
[production] |
| 22:24 |
<inflatador> |
bking@apt1002 `sudo -E reprepro -C thirdparty/opensearch3 copy trixie-wikimedia bookworm-wikimedia opensearch` |
[production] |
| 22:19 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1240.eqiad.wmnet with reason: Maintenance |
[production] |
| 22:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1212 (T415786)', diff saved to https://phabricator.wikimedia.org/P88430 and previous config saved to /var/cache/conftool/dbconfig/20260202-221912-marostegui.json |
[production] |
| 22:06 |
<wmftkbot> |
Test Kitchen edge-unique experiments (poll 82755) - adds: test-context-edit-color; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD |
[analytics] |
| 22:04 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1212', diff saved to https://phabricator.wikimedia.org/P88429 and previous config saved to /var/cache/conftool/dbconfig/20260202-220404-marostegui.json |
[production] |
| 21:48 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1212', diff saved to https://phabricator.wikimedia.org/P88428 and previous config saved to /var/cache/conftool/dbconfig/20260202-214855-marostegui.json |
[production] |
| 21:33 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1212 (T415786)', diff saved to https://phabricator.wikimedia.org/P88427 and previous config saved to /var/cache/conftool/dbconfig/20260202-213347-marostegui.json |
[production] |
| 21:27 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2209 (T415786)', diff saved to https://phabricator.wikimedia.org/P88426 and previous config saved to /var/cache/conftool/dbconfig/20260202-212703-marostegui.json |
[production] |
| 21:26 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2209.codfw.wmnet with reason: Maintenance |
[production] |
| 21:26 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2194 (T415786)', diff saved to https://phabricator.wikimedia.org/P88425 and previous config saved to /var/cache/conftool/dbconfig/20260202-212638-marostegui.json |
[production] |
| 21:17 |
<hashar> |
Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/1234926 "re-enable master jobs for some BlueSpice repos - T403196" |
[releng] |
| 21:16 |
<kemayo@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1235392|Edit check: turn off the tone a/b test on frwiki, jawiki, ptwiki (T411914)]], [[gerrit:1235111|Enable suggestions BetaFeature on beta wikis (T415504)]], [[gerrit:1230462|WikimediaCustomizations: Set WMCBadEmailDomainsFile (T397244)]], [[gerrit:1235491|filebackend: Clean up removed config params for multi-write backends (T328872)]] (duration: 10 |
[production] |
| 21:12 |
<kemayo@deploy2002> |
tgr, func, kemayo, esanders: Continuing with sync |
[production] |
| 21:11 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2194', diff saved to https://phabricator.wikimedia.org/P88424 and previous config saved to /var/cache/conftool/dbconfig/20260202-211129-marostegui.json |
[production] |
| 21:07 |
<kemayo@deploy2002> |
tgr, func, kemayo, esanders: Backport for [[gerrit:1235392|Edit check: turn off the tone a/b test on frwiki, jawiki, ptwiki (T411914)]], [[gerrit:1235111|Enable suggestions BetaFeature on beta wikis (T415504)]], [[gerrit:1230462|WikimediaCustomizations: Set WMCBadEmailDomainsFile (T397244)]], [[gerrit:1235491|filebackend: Clean up removed config params for multi-write backends (T328872)]] synced to |
[production] |
| 21:05 |
<bd808> |
Unblock 85.146.0.0/17 (T416079) |
[releng] |