|
2026-02-03
§
|
| 08:19 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1003.wikimedia.org |
[production] |
| 08:15 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host irc1003.wikimedia.org |
[production] |
| 08:12 |
<Ammar> |
Ran refreshImageMetadata.php for multiple files for T414643 |
[production] |
| 07:34 |
<ammarpad@deploy2002> |
mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki --reason 'Requested at [[phab:T416031]]' 'Celebrate Women' 'Event:Celebrate Women' Ammarpad # T416031 |
[production] |
| 07:24 |
<moritzm> |
installing openssl security updates |
[production] |
| 07:09 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2141.codfw.wmnet with reason: Maintenance |
[production] |
| 06:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1163 (T415786)', diff saved to https://phabricator.wikimedia.org/P88448 and previous config saved to /var/cache/conftool/dbconfig/20260203-065541-marostegui.json |
[production] |
| 06:55 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1163.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:17 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db2161.codfw.wmnet with reason: schema change |
[production] |
| 06:16 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2192.codfw.wmnet with reason: Maintenance |
[production] |
| 06:14 |
<marostegui@dns1006> |
END - running authdns-update |
[production] |
| 06:13 |
<marostegui@dns1006> |
START - running authdns-update |
[production] |
| 06:11 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depool db2192 T415900', diff saved to https://phabricator.wikimedia.org/P88447 and previous config saved to /var/cache/conftool/dbconfig/20260203-061142-marostegui.json |
[production] |
| 06:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Promote db2213 to s5 primary and set section read-write T415900', diff saved to https://phabricator.wikimedia.org/P88446 and previous config saved to /var/cache/conftool/dbconfig/20260203-061025-marostegui.json |
[production] |
| 06:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set s5 codfw as read-only for maintenance - T415900', diff saved to https://phabricator.wikimedia.org/P88445 and previous config saved to /var/cache/conftool/dbconfig/20260203-061002-marostegui.json |
[production] |
| 06:04 |
<marostegui> |
Starting s5 codfw failover from db2192 to db2213 - T415900 |
[production] |
| 06:04 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 23 hosts with reason: Primary switchover s5 T415900 |
[production] |
| 06:04 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set db2213 with weight 0 T415900', diff saved to https://phabricator.wikimedia.org/P88444 and previous config saved to /var/cache/conftool/dbconfig/20260203-060411-marostegui.json |
[production] |
| 06:03 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2214.codfw.wmnet with reason: Maintenance |
[production] |
| 06:00 |
<marostegui@dns1006> |
END - running authdns-update |
[production] |
| 06:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depool db2214 T415862', diff saved to https://phabricator.wikimedia.org/P88443 and previous config saved to /var/cache/conftool/dbconfig/20260203-060000-marostegui.json |
[production] |
| 05:59 |
<marostegui@dns1006> |
START - running authdns-update |
[production] |
| 05:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Promote db2229 to s6 primary and set section read-write T415862', diff saved to https://phabricator.wikimedia.org/P88442 and previous config saved to /var/cache/conftool/dbconfig/20260203-055844-marostegui.json |
[production] |
| 05:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set s6 codfw as read-only for maintenance - T415862', diff saved to https://phabricator.wikimedia.org/P88441 and previous config saved to /var/cache/conftool/dbconfig/20260203-055823-marostegui.json |
[production] |
| 05:51 |
<marostegui> |
Starting s6 codfw failover from db2214 to db2229 - T415862 |
[production] |
| 05:50 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 22 hosts with reason: Primary switchover s6 T415862 |
[production] |
| 05:50 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set db2229 with weight 0 T415862', diff saved to https://phabricator.wikimedia.org/P88440 and previous config saved to /var/cache/conftool/dbconfig/20260203-055010-marostegui.json |
[production] |
| 05:49 |
<eileen> |
config revision changed from f348441d to 23b2d9b6 |
[fundraising] |
| 05:48 |
<eileen> |
civicrm upgraded from a097bb3d to 10ab3659 |
[fundraising] |
| 05:02 |
<mwpresync@deploy2002> |
Pruned MediaWiki: 1.46.0-wmf.11 (duration: 02m 53s) |
[production] |
| 04:48 |
<mwpresync@deploy2002> |
Finished scap sync-world: testwikis to 1.46.0-wmf.14 refs T413805 (duration: 44m 29s) |
[production] |
| 04:03 |
<mwpresync@deploy2002> |
Started scap sync-world: testwikis to 1.46.0-wmf.14 refs T413805 |
[production] |
| 03:07 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2239.codfw.wmnet with reason: Maintenance |
[production] |
| 03:06 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227 (T415786)', diff saved to https://phabricator.wikimedia.org/P88439 and previous config saved to /var/cache/conftool/dbconfig/20260203-030644-marostegui.json |
[production] |
| 02:51 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227', diff saved to https://phabricator.wikimedia.org/P88438 and previous config saved to /var/cache/conftool/dbconfig/20260203-025135-marostegui.json |
[production] |
| 02:36 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227', diff saved to https://phabricator.wikimedia.org/P88437 and previous config saved to /var/cache/conftool/dbconfig/20260203-023627-marostegui.json |
[production] |
| 02:21 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227 (T415786)', diff saved to https://phabricator.wikimedia.org/P88436 and previous config saved to /var/cache/conftool/dbconfig/20260203-022119-marostegui.json |
[production] |
| 02:13 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 12m 39s) |
[production] |
| 02:05 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance |
[production] |
| 02:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 01:16 |
<wfan> |
civicrm upgraded from 5b9f3cd4 to a097bb3d |
[fundraising] |
| 00:24 |
<wfan> |
donorwiki upgraded from 3ffc70f0 to 53bfb05b |
[fundraising] |
| 00:15 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2227 (T415786)', diff saved to https://phabricator.wikimedia.org/P88435 and previous config saved to /var/cache/conftool/dbconfig/20260203-001511-marostegui.json |
[production] |
| 00:15 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2227.codfw.wmnet with reason: Maintenance |
[production] |
| 00:14 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2209 (T415786)', diff saved to https://phabricator.wikimedia.org/P88434 and previous config saved to /var/cache/conftool/dbconfig/20260203-001445-marostegui.json |
[production] |
| 00:04 |
<robh> |
eqsin cp5022 troubleshooting onsite in progress |
[production] |