|
2026-02-03
ยง
|
| 09:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1163 (T415786)', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20260203-091039-marostegui.json |
[production] |
| 09:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P88452 and previous config saved to /var/cache/conftool/dbconfig/20260203-090031-marostegui.json |
[production] |
| 08:58 |
<ammarpad@deploy2002> |
mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki --reason 'Requested at [[phab:T416031]]' 'Celebrate Women/Events/2025' 'Event:Celebrate Women/Events/2025' Ammarpad # T416031 |
[production] |
| 08:50 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P88451 and previous config saved to /var/cache/conftool/dbconfig/20260203-085022-marostegui.json |
[production] |
| 08:49 |
<moritzm> |
installing libcommons-lang3-java security updates |
[production] |
| 08:47 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2145 (T415786)', diff saved to https://phabricator.wikimedia.org/P88450 and previous config saved to /var/cache/conftool/dbconfig/20260203-084737-marostegui.json |
[production] |
| 08:47 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2145.codfw.wmnet with reason: Maintenance |
[production] |
| 08:45 |
<ammarpad@deploy2002> |
mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki --reason 'Requested at [[phab:T416031]]' 'Celebrate Women/Events/2024' 'Event:Celebrate Women/Events/2024' Ammarpad # T416031 |
[production] |
| 08:40 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1163 (T415786)', diff saved to https://phabricator.wikimedia.org/P88449 and previous config saved to /var/cache/conftool/dbconfig/20260203-084014-marostegui.json |
[production] |
| 08:38 |
<ammarpad@deploy2002> |
mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki --reason 'Requested at [[phab:T416031]]' 'Celebrate Women/Events' 'Event:Celebrate Women/Events' Ammarpad # T416031 |
[production] |
| 08:31 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc2003.wikimedia.org |
[production] |
| 08:27 |
<moritzm> |
failover irc.wikimedia.org to irc1003.wikimedia.org |
[production] |
| 08:27 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host irc2003.wikimedia.org |
[production] |
| 08:25 |
<ammarpad@deploy2002> |
mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki --reason 'Requested at [[phab:T416031]]' 'Celebrate Women/Create an article' 'Event:Celebrate Women/Create an article' Ammarpad # T416031 |
[production] |
| 08:21 |
<jmm@dns1004> |
END - running authdns-update |
[production] |
| 08:20 |
<jmm@dns1004> |
START - running authdns-update |
[production] |
| 08:19 |
<ammarpad@deploy2002> |
mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki --reason 'Requested at [[phab:T416031]]' 'Celebrate Women/Add citations' 'Event:Celebrate Women/Add citations' Ammarpad # T416031 |
[production] |
| 08:19 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1003.wikimedia.org |
[production] |
| 08:15 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host irc1003.wikimedia.org |
[production] |
| 08:12 |
<Ammar> |
Ran refreshImageMetadata.php for multiple files for T414643 |
[production] |
| 07:34 |
<ammarpad@deploy2002> |
mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki --reason 'Requested at [[phab:T416031]]' 'Celebrate Women' 'Event:Celebrate Women' Ammarpad # T416031 |
[production] |
| 07:24 |
<moritzm> |
installing openssl security updates |
[production] |
| 07:09 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2141.codfw.wmnet with reason: Maintenance |
[production] |
| 06:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1163 (T415786)', diff saved to https://phabricator.wikimedia.org/P88448 and previous config saved to /var/cache/conftool/dbconfig/20260203-065541-marostegui.json |
[production] |
| 06:55 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1163.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:17 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db2161.codfw.wmnet with reason: schema change |
[production] |
| 06:16 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2192.codfw.wmnet with reason: Maintenance |
[production] |
| 06:14 |
<marostegui@dns1006> |
END - running authdns-update |
[production] |
| 06:13 |
<marostegui@dns1006> |
START - running authdns-update |
[production] |
| 06:11 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depool db2192 T415900', diff saved to https://phabricator.wikimedia.org/P88447 and previous config saved to /var/cache/conftool/dbconfig/20260203-061142-marostegui.json |
[production] |
| 06:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Promote db2213 to s5 primary and set section read-write T415900', diff saved to https://phabricator.wikimedia.org/P88446 and previous config saved to /var/cache/conftool/dbconfig/20260203-061025-marostegui.json |
[production] |
| 06:10 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set s5 codfw as read-only for maintenance - T415900', diff saved to https://phabricator.wikimedia.org/P88445 and previous config saved to /var/cache/conftool/dbconfig/20260203-061002-marostegui.json |
[production] |
| 06:04 |
<marostegui> |
Starting s5 codfw failover from db2192 to db2213 - T415900 |
[production] |
| 06:04 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 23 hosts with reason: Primary switchover s5 T415900 |
[production] |
| 06:04 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set db2213 with weight 0 T415900', diff saved to https://phabricator.wikimedia.org/P88444 and previous config saved to /var/cache/conftool/dbconfig/20260203-060411-marostegui.json |
[production] |
| 06:03 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2214.codfw.wmnet with reason: Maintenance |
[production] |
| 06:00 |
<marostegui@dns1006> |
END - running authdns-update |
[production] |
| 06:00 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depool db2214 T415862', diff saved to https://phabricator.wikimedia.org/P88443 and previous config saved to /var/cache/conftool/dbconfig/20260203-060000-marostegui.json |
[production] |
| 05:59 |
<marostegui@dns1006> |
START - running authdns-update |
[production] |
| 05:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Promote db2229 to s6 primary and set section read-write T415862', diff saved to https://phabricator.wikimedia.org/P88442 and previous config saved to /var/cache/conftool/dbconfig/20260203-055844-marostegui.json |
[production] |
| 05:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set s6 codfw as read-only for maintenance - T415862', diff saved to https://phabricator.wikimedia.org/P88441 and previous config saved to /var/cache/conftool/dbconfig/20260203-055823-marostegui.json |
[production] |
| 05:51 |
<marostegui> |
Starting s6 codfw failover from db2214 to db2229 - T415862 |
[production] |
| 05:50 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 22 hosts with reason: Primary switchover s6 T415862 |
[production] |
| 05:50 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Set db2229 with weight 0 T415862', diff saved to https://phabricator.wikimedia.org/P88440 and previous config saved to /var/cache/conftool/dbconfig/20260203-055010-marostegui.json |
[production] |
| 05:02 |
<mwpresync@deploy2002> |
Pruned MediaWiki: 1.46.0-wmf.11 (duration: 02m 53s) |
[production] |
| 04:48 |
<mwpresync@deploy2002> |
Finished scap sync-world: testwikis to 1.46.0-wmf.14 refs T413805 (duration: 44m 29s) |
[production] |
| 04:03 |
<mwpresync@deploy2002> |
Started scap sync-world: testwikis to 1.46.0-wmf.14 refs T413805 |
[production] |
| 03:07 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2239.codfw.wmnet with reason: Maintenance |
[production] |
| 03:06 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227 (T415786)', diff saved to https://phabricator.wikimedia.org/P88439 and previous config saved to /var/cache/conftool/dbconfig/20260203-030644-marostegui.json |
[production] |
| 02:51 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2227', diff saved to https://phabricator.wikimedia.org/P88438 and previous config saved to /var/cache/conftool/dbconfig/20260203-025135-marostegui.json |
[production] |