|
2026-01-13
ยง
|
| 10:05 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2245', diff saved to https://phabricator.wikimedia.org/P87459 and previous config saved to /var/cache/conftool/dbconfig/20260113-100519-marostegui.json |
[production] |
| 09:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2245', diff saved to https://phabricator.wikimedia.org/P87458 and previous config saved to /var/cache/conftool/dbconfig/20260113-095510-marostegui.json |
[production] |
| 09:45 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2245 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87457 and previous config saved to /var/cache/conftool/dbconfig/20260113-094502-marostegui.json |
[production] |
| 09:41 |
<ayounsi@cumin1003> |
START - Cookbook sre.hosts.reimage for host testvm2007.codfw.wmnet with OS bookworm |
[production] |
| 09:40 |
<fceratto@deploy2002> |
helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . |
[production] |
| 09:34 |
<fceratto@deploy2002> |
helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . |
[production] |
| 08:43 |
<marostegui> |
Stop mariadb on db2232 (m5) for testing dbproxy2005 T409398 |
[production] |
| 08:42 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db[2160,2232].codfw.wmnet with reason: testing |
[production] |
| 08:31 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2005.codfw.wmnet with OS trixie |
[production] |
| 08:31 |
<brouberol@cumin1003> |
END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host an-test-druid1001.eqiad.wmnet with OS bookworm |
[production] |
| 08:08 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbproxy2005.codfw.wmnet with reason: host reimage |
[production] |
| 08:04 |
<marostegui@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on dbproxy2005.codfw.wmnet with reason: host reimage |
[production] |
| 07:53 |
<brouberol@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-test-druid1001.eqiad.wmnet with reason: host reimage |
[production] |
| 07:48 |
<marostegui@cumin1003> |
START - Cookbook sre.hosts.reimage for host dbproxy2005.codfw.wmnet with OS trixie |
[production] |
| 07:48 |
<brouberol@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on an-test-druid1001.eqiad.wmnet with reason: host reimage |
[production] |
| 07:34 |
<brouberol@cumin1003> |
START - Cookbook sre.hosts.reimage for host an-test-druid1001.eqiad.wmnet with OS bookworm |
[production] |
| 07:11 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newpool (exit_code=0) pool db2143: After Schema change |
[production] |
| 07:11 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 07:11 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 07:11 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newpool pool db2143: After Schema change |
[production] |
| 07:10 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newdepool (exit_code=0) depool db2143: Schema change |
[production] |
| 07:10 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 07:10 |
<marostegui> |
Deploy schema change on ms3 T411497 |
[production] |
| 07:10 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 07:10 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newdepool depool db2143: Schema change |
[production] |
| 07:06 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newpool (exit_code=0) pool db2144: After Schema change |
[production] |
| 07:06 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 07:06 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 07:06 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newpool pool db2144: After Schema change |
[production] |
| 07:06 |
<marostegui> |
Deploy schema change on ms2 T411497 |
[production] |
| 07:05 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newdepool (exit_code=0) depool db2144: Schema change |
[production] |
| 07:05 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 07:05 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 07:05 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newdepool depool db2144: Schema change |
[production] |
| 06:51 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newpool (exit_code=0) pool db2142: After Schema change |
[production] |
| 06:50 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 06:50 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 06:50 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newpool pool db2142: After Schema change |
[production] |
| 06:50 |
<marostegui> |
Deploy schema change on ms1 T411497 |
[production] |
| 06:48 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.newdepool (exit_code=0) depool db2142: Schema change |
[production] |
| 06:48 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 06:48 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 06:48 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.newdepool depool db2142: Schema change |
[production] |
| 06:39 |
<XioNoX> |
push pfw policies - T414393 |
[production] |
| 06:13 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1163.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:13 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2212.codfw.wmnet with reason: Maintenance |
[production] |
| 05:04 |
<mwpresync@deploy2002> |
Pruned MediaWiki: 1.46.0-wmf.5 (duration: 04m 11s) |
[production] |
| 04:47 |
<mwpresync@deploy2002> |
Finished scap sync-world: testwikis to 1.46.0-wmf.11 refs T413802 (duration: 44m 17s) |
[production] |
| 04:03 |
<mwpresync@deploy2002> |
Started scap sync-world: testwikis to 1.46.0-wmf.11 refs T413802 |
[production] |
| 02:27 |
<sukhe@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on cp5022.eqsin.wmnet with reason: host down |
[production] |