|
2026-10-07
§
|
| 05:21 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2068.codfw.wmnet |
[production] |
| 05:20 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2067.codfw.wmnet |
[production] |
| 05:18 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2067.codfw.wmnet |
[production] |
| 05:18 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2067.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 05:10 |
<kart_> |
Updated Apertium to 2026-09-30-051826-production (T437213) |
[production] |
| 05:09 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker2067.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 05:09 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2067.codfw.wmnet |
[production] |
| 05:08 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2067.codfw.wmnet |
[production] |
| 05:08 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[2067-2078,2087-2095,2102-2115].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) |
[production] |
| 05:04 |
<kartik@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/apertium: apply |
[production] |
| 05:04 |
<kartik@deploy1003> |
helmfile [eqiad] START helmfile.d/services/apertium: apply |
[production] |
| 05:01 |
<kartik@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/apertium: apply |
[production] |
| 05:00 |
<kartik@deploy1003> |
helmfile [codfw] START helmfile.d/services/apertium: apply |
[production] |
| 04:54 |
<marostegui> |
Stop mariadb on x4 db2245 to clone the backup host T437279 |
[production] |
| 04:52 |
<marostegui@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2245.codfw.wmnet with reason: cloning |
[production] |
| 04:51 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2245: to clone the backup host T437279 |
[production] |
| 04:51 |
<marostegui@cumin1004> |
START - Cookbook sre.mysql.depool depool db2245: to clone the backup host T437279 |
[production] |
| 04:50 |
<marostegui> |
Stop mariadb on x4 db2245 to clone the backup host |
[production] |
| 04:50 |
<kartik@deploy1003> |
helmfile [staging] DONE helmfile.d/services/apertium: apply |
[production] |
| 04:50 |
<kartik@deploy1003> |
helmfile [staging] START helmfile.d/services/apertium: apply |
[production] |
| 02:08 |
<mwpresync@deploy1003> |
Finished scap build-images: Publishing wmf/next image (duration: 07m 35s) |
[production] |
| 02:00 |
<mwpresync@deploy1003> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2026-10-06
§
|
| 22:07 |
<jdlrobson@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1352284|Revert "Scroll the TOC along with the page scrolling" (T440296)]] (duration: 11m 24s) |
[production] |
| 22:01 |
<jdlrobson@deploy1003> |
jdlrobson: Continuing with deployment |
[production] |
| 22:00 |
<jdlrobson@deploy1003> |
jdlrobson: Backport for [[gerrit:1352284|Revert "Scroll the TOC along with the page scrolling" (T440296)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 21:55 |
<jdlrobson@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1352284|Revert "Scroll the TOC along with the page scrolling" (T440296)]] |
[production] |
| 20:15 |
<catrope@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1352217|Email confirmation: Temporarily disable banner modification]], [[gerrit:1352219|Email confirmation: Temporarily disable banner modification]], [[gerrit:1352259|EmailConfirmationHooks: Replace hard-coded timestamp with getStartDate()]], [[gerrit:1352260|EmailConfirmationHooks: Replace hard-coded timestamp with getStartDate()]] (duration: 12m 17 |
[production] |
| 20:10 |
<catrope@deploy1003> |
catrope: Continuing with deployment |
[production] |
| 20:07 |
<catrope@deploy1003> |
catrope: Backport for [[gerrit:1352217|Email confirmation: Temporarily disable banner modification]], [[gerrit:1352219|Email confirmation: Temporarily disable banner modification]], [[gerrit:1352259|EmailConfirmationHooks: Replace hard-coded timestamp with getStartDate()]], [[gerrit:1352260|EmailConfirmationHooks: Replace hard-coded timestamp with getStartDate()]] synced to the testservers (see htt |
[production] |
| 20:03 |
<catrope@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1352217|Email confirmation: Temporarily disable banner modification]], [[gerrit:1352219|Email confirmation: Temporarily disable banner modification]], [[gerrit:1352259|EmailConfirmationHooks: Replace hard-coded timestamp with getStartDate()]], [[gerrit:1352260|EmailConfirmationHooks: Replace hard-coded timestamp with getStartDate()]] |
[production] |
| 18:48 |
<eevans@deploy1003> |
helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply |
[production] |
| 18:48 |
<eevans@deploy1003> |
helmfile [staging] START helmfile.d/services/linked-artifacts: apply |
[production] |
| 18:32 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1218: Pooling back db1218 after stress test |
[production] |
| 18:32 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2209: Pooling back db2209 after stress test |
[production] |
| 18:32 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2207: Pooling back db2207 after stress test |
[production] |
| 18:02 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2055-2062,2064-2065].codfw.wmnet |
[production] |
| 18:01 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2055-2062,2064-2065].codfw.wmnet |
[production] |
| 17:47 |
<marostegui> |
Repool db1218, db2207 and db2209 after stress testing |
[production] |
| 17:47 |
<marostegui@cumin1004> |
START - Cookbook sre.mysql.pool pool db1218: Pooling back db1218 after stress test |
[production] |
| 17:47 |
<marostegui@cumin1004> |
START - Cookbook sre.mysql.pool pool db2209: Pooling back db2209 after stress test |
[production] |
| 17:47 |
<marostegui@cumin1004> |
START - Cookbook sre.mysql.pool pool db2207: Pooling back db2207 after stress test |
[production] |
| 17:46 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[2055-2062,2064-2065].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) |
[production] |
| 17:46 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2065.codfw.wmnet |
[production] |
| 17:46 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2065.codfw.wmnet |
[production] |
| 17:46 |
<marostegui@cumin1004> |
END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db2207: Pooling back db2207 after stress test |
[production] |
| 17:45 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2065.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 17:44 |
<marostegui@cumin1004> |
START - Cookbook sre.mysql.pool pool db2207: Pooling back db2207 after stress test |
[production] |
| 17:36 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.provision for host wikikube-worker2065.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 17:36 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2065.codfw.wmnet |
[production] |
| 17:36 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2065.codfw.wmnet |
[production] |