|
2026-10-14
ยง
|
| 20:27 |
<wmde-fisch@deploy1003> |
wmde-fisch: Backport for [[gerrit:1355169|Check for undefined when using mainListIndex (T441193)]] (1.47.0-wmf.23) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:23 |
<wmde-fisch@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1355169|Check for undefined when using mainListIndex (T441193)]] (1.47.0-wmf.23) |
[production] |
| 20:22 |
<kemayo@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1355168|VisualEditor: Precompute edit suggestion counts on 25% of enwiki (T433024)]], [[gerrit:1355147|ExtensionDistributor: Mark 1.47 as beta (T441077)]], [[gerrit:1352018|InitialiseSettings: Enable ModeratorToolkit on four group2 wikis (T437617)]], [[gerrit:1352019|InitialiseSettings: Enable ModeratorToolkit on enwiki (T437617)]] (duration: 14m 26s) |
[production] |
| 20:19 |
<cdobbins@cumin1004> |
START - Cookbook sre.hosts.provision for host cp2046.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 20:17 |
<cdobbins@cumin1004> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts cp2046.codfw.wmnet |
[production] |
| 20:17 |
<cdobbins@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2046.codfw.wmnet |
[production] |
| 20:16 |
<kemayo@deploy1003> |
ariel, kemayo, dhardy: Continuing with deployment |
[production] |
| 20:12 |
<kemayo@deploy1003> |
ariel, kemayo, dhardy: Backport for [[gerrit:1355168|VisualEditor: Precompute edit suggestion counts on 25% of enwiki (T433024)]], [[gerrit:1355147|ExtensionDistributor: Mark 1.47 as beta (T441077)]], [[gerrit:1352018|InitialiseSettings: Enable ModeratorToolkit on four group2 wikis (T437617)]], [[gerrit:1352019|InitialiseSettings: Enable ModeratorToolkit on enwiki (T437617)]] synced to the testserve |
[production] |
| 20:07 |
<kemayo@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1355168|VisualEditor: Precompute edit suggestion counts on 25% of enwiki (T433024)]], [[gerrit:1355147|ExtensionDistributor: Mark 1.47 as beta (T441077)]], [[gerrit:1352018|InitialiseSettings: Enable ModeratorToolkit on four group2 wikis (T437617)]], [[gerrit:1352019|InitialiseSettings: Enable ModeratorToolkit on enwiki (T437617)]] |
[production] |
| 19:56 |
<cdobbins@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host cp2046.codfw.wmnet |
[production] |
| 19:52 |
<cdobbins@cumin1004> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2046.codfw.wmnet |
[production] |
| 19:52 |
<cdobbins@cumin1004> |
conftool action : set/pooled=no; selector: name=cp2046.* |
[production] |
| 19:46 |
<Southparkfan> |
Decommission deployment-deploy04 - T435393, T441229 |
[releng] |
| 19:40 |
<cdobbins@cumin1004> |
conftool action : set/pooled=yes; selector: name=cp2045.* |
[production] |
| 19:40 |
<cdobbins@cumin1004> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2045.codfw.wmnet |
[production] |
| 19:40 |
<cdobbins@cumin1004> |
START - Cookbook sre.hosts.remove-downtime for cp2045.codfw.wmnet |
[production] |
| 19:39 |
<Southparkfan> |
Assign missing security groups to instances: web to deployment-deploy06, citoid to deployment-docker-citoid03, wikifeeds to deployment-docker-wikifeeds01 |
[releng] |
| 19:37 |
<cdobbins@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cp2045.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 19:22 |
<cdobbins@cumin1004> |
START - Cookbook sre.hosts.provision for host cp2045.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 19:21 |
<kemayo@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 19:20 |
<kemayo@deploy1003> |
helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 19:20 |
<kemayo@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 19:19 |
<cdobbins@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2045.codfw.wmnet |
[production] |
| 19:19 |
<kemayo@deploy1003> |
helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 19:17 |
<kemayo@deploy1003> |
helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 19:16 |
<kemayo@deploy1003> |
helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 19:15 |
<kemayo@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/editcheck-headless: apply |
[production] |
| 19:14 |
<kemayo@deploy1003> |
helmfile [codfw] START helmfile.d/services/editcheck-headless: apply |
[production] |
| 19:14 |
<kemayo@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/editcheck-headless: apply |
[production] |
| 19:14 |
<kemayo@deploy1003> |
helmfile [eqiad] START helmfile.d/services/editcheck-headless: apply |
[production] |
| 19:12 |
<cdobbins@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host cp2045.codfw.wmnet |
[production] |
| 19:11 |
<cdobbins@cumin1004> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts cp2045.codfw.wmnet |
[production] |
| 19:11 |
<cdobbins@cumin1004> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2045.codfw.wmnet |
[production] |
| 18:55 |
<akhatun@deploy1003> |
helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply |
[production] |
| 18:55 |
<akhatun@deploy1003> |
helmfile [staging] START helmfile.d/services/lac-lambdas: apply |
[production] |
| 18:55 |
<akhatun@deploy1003> |
helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply |
[production] |
| 18:54 |
<akhatun@deploy1003> |
helmfile [staging] START helmfile.d/services/lac-lambdas: apply |
[production] |
| 18:50 |
<akhatun@deploy1003> |
helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply |
[production] |
| 18:50 |
<akhatun@deploy1003> |
helmfile [staging] START helmfile.d/services/lac-lambdas: apply |
[production] |
| 18:50 |
<dzahn@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on codesearch2001.codfw.wmnet with reason: in setup, frontend image pending |
[production] |
| 18:49 |
<cdobbins@cumin1004> |
START - Cookbook sre.hosts.reboot-single for host cp2045.codfw.wmnet |
[production] |
| 18:47 |
<cdobbins@cumin1004> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2045.codfw.wmnet |
[production] |
| 18:47 |
<cdobbins@cumin1004> |
conftool action : set/pooled=no; selector: name=cp2045.* |
[production] |
| 18:22 |
<brett@cumin2003> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2044.codfw.wmnet |
[production] |
| 18:22 |
<brett@cumin2003> |
START - Cookbook sre.hosts.remove-downtime for cp2044.codfw.wmnet |
[production] |
| 18:19 |
<brennen@deploy1003> |
rebuilt and synchronized wikiversions files: group1 to 1.47.0-wmf.24 refs T438220 |
[production] |
| 18:12 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[2261-2290].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) |
[production] |
| 18:12 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2290.codfw.wmnet |
[production] |
| 18:11 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2290.codfw.wmnet |
[production] |
| 18:11 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2290.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART |
[production] |