|
2025-03-12
ยง
|
| 19:02 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on P{cp404[0-3].ulsfo.wmnet} and A:cp for 9.2.9-1wm1 |
[production] |
| 19:00 |
<fnegri@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics (T362868) |
[toolsbeta] |
| 18:48 |
<swfrench-wmf> |
mw-(api-ext|web): scaled latent 'next' deployments down to 1 pod - T383845 |
[production] |
| 18:47 |
<swfrench@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-web: apply |
[production] |
| 18:46 |
<swfrench@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-web: apply |
[production] |
| 18:46 |
<swfrench@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-web: apply |
[production] |
| 18:46 |
<swfrench@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-web: apply |
[production] |
| 18:43 |
<swfrench@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply |
[production] |
| 18:43 |
<swfrench@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-api-ext: apply |
[production] |
| 18:43 |
<swfrench@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply |
[production] |
| 18:43 |
<swfrench@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply |
[production] |
| 18:36 |
<Amir1> |
marking ~3K revisions with bad blobs (T351953) |
[production] |
| 18:35 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on P{cp404[0-3].ulsfo.wmnet} and A:cp for 9.2.9-1wm1 |
[production] |
| 18:32 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on P{cp4048.ulsfo.wmnet} and A:cp for 9.2.9-1wm1 |
[production] |
| 18:29 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on P{cp4048.ulsfo.wmnet} and A:cp for 9.2.9-1wm1 |
[production] |
| 18:20 |
<jhuneidi@deploy2002> |
rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.20 refs T386215 |
[production] |
| 18:19 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on P{cp4049.ulsfo.wmnet} and A:cp for 9.2.9-1wm1 |
[production] |
| 18:16 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on P{cp4049.ulsfo.wmnet} and A:cp for 9.2.9-1wm1 |
[production] |
| 18:07 |
<swfrench-wmf> |
ran cumin -b8 -s90 'A:cp-text' 'run-puppet-agent -e "merging ATS Lua config change - T383845"' |
[production] |
| 17:56 |
<dhinus> |
aptly repo remove bookworm-tools helmfile, removing custom version that is older than the one from apt.w.o |
[tools] |
| 17:46 |
<wmbot~bd808@tools-bastion-12> |
`toolforge jobs restart ircservserv` after noticing the bot had dropped from IRC before it noticed itself. |
[tools.ircservserv] |
| 17:44 |
<sandraebele> |
deploying refinery source as part of weekly deployment train |
[production] |
| 17:44 |
<sandraebele> |
deploying refinery source as part of weekly deployment train |
[analytics] |
| 17:41 |
<wmbot~bd808@tools-bastion-12> |
`toolforge jobs restart gitlab` to pick up new GitLab PAT |
[tools.wikibugs] |
| 17:37 |
<swfrench-wmf> |
ran cumin 'A:cp-text' 'disable-puppet "merging ATS Lua config change - T383845"' |
[production] |
| 17:35 |
<swfrench-wmf> |
mw-(api-ext|web): scaled 'main' releases back to normal size - T383845 |
[production] |
| 17:34 |
<swfrench@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-web: apply |
[production] |
| 17:34 |
<swfrench@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-web: apply |
[production] |
| 17:34 |
<swfrench@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-web: apply |
[production] |
| 17:33 |
<swfrench@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-web: apply |
[production] |
| 17:33 |
<wmbot~bd808@tools-bastion-12> |
Rotated GITLAB_TOKEN envvar to use new non-expiring "toolforge-ro" GitLab PAT associated with the https://gitlab.wikimedia.org/pywikibugs account |
[tools.wikibugs] |
| 17:33 |
<swfrench@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply |
[production] |
| 17:33 |
<swfrench@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-api-ext: apply |
[production] |
| 17:32 |
<swfrench@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply |
[production] |
| 17:32 |
<swfrench@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply |
[production] |
| 17:28 |
<swfrench-wmf> |
mw-(api-ext|web): reverted all non-cookie-migrated traffic back to 'main' release - T383845 |
[production] |
| 17:27 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on P{cp4050.ulsfo.wmnet} and A:cp for 9.2.9-1wm1 |
[production] |
| 17:26 |
<swfrench@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-web: apply |
[production] |
| 17:26 |
<swfrench@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-web: apply |
[production] |
| 17:25 |
<swfrench@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-web: apply |
[production] |
| 17:25 |
<swfrench@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-web: apply |
[production] |
| 17:24 |
<swfrench@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-web: apply |
[production] |
| 17:24 |
<swfrench@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-web: apply |
[production] |
| 17:24 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on P{cp4050.ulsfo.wmnet} and A:cp for 9.2.9-1wm1 |
[production] |
| 17:23 |
<swfrench@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-web: apply |
[production] |
| 17:23 |
<swfrench@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-web: apply |
[production] |
| 17:21 |
<swfrench@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply |
[production] |
| 17:21 |
<swfrench@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-api-ext: apply |
[production] |
| 17:20 |
<swfrench@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply |
[production] |
| 17:20 |
<swfrench@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply |
[production] |