|
2026-03-25
§
|
| 00:04 |
<jclark@cumin1003> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" |
[production] |
| 00:03 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply |
[production] |
| 00:03 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/eventgate-analytics-external: apply |
[production] |
| 00:03 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/eventgate-analytics-external: apply |
[production] |
| 00:02 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/eventgate-analytics: apply |
[production] |
| 00:02 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/eventgate-analytics: apply |
[production] |
| 00:02 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/editor-analytics: apply |
[production] |
| 00:01 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/editor-analytics: apply |
[production] |
| 00:01 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/edit-analytics: apply |
[production] |
| 00:01 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/edit-analytics: apply |
[production] |
| 00:00 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/echostore: apply |
[production] |
| 00:00 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/echostore: apply |
[production] |
| 00:00 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/device-analytics: apply |
[production] |
| 00:00 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/device-analytics: apply |
[production] |
|
2026-03-24
§
|
| 23:59 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/developer-portal: apply |
[production] |
| 23:59 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/developer-portal: apply |
[production] |
| 23:59 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/data-gateway: apply |
[production] |
| 23:59 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/data-gateway: apply |
[production] |
| 23:58 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cxserver: apply |
[production] |
| 23:58 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/cxserver: apply |
[production] |
| 23:58 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply |
[production] |
| 23:58 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply |
[production] |
| 23:56 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/citoid: apply |
[production] |
| 23:56 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/citoid: apply |
[production] |
| 23:56 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 23:56 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 23:54 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/chart-renderer: apply |
[production] |
| 23:53 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/chart-renderer: apply |
[production] |
| 23:53 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker1023.eqiad.wmnet with reason: host reimage |
[production] |
| 23:53 |
<rzl@deploy2002> |
helmfile [staging] DONE helmfile.d/services/apertium: apply |
[production] |
| 23:52 |
<rzl@deploy2002> |
helmfile [staging] START helmfile.d/services/apertium: apply |
[production] |
| 23:46 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker1022.eqiad.wmnet with reason: host reimage |
[production] |
| 23:43 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker1021.eqiad.wmnet with reason: host reimage |
[production] |
| 23:19 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.reimage for host dse-k8s-worker1023.eqiad.wmnet with OS bookworm |
[production] |
| 23:19 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.reimage for host dse-k8s-worker1022.eqiad.wmnet with OS bookworm |
[production] |
| 23:18 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.reimage for host dse-k8s-worker1021.eqiad.wmnet with OS bookworm |
[production] |
| 23:16 |
<rzl@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-videoscaler: apply |
[production] |
| 23:16 |
<rzl@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-videoscaler: apply |
[production] |
| 23:15 |
<rzl@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-videoscaler: apply |
[production] |
| 23:15 |
<rzl@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-videoscaler: apply |
[production] |
| 22:02 |
<jdlrobson@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1260118|Drop inactive simple summary surveys (T389393)]] (duration: 08m 15s) |
[production] |
| 21:57 |
<jdlrobson@deploy2002> |
jdlrobson: Continuing with sync |
[production] |
| 21:57 |
<jdlrobson@deploy2002> |
jdlrobson: Backport for [[gerrit:1260118|Drop inactive simple summary surveys (T389393)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 21:54 |
<jdlrobson@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1260118|Drop inactive simple summary surveys (T389393)]] |
[production] |
| 21:52 |
<jdlrobson@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1259147|Address FIXME and drop not selector for section headings (T420085)]] (duration: 13m 11s) |
[production] |
| 21:47 |
<jdlrobson@deploy2002> |
jdlrobson: Continuing with sync |
[production] |
| 21:44 |
<jdlrobson@deploy2002> |
jdlrobson: Backport for [[gerrit:1259147|Address FIXME and drop not selector for section headings (T420085)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 21:38 |
<jdlrobson@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1259147|Address FIXME and drop not selector for section headings (T420085)]] |
[production] |
| 21:00 |
<jforrester@deploy2002> |
mwscript-k8s job started: maintenance/namespaceDupes.php --wiki=frwiki --source-pseudo-namespace=Abstract_ --fix # T420654 abstract: is now an interwiki |
[production] |
| 20:55 |
<jforrester@deploy2002> |
mwscript-k8s job started: moveBatch --wiki=frwiki '--u=Jdforrester (WMF)' --r=T420654 --noredirects /home/jforrester/T420654-frwiki-move # T420654 abstract: is now an interwiki; manual fix |
[production] |