251-300 of 10000 results (24ms)
2026-02-25 ยง
14:24 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.copy_istio_images_to_registry (exit_code=0) for Istio 1.29.0 [tools]
14:24 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.copy_istio_images_to_registry for Istio 1.29.0 [tools]
14:22 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.copy_istio_images_to_registry (exit_code=99) for Istio 1.29.0 [tools]
14:21 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.copy_istio_images_to_registry for Istio 1.29.0 [tools]
14:17 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component gateway-api [toolsbeta]
14:10 <stran@deploy2002> stran: Backport for [[gerrit:1233674|Remove deprecated IRS v2 configurations (T413951)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:09 <taavi> taavi@tools-imagebuilder-2:~$ sudo docker system prune -a # reclaiming disk space [tools]
14:08 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.copy_istio_images_to_registry (exit_code=99) for Istio 1.29.0 [tools]
14:08 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.copy_istio_images_to_registry for Istio 1.29.0 [tools]
14:07 <James_F> Zuul: [mediawiki/extensions/CommunityRequests] Add TemplateData dependency, for T401638 [releng]
14:06 <stran@deploy2002> Started scap sync-world: Backport for [[gerrit:1233674|Remove deprecated IRS v2 configurations (T413951)]] [production]
14:02 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component gateway-api [toolsbeta]
14:02 <kamila@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2356.codfw.wmnet [production]
14:01 <kamila@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2356.codfw.wmnet [production]
14:00 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host dse-k8s-worker1026.eqiad.wmnet with OS bookworm [production]
13:59 <btullis@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dse-k8s-worker1026.eqiad.wmnet with OS bookworm [production]
13:49 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host dse-k8s-worker1026.eqiad.wmnet with OS bookworm [production]
13:48 <btullis@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dse-k8s-worker1026.eqiad.wmnet with OS bookworm [production]
13:47 <btullis@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker1026 [production]
13:47 <btullis@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker1026 [production]
13:30 <aikochou@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
13:27 <aikochou@deploy2002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
13:25 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host dse-k8s-worker1026.eqiad.wmnet with OS bookworm [production]
13:25 <aikochou@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
13:24 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1239949|[Growth] Enable on all open Wikipedias (T417023)]] (duration: 08m 11s) [production]
13:22 <tappof> Starting deployment of the multi-instance Thanos Store Gateway patches for T412924 [production]
13:20 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
13:18 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1239949|[Growth] Enable on all open Wikipedias (T417023)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:17 <btullis@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dse-k8s-worker1026.eqiad.wmnet with OS bookworm [production]
13:16 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1239949|[Growth] Enable on all open Wikipedias (T417023)]] [production]
13:12 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1242466|[Growth] Enable wmgGEMentorListJsonSchemaEnabled (T417422)]] (duration: 07m 24s) [production]
13:08 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
13:07 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1242466|[Growth] Enable wmgGEMentorListJsonSchemaEnabled (T417422)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:05 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1242466|[Growth] Enable wmgGEMentorListJsonSchemaEnabled (T417422)]] [production]
13:00 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1243811|[Growth] testwiki: Enable wmgGEMentorListJsonSchemaEnabled (T417422)]] (duration: 12m 00s) [production]
12:56 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
12:50 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1243811|[Growth] testwiki: Enable wmgGEMentorListJsonSchemaEnabled (T417422)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
12:48 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1243811|[Growth] testwiki: Enable wmgGEMentorListJsonSchemaEnabled (T417422)]] [production]
12:46 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1243190|feat(DataProvider): Allow logging of read validation failures (T417893)]], [[gerrit:1242392|[Growth] Log read failures when JSON schema validation is enabled (T417422 T417893)]] (duration: 06m 57s) [production]
12:45 <mvolz@deploy2002> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
12:44 <mvolz@deploy2002> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
12:42 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
12:42 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1243190|feat(DataProvider): Allow logging of read validation failures (T417893)]], [[gerrit:1242392|[Growth] Log read failures when JSON schema validation is enabled (T417422 T417893)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
12:42 <mvolz@deploy2002> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
12:41 <mvolz@deploy2002> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
12:40 <mvolz@deploy2002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
12:39 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1243190|feat(DataProvider): Allow logging of read validation failures (T417893)]], [[gerrit:1242392|[Growth] Log read failures when JSON schema validation is enabled (T417422 T417893)]] [production]
12:39 <mvolz@deploy2002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
12:38 <fabfur@cumin1003> conftool action : set/pooled=yes; selector: name=cp7009.* [production]
12:38 <fabfur> repooling cp7009 (T417253) [production]