151-200 of 10000 results (38ms)
2026-07-13 ยง
12:48 <atsuko@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
12:48 <ladsgroup@deploy2003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
12:47 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host thanos-be2008.codfw.wmnet with OS trixie [production]
12:47 <atsuko@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
12:47 <ladsgroup@deploy2003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
12:47 <atsuko@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
12:46 <ladsgroup@deploy2003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
12:45 <atsuko@deploy2003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
12:45 <ladsgroup@deploy2003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
12:45 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
12:44 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
12:43 <dreamyjazz@deploy2003> Finished scap sync-world: Backport for [[gerrit:1309684|ProductionServices: Drop NodeJS iPoid URL (T416623)]] (duration: 07m 02s) [production]
12:42 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [toolsbeta]
12:38 <dreamyjazz@deploy2003> dreamyjazz: Continuing with deployment [production]
12:38 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on toolsbeta-redis-8.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:37 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on toolsbeta-redis-9.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:37 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [toolsbeta]
12:37 <dreamyjazz@deploy2003> dreamyjazz: Backport for [[gerrit:1309684|ProductionServices: Drop NodeJS iPoid URL (T416623)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
12:36 <dreamyjazz@deploy2003> Started scap sync-world: Backport for [[gerrit:1309684|ProductionServices: Drop NodeJS iPoid URL (T416623)]] [production]
12:35 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on toolsbeta-redis-8.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:35 <taavi@cloudcumin1001> END (ERROR) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=97) on toolsbeta-redis-8.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:35 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on toolsbeta-redis-9.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:34 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=99) on toolsbeta-redis-9.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:34 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on toolsbeta-redis-8.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:31 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on toolsbeta-redis-9.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:29 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-be2008.codfw.wmnet with reason: host reimage [production]
12:27 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [tools]
12:23 <Msz2001> Deployed changes to private code for Suggested Investigations [production]
12:22 <mvernon@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-be2008.codfw.wmnet with reason: host reimage [production]
12:21 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [tools]
12:20 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
12:19 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [toolsbeta]
12:19 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
12:17 <atsuko@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/opensearch-ttmserver: apply [production]
12:17 <atsuko@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-ttmserver: apply [production]
12:16 <gmodena@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
12:15 <mszwarc@deploy2003> Finished scap sync-world: Backport for [[gerrit:1310058|Revert^2 "SI: Fix client side instrumentation" (T431977)]] (duration: 07m 14s) [production]
12:15 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
12:10 <mszwarc@deploy2003> mszwarc: Continuing with deployment [production]
12:09 <mszwarc@deploy2003> mszwarc: Backport for [[gerrit:1310058|Revert^2 "SI: Fix client side instrumentation" (T431977)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
12:07 <mszwarc@deploy2003> Started scap sync-world: Backport for [[gerrit:1310058|Revert^2 "SI: Fix client side instrumentation" (T431977)]] [production]
12:04 <mszwarc@deploy2003> sync-world aborted: Backport for [[gerrit:1310027|SI: Fix client side instrumentation (T431977)]] (duration: 00m 29s) [production]
12:03 <mszwarc@deploy2003> Started scap sync-world: Backport for [[gerrit:1310027|SI: Fix client side instrumentation (T431977)]] [production]
12:01 <mvernon@cumin2003> START - Cookbook sre.hosts.reimage for host thanos-be2008.codfw.wmnet with OS trixie [production]
12:00 <zabe@deploy2003> Finished scap sync-world: Backport for [[gerrit:1310064|Do not apply elwiki abusefilter settings to dewiki (T431934)]], [[gerrit:1310061|etcd: Add support for x4 (T431989)]] (duration: 07m 37s) [production]
11:55 <zabe@deploy2003> zabe: Continuing with deployment [production]
11:54 <zabe@deploy2003> zabe: Backport for [[gerrit:1310064|Do not apply elwiki abusefilter settings to dewiki (T431934)]], [[gerrit:1310061|etcd: Add support for x4 (T431989)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
11:52 <zabe@deploy2003> Started scap sync-world: Backport for [[gerrit:1310064|Do not apply elwiki abusefilter settings to dewiki (T431934)]], [[gerrit:1310061|etcd: Add support for x4 (T431989)]] [production]
11:51 <gmodena@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
11:43 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on toolsbeta-redis-7.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]