1-50 of 10000 results (35ms)
2026-07-13 ยง
13:49 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on tools-redis-8.tools.eqiad1.wikimedia.cloud [tools]
13:48 <rscout@deploy2003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
13:48 <rscout@deploy2003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
13:48 <rscout@deploy2003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
13:47 <rscout@deploy2003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
13:44 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
13:40 <bwojtowicz@deploy2003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
13:33 <gmodena@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
13:31 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
13:31 <mvernon@cumin2003> START - Cookbook sre.hosts.reimage for host thanos-be2009.codfw.wmnet with OS trixie [production]
13:30 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on ms-be1070.eqiad.wmnet with reason: vacuum overlarge container dbs [production]
13:28 <aude@deploy2003> Finished scap sync-world: Backport for [[gerrit:1310059|Enable ChartWizard on the beta cluster (T431990)]], [[gerrit:1308656|streams: webrequest - pageview - trending (T430675)]], [[gerrit:1307438|EventStreamConfig: add page_revert_risk_wikidata_prediction_change.v1 (T420883)]], [[gerrit:1309894|Remove nonexistent autopatrolled group from Outreach Wiki (T431959)]] (duration: 11m 12s) [production]
13:23 <gmodena@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply [production]
13:22 <aude@deploy2003> aikochou, javiermonton, aude, gkm563: Continuing with deployment [production]
13:22 <gmodena@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
13:19 <gmodena@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
13:19 <aude@deploy2003> aikochou, javiermonton, aude, gkm563: Backport for [[gerrit:1310059|Enable ChartWizard on the beta cluster (T431990)]], [[gerrit:1308656|streams: webrequest - pageview - trending (T430675)]], [[gerrit:1307438|EventStreamConfig: add page_revert_risk_wikidata_prediction_change.v1 (T420883)]], [[gerrit:1309894|Remove nonexistent autopatrolled group from Outreach Wiki (T431959)]] synced to the testservers [production]
13:17 <aude@deploy2003> Started scap sync-world: Backport for [[gerrit:1310059|Enable ChartWizard on the beta cluster (T431990)]], [[gerrit:1308656|streams: webrequest - pageview - trending (T430675)]], [[gerrit:1307438|EventStreamConfig: add page_revert_risk_wikidata_prediction_change.v1 (T420883)]], [[gerrit:1309894|Remove nonexistent autopatrolled group from Outreach Wiki (T431959)]] [production]
13:01 <ladsgroup@deploy2003> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
13:01 <gmodena@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply [production]
13:00 <ladsgroup@deploy2003> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
12:59 <gmodena@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply [production]
12:59 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [tools]
12:53 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [tools]
12:52 <ladsgroup@deploy2003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
12:51 <ladsgroup@deploy2003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
12:48 <atsuko@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
12:48 <ladsgroup@deploy2003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
12:47 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host thanos-be2008.codfw.wmnet with OS trixie [production]
12:47 <atsuko@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
12:47 <ladsgroup@deploy2003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
12:47 <atsuko@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
12:46 <ladsgroup@deploy2003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
12:45 <atsuko@deploy2003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
12:45 <ladsgroup@deploy2003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
12:45 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
12:44 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
12:43 <dreamyjazz@deploy2003> Finished scap sync-world: Backport for [[gerrit:1309684|ProductionServices: Drop NodeJS iPoid URL (T416623)]] (duration: 07m 02s) [production]
12:42 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [toolsbeta]
12:38 <dreamyjazz@deploy2003> dreamyjazz: Continuing with deployment [production]
12:38 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on toolsbeta-redis-8.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:37 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on toolsbeta-redis-9.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:37 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [toolsbeta]
12:37 <dreamyjazz@deploy2003> dreamyjazz: Backport for [[gerrit:1309684|ProductionServices: Drop NodeJS iPoid URL (T416623)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
12:36 <dreamyjazz@deploy2003> Started scap sync-world: Backport for [[gerrit:1309684|ProductionServices: Drop NodeJS iPoid URL (T416623)]] [production]
12:35 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on toolsbeta-redis-8.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:35 <taavi@cloudcumin1001> END (ERROR) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=97) on toolsbeta-redis-8.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:35 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on toolsbeta-redis-9.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:34 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=99) on toolsbeta-redis-9.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]
12:34 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on toolsbeta-redis-8.toolsbeta.eqiad1.wikimedia.cloud [toolsbeta]