351-400 of 10000 results (117ms)
2026-06-03 ยง
11:33 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:33 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:32 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:32 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:30 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]
11:30 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2196: Migration of db2196.codfw.wmnet completed [production]
11:29 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1212 (T426633)', diff saved to https://phabricator.wikimedia.org/P93691 and previous config saved to /var/cache/conftool/dbconfig/20260603-112909-fceratto.json [production]
11:29 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on 6 hosts with reason: Maintenance [production]
11:28 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1212.eqiad.wmnet with reason: Maintenance [production]
11:28 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1198 (T426633)', diff saved to https://phabricator.wikimedia.org/P93690 and previous config saved to /var/cache/conftool/dbconfig/20260603-112838-fceratto.json [production]
11:24 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
11:20 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:20 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:20 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:19 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:18 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1198', diff saved to https://phabricator.wikimedia.org/P93689 and previous config saved to /var/cache/conftool/dbconfig/20260603-111831-fceratto.json [production]
11:14 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
11:09 <cgoubert@deploy1003> helmfile [staging] DONE helmfile.d/services/api-gateway: apply [production]
11:09 <cgoubert@deploy1003> helmfile [staging] START helmfile.d/services/api-gateway: apply [production]
11:08 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/api-gateway: apply [production]
11:08 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1198', diff saved to https://phabricator.wikimedia.org/P93687 and previous config saved to /var/cache/conftool/dbconfig/20260603-110823-fceratto.json [production]
11:07 <mvernon@cumin2002> END (FAIL) - Cookbook sre.swift.convert-disks (exit_code=99) for host ms-be1066 [production]
11:07 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/api-gateway: apply [production]
11:06 <jiji@deploy1003> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
11:05 <jiji@deploy1003> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
11:03 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
11:02 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:02 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:02 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:02 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
11:02 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:01 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:01 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
11:00 <mszwarc@deploy1003> Finished scap sync-world: Backport for [[gerrit:1289895|Update UserInfoCard to be enabled by default for certain user groups (T426021)]] (duration: 07m 37s) [production]
11:00 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
10:59 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/api-gateway: apply [production]
10:59 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
10:59 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/api-gateway: apply [production]
10:59 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
10:58 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply [production]
10:58 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/api-gateway: apply [production]
10:58 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1198 (T426633)', diff saved to https://phabricator.wikimedia.org/P93685 and previous config saved to /var/cache/conftool/dbconfig/20260603-105815-fceratto.json [production]
10:58 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/api-gateway: apply [production]
10:57 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
10:57 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
10:56 <mszwarc@deploy1003> mszwarc: Continuing with deployment [production]
10:55 <mszwarc@deploy1003> mszwarc: Backport for [[gerrit:1289895|Update UserInfoCard to be enabled by default for certain user groups (T426021)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
10:54 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply [production]
10:54 <jiji@deploy1003> helmfile [codfw] DONE helmfile.d/services/changeprop: apply [production]
10:53 <jiji@deploy1003> helmfile [codfw] START helmfile.d/services/changeprop: apply [production]