101-150 of 10000 results (106ms)
2025-11-05 ยง
17:08 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
17:00 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
17:00 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
17:00 <swfrench-wmf> disable-puppet on A:cp hosts for haproxy config change [production]
16:58 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/api-gateway: apply [production]
16:58 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/api-gateway: apply [production]
16:58 <dancy@deploy2002> Installation of scap version "4.223.0" completed for 2 hosts [production]
16:56 <dancy@deploy2002> Installing scap version "4.223.0" for 2 host(s) [production]
16:55 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1202180|Update BetaFeatures comments]] (duration: 07m 38s) [production]
16:53 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2177', diff saved to https://phabricator.wikimedia.org/P84931 and previous config saved to /var/cache/conftool/dbconfig/20251105-165309-marostegui.json [production]
16:51 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde: Continuing with sync [production]
16:50 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde: Backport for [[gerrit:1202180|Update BetaFeatures comments]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
16:48 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1202180|Update BetaFeatures comments]] [production]
16:47 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply [production]
16:47 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/api-gateway: apply [production]
16:47 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/api-gateway: apply [production]
16:47 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:47 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/api-gateway: apply [production]
16:46 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:44 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:44 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:42 <papaul_> pfw1a/b-codfw Junos downgrade complete [production]
16:38 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2177 (T407997)', diff saved to https://phabricator.wikimedia.org/P84930 and previous config saved to /var/cache/conftool/dbconfig/20251105-163801-marostegui.json [production]
16:36 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db2161 - Upgrading db2161.codfw.wmnet [production]
16:36 <fceratto@cumin1003> START - Cookbook sre.mysql.depool db2161 - Upgrading db2161.codfw.wmnet [production]
16:35 <fceratto@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
16:31 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply [production]
16:30 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/api-gateway: apply [production]
16:29 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/api-gateway: apply [production]
16:29 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/api-gateway: apply [production]
16:27 <javiermonton@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
16:27 <javiermonton@deploy2002> helmfile [codfw] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
16:27 <javiermonton@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
16:27 <javiermonton@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
16:26 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:26 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:24 <topranks> add peering to NL-ix route servers from drmrs T386986 [production]
16:21 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:21 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:20 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2177 (T407997)', diff saved to https://phabricator.wikimedia.org/P84928 and previous config saved to /var/cache/conftool/dbconfig/20251105-162055-marostegui.json [production]
16:20 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2177.codfw.wmnet with reason: Maintenance [production]
16:20 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2156 (T407997)', diff saved to https://phabricator.wikimedia.org/P84927 and previous config saved to /var/cache/conftool/dbconfig/20251105-162032-marostegui.json [production]
16:15 <javiermonton@deploy2002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
16:14 <javiermonton@deploy2002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
16:12 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:12 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:08 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:08 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ipoid-test: apply [production]
16:06 <javiermonton@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich-next: apply [production]
16:06 <javiermonton@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich-next: apply [production]