551-600 of 10000 results (13ms)
2025-11-24 ยง
10:48 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
10:48 <gehel@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-cluster (exit_code=0) [production]
10:47 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
10:46 <gehel@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-cluster (exit_code=0) [production]
10:46 <claime> Deploying envoy 1.32 to api-gateway [production]
10:39 <gehel@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-cluster (exit_code=0) [production]
10:37 <btullis@deploy2002> helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
10:37 <btullis@deploy2002> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
10:37 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1198 (T410531)', diff saved to https://phabricator.wikimedia.org/P85501 and previous config saved to /var/cache/conftool/dbconfig/20251124-103708-marostegui.json [production]
10:36 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
10:36 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
10:34 <gehel@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-cluster (exit_code=0) [production]
10:32 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1198 (T410531)', diff saved to https://phabricator.wikimedia.org/P85500 and previous config saved to /var/cache/conftool/dbconfig/20251124-103218-marostegui.json [production]
10:32 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1198.eqiad.wmnet with reason: Maintenance [production]
10:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1189 (T410531)', diff saved to https://phabricator.wikimedia.org/P85499 and previous config saved to /var/cache/conftool/dbconfig/20251124-103155-marostegui.json [production]
10:27 <gehel@cumin2002> START - Cookbook sre.hosts.reboot-cluster [production]
10:26 <gehel@cumin1003> START - Cookbook sre.hosts.reboot-cluster [production]
10:25 <gehel@cumin2002> START - Cookbook sre.hosts.reboot-cluster [production]
10:25 <gehel@cumin1003> START - Cookbook sre.hosts.reboot-cluster [production]
10:23 <volans@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component infra-tracing [tools]
10:22 <gehel@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-cluster (exit_code=0) [production]
10:16 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1189', diff saved to https://phabricator.wikimedia.org/P85498 and previous config saved to /var/cache/conftool/dbconfig/20251124-101647-marostegui.json [production]
10:14 <gehel@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-cluster (exit_code=0) [production]
10:14 <gehel@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-cluster (exit_code=0) [production]
10:04 <volans@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component infra-tracing [tools]
10:03 <volans@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component infra-tracing [toolsbeta]
10:01 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1189', diff saved to https://phabricator.wikimedia.org/P85497 and previous config saved to /var/cache/conftool/dbconfig/20251124-100139-marostegui.json [production]
10:00 <gehel@cumin2002> START - Cookbook sre.hosts.reboot-cluster [production]
09:59 <gehel@cumin1003> START - Cookbook sre.hosts.reboot-cluster [production]
09:58 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
09:58 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
09:56 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
09:55 <gehel@cumin1003> START - Cookbook sre.hosts.reboot-cluster [production]
09:55 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
09:47 <volans@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component infra-tracing [toolsbeta]
09:46 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1189 (T410531)', diff saved to https://phabricator.wikimedia.org/P85496 and previous config saved to /var/cache/conftool/dbconfig/20251124-094632-marostegui.json [production]
09:42 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
09:42 <jmm@dns1004> END - running authdns-update [production]
09:41 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
09:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1189 (T410531)', diff saved to https://phabricator.wikimedia.org/P85495 and previous config saved to /var/cache/conftool/dbconfig/20251124-094141-marostegui.json [production]
09:41 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1189.eqiad.wmnet with reason: Maintenance [production]
09:41 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
09:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T410531)', diff saved to https://phabricator.wikimedia.org/P85494 and previous config saved to /var/cache/conftool/dbconfig/20251124-094117-marostegui.json [production]
09:41 <jmm@dns1004> START - running authdns-update [production]
09:40 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
09:40 <cgoubert@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
09:39 <cgoubert@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
09:38 <cgoubert@deploy2002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
09:38 <cgoubert@deploy2002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
09:26 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P85492 and previous config saved to /var/cache/conftool/dbconfig/20251124-092609-marostegui.json [production]