1-50 of 10000 results (20ms)
2026-04-02 ยง
11:24 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2177 (T419635)', diff saved to https://phabricator.wikimedia.org/P90217 and previous config saved to /var/cache/conftool/dbconfig/20260402-112421-fceratto.json [production]
11:19 <James_F> Zuul: [oojs/ui] Drop ooui-ruby2.7-rake job, we're abandoning Ruby use there [releng]
11:18 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission [toolsbeta]
11:16 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
11:04 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli [tools]
11:03 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
11:02 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
11:01 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/304 [admin]
11:01 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/304 [admin]
10:56 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli [tools]
10:51 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db2177 (T419635)', diff saved to https://phabricator.wikimedia.org/P90216 and previous config saved to /var/cache/conftool/dbconfig/20260402-105142-fceratto.json [production]
10:51 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2177.codfw.wmnet with reason: Maintenance [production]
10:51 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2156 (T419635)', diff saved to https://phabricator.wikimedia.org/P90215 and previous config saved to /var/cache/conftool/dbconfig/20260402-105129-fceratto.json [production]
10:51 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli [toolsbeta]
10:47 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component volume-admission [toolsbeta]
10:47 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
10:45 <daniel@deploy1003> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
10:45 <daniel@deploy1003> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
10:44 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component volume-admission [toolsbeta]
10:44 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
10:43 <jmm@cumin1003> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cumin2002.codfw.wmnet [production]
10:42 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli [toolsbeta]
10:41 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-cli [toolsbeta]
10:41 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2156', diff saved to https://phabricator.wikimedia.org/P90214 and previous config saved to /var/cache/conftool/dbconfig/20260402-104121-fceratto.json [production]
10:40 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component volume-admission [toolsbeta]
10:40 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
10:40 <daniel@deploy1003> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
10:38 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component volume-admission [toolsbeta]
10:38 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
10:37 <daniel@deploy1003> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
10:37 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component volume-admission [toolsbeta]
10:37 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
10:36 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component volume-admission [toolsbeta]
10:35 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
10:35 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component volume-admission [toolsbeta]
10:35 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
10:34 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli [toolsbeta]
10:34 <dcaro@cloudcumin1001> END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component wmcs-k8s-metrics [toolsbeta]
10:33 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics [toolsbeta]
10:33 <dcaro@cloudcumin1001> END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component wmcs-k8s-metrics [toolsbeta]
10:33 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics [toolsbeta]
10:32 <jmm@cumin1003> START - Cookbook sre.hosts.reboot-single for host cumin2002.codfw.wmnet [production]
10:31 <daniel@deploy1003> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
10:31 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2156', diff saved to https://phabricator.wikimedia.org/P90213 and previous config saved to /var/cache/conftool/dbconfig/20260402-103113-fceratto.json [production]
10:31 <daniel@deploy1003> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
10:27 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
10:21 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2156 (T419635)', diff saved to https://phabricator.wikimedia.org/P90212 and previous config saved to /var/cache/conftool/dbconfig/20260402-102105-fceratto.json [production]
10:19 <jayme@deploy1003> helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
10:19 <jayme@deploy1003> helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. [production]
10:19 <jayme@deploy1003> helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]