6501-6550 of 10000 results (77ms)
2024-07-25 ยง
12:23 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
12:23 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
12:22 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
12:22 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-jobrunner: apply [production]
12:20 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply [production]
12:20 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-wikifunctions: apply [production]
12:20 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-wikifunctions: apply [production]
12:20 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-wikifunctions: apply [production]
12:18 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-wikifunctions: apply [production]
12:18 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
12:17 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
12:17 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
12:16 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
12:16 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
12:16 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc1017.eqiad.wmnet with reason: host reimage [production]
12:15 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
12:15 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
12:14 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
12:13 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on pc1017.eqiad.wmnet with reason: host reimage [production]
12:13 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
12:12 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
12:12 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
12:12 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
12:08 <cgoubert@deploy1002> sync-world aborted: Deploying mpic envoy listener - 1056163 - T366234 (duration: 17m 59s) [production]
11:59 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host pc1017.eqiad.wmnet with OS bookworm [production]
11:53 <btullis@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
11:51 <cgoubert@deploy1002> Started scap sync-world: Deploying mpic envoy listener - 1056163 - T366234 [production]
11:45 <btullis@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
11:40 <arturo> manually restart maintain-dbusers in cloudcontrol1005 to see if that makes any difference [admin]
11:22 <btullis@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
11:22 <btullis@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
11:05 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
11:03 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
11:02 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
11:01 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
11:01 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
11:00 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:58 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:58 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:57 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:57 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:57 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:56 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:49 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:48 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:48 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:47 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 [admin]
10:42 <elukey> upload docker-report 0.0.15 to bullseye-wimedia and upgrade build2001 [production]
10:00 <cgoubert@cumin1002> conftool action : set/pooled=yes; selector: name=kubernetes1051.eqiad.wmnet,cluster=kubernetes,service=kubesvc [reason: Uncordoning kubernetes1051 - T369011] [production]
09:57 <cgoubert@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]