51-100 of 10000 results (14ms)
2025-11-14 ยง
18:19 <andrew@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcontrol1008-dev.eqiad.wmnet with OS trixie [production]
17:56 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2094.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
17:16 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host ms-be2094.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
16:55 <fceratto@cumin1003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host db-test2001.codfw.wmnet [production]
16:55 <fceratto@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db-test2001.codfw.wmnet with OS trixie [production]
16:37 <ejegg> donorwiki upgraded from b9f94a76 to 8437b605 [production]
16:36 <ejegg> payments-wiki upgraded from b9f94a76 to 8437b605 [production]
16:34 <fceratto@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db-test2001.codfw.wmnet with reason: host reimage [production]
16:28 <fceratto@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db-test2001.codfw.wmnet with reason: host reimage [production]
16:27 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance tools-db-4 (T409287) [tools]
16:26 <fnegri@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance tools-db-4 (T409287) [tools]
16:15 <dhinus> use wmcs-makedomain to create missing project domains T409361 [logging]
16:11 <fceratto@cumin1003> START - Cookbook sre.hosts.reimage for host db-test2001.codfw.wmnet with OS trixie [production]
16:09 <fceratto@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM db-test2001.codfw.wmnet - fceratto@cumin1003" [production]
16:09 <fceratto@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM db-test2001.codfw.wmnet - fceratto@cumin1003" [production]
16:09 <fceratto@cumin1003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) db-test2001.codfw.wmnet on all recursors [production]
16:09 <fceratto@cumin1003> START - Cookbook sre.dns.wipe-cache db-test2001.codfw.wmnet on all recursors [production]
16:09 <fceratto@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:09 <fceratto@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM db-test2001.codfw.wmnet - fceratto@cumin1003" [production]
16:08 <fceratto@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM db-test2001.codfw.wmnet - fceratto@cumin1003" [production]
16:05 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
16:05 <fceratto@cumin1003> START - Cookbook sre.ganeti.makevm for new host db-test2001.codfw.wmnet [production]
15:53 <dhinus> allow access to cinder volume type "high-iops" T409365 [zuul]
15:42 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
15:41 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
15:28 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
15:28 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
15:19 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
15:19 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
15:16 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
15:15 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
15:14 <fceratto@cumin1003> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db-test2001.codfw.wmnet [production]
15:14 <fceratto@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:14 <fceratto@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db-test2001.codfw.wmnet decommissioned, removing all IPs except the asset tag one - fceratto@cumin1003" [production]
15:13 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/279 (T409365) [admin]
15:13 <fceratto@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db-test2001.codfw.wmnet decommissioned, removing all IPs except the asset tag one - fceratto@cumin1003" [production]
15:13 <fnegri@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/279 (T409365) [admin]
15:13 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcontrol1008-dev.eqiad.wmnet with OS trixie [production]
15:12 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/279 (T409365) [admin]
15:12 <fnegri@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/279 (T409365) [admin]
15:10 <fnegri@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for main branch (T409365) [admin]
15:09 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
15:09 <fnegri@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for main branch (T409365) [admin]
15:08 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
15:08 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
15:04 <fceratto@cumin1003> START - Cookbook sre.hosts.decommission for hosts db-test2001.codfw.wmnet [production]
15:01 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply [production]
14:56 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply [production]
14:56 <ejegg> donorwiki upgraded from c2a4b377 to b9f94a76 [production]
14:55 <ejegg> payments-wiki upgraded from b67adca1 to b9f94a76 [production]