7001-7050 of 10000 results (69ms)
2024-09-02 ยง
12:42 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1068120|Remove the "powered by mediawiki" override]] [production]
12:41 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-ingress-9 from 1.25.16 to 1.26.15 [tools]
12:41 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/28 [admin]
12:40 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/28 [admin]
12:40 <aborrero@cloudcumin1001> END (ERROR) - Cookbook wmcs.openstack.tofu (exit_code=97) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/28 [admin]
12:40 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/28 [admin]
12:40 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-ingress-9 from 1.25.16 to 1.26.15 [tools]
12:38 <ladsgroup@deploy1003> Finished scap sync-world: Backport for [[gerrit:1068302|Enable dark mode for Creator: namespace in Commons]] (duration: 09m 34s) [production]
12:35 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-6 from 1.25.16 to 1.26.15 [tools]
12:34 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-6 from 1.25.16 to 1.26.15 [tools]
12:34 <ladsgroup@deploy1003> ladsgroup, ebrahim: Continuing with sync [production]
12:33 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-5 from 1.25.16 to 1.26.15 [tools]
12:32 <klausman@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-worker1009.eqiad.wmnet [production]
12:32 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-5 from 1.25.16 to 1.26.15 [tools]
12:32 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-3 from 1.25.16 to 1.26.15 [tools]
12:31 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-3 from 1.25.16 to 1.26.15 [tools]
12:30 <ladsgroup@deploy1003> ladsgroup, ebrahim: Backport for [[gerrit:1068302|Enable dark mode for Creator: namespace in Commons]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
12:29 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-2 from 1.25.16 to 1.26.15 [tools]
12:28 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1068302|Enable dark mode for Creator: namespace in Commons]] [production]
12:28 <klausman@cumin1002> START - Cookbook sre.hosts.reboot-single for host dse-k8s-worker1009.eqiad.wmnet [production]
12:27 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-2 from 1.25.16 to 1.26.15 [tools]
12:26 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-1 from 1.25.16 to 1.26.15 [tools]
12:24 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-1 from 1.25.16 to 1.26.15 [tools]
12:24 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-control-9 from 1.25.16 to 1.26.15 [tools]
12:24 <godog> enable oidc for prometheus public web interface - T326657 [production]
12:23 <klausman@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve2011.codfw.wmnet [production]
12:22 <samtar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1062977|Add CommunityRequests (T372527)]] (duration: 28m 14s) [production]
12:21 <jayme@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2066.codfw.wmnet with OS bullseye [production]
12:19 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw[2271-2277].codfw.wmnet [production]
12:19 <cgoubert@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: mw[2271-2277].codfw.wmnet decommissioned, removing all IPs except the asset tag one - cgoubert@cumin1002" [production]
12:19 <cgoubert@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:19 <cgoubert@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: mw[2271-2277].codfw.wmnet decommissioned, removing all IPs except the asset tag one - cgoubert@cumin1002" [production]
12:17 <klausman@cumin1002> START - Cookbook sre.hosts.reboot-single for host ml-serve2011.codfw.wmnet [production]
12:17 <klausman@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve2009.codfw.wmnet [production]
12:14 <samtar@deploy1003> samtar: Continuing with sync [production]
12:13 <samtar@deploy1003> samtar: Backport for [[gerrit:1062977|Add CommunityRequests (T372527)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
12:12 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-control-9 from 1.25.16 to 1.26.15 [tools]
12:11 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-control-8 from 1.25.16 to 1.26.15 [tools]
12:10 <klausman@cumin1002> START - Cookbook sre.hosts.reboot-single for host ml-serve2009.codfw.wmnet [production]
12:06 <cgoubert@cumin1002> START - Cookbook sre.dns.netbox [production]
12:05 <klausman@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve1011.eqiad.wmnet [production]
12:04 <hnowlan@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw2386 to wikikube-worker2068 [production]
12:04 <hnowlan@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2068 [production]
12:03 <hnowlan@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2068 [production]
12:03 <hnowlan@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:03 <hnowlan@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2386 to wikikube-worker2068 - hnowlan@cumin1002" [production]
12:03 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2067.codfw.wmnet with OS bullseye [production]
12:01 <hnowlan@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2386 to wikikube-worker2068 - hnowlan@cumin1002" [production]
12:00 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-control-8 from 1.25.16 to 1.26.15 [tools]
11:59 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-control-7 from 1.25.16 to 1.26.15 [tools]