6201-6250 of 10000 results (39ms)
2024-06-24 ยง
10:12 <dhinus> webservice restart [tools.sal]
10:11 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-k8s-worker-nfs-43 [tools]
10:11 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-k8s-ingress-7 [tools]
10:10 <jayme@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
10:09 <fnegri@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-k8s-worker-nfs-43 [tools]
10:08 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-k8s-control-7 [tools]
10:06 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-k8s-control-7 [tools]
10:05 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component maintain-kubeusers [toolsbeta]
10:05 <aborrero@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.component.deploy for component maintain-kubeusers [toolsbeta]
10:04 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-redis-7 [tools]
10:04 <jelto@cumin1002> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab Replica to new version [production]
10:03 <fnegri@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.worker.drain (exit_code=99) for node tools-k8s-worker-nfs-43 [tools]
10:03 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1407.eqiad.wmnet with reason: host reimage [production]
10:02 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-redis-7 [tools]
10:01 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-redis-6 [tools]
09:59 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-redis-6 [tools]
09:59 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1420.eqiad.wmnet with reason: host reimage [production]
09:58 <fnegri@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.drain for node tools-k8s-worker-nfs-43 [tools]
09:57 <jelto@cumin1002> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab Replica to new version [production]
09:56 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1407.eqiad.wmnet with reason: host reimage [production]
09:56 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1420.eqiad.wmnet with reason: host reimage [production]
09:53 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-cumin-1 [tools]
09:52 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-cumin-1 [tools]
09:51 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-k8s-haproxy-5 [tools]
09:50 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-k8s-haproxy-5 [tools]
09:49 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-harbor-1 [tools]
09:47 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-harbor-1 [tools]
09:46 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker role in the tools cluster [tools]
09:46 <taavi@cloudcumin1001> Added a new k8s worker tools-k8s-worker-107.tools.eqiad1.wikimedia.cloud to the cluster [tools]
09:46 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
09:45 <mvolz@deploy1002> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
09:44 <mvolz@deploy1002> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
09:44 <mvolz@deploy1002> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
09:44 <mvolz@deploy1002> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
09:44 <mvolz@deploy1002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
09:43 <mvolz@deploy1002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
09:42 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw1420.eqiad.wmnet with OS buster [production]
09:42 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
09:42 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
09:41 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw1407.eqiad.wmnet with OS buster [production]
09:40 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-prometheus-6 [tools]
09:39 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-prometheus-6 [tools]
09:39 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
09:35 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker role in the tools cluster [tools]
09:35 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-puppetserver-01 [tools]
09:34 <claime> Reimaging scap::proxies, mediawiki deployments may be unavailable - T368058 [production]
09:34 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-puppetserver-01 [tools]
09:33 <mvolz@deploy1002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
09:33 <mvolz@deploy1002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
09:33 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-puppetdb-2 [tools]