6951-7000 of 10000 results (58ms)
2024-06-20 ยง
13:06 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [text-to-speech]
13:06 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cumin1002.eqiad.wmnet [production]
13:05 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-staging2003.codfw.wmnet [production]
13:05 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [suggestbot]
13:04 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [suggestbot]
13:02 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [striker]
13:01 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [striker]
13:00 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host cumin1002.eqiad.wmnet [production]
13:00 <klausman@cumin2002> START - Cookbook sre.hosts.reboot-single for host ml-staging2003.codfw.wmnet [production]
13:00 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1050.eqiad.wmnet' [admin]
12:59 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [statanalyser]
12:57 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [statanalyser]
12:57 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [sso]
12:56 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno [tools]
12:55 <aborrero@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno [tools]
12:54 <sukhe> sudo cumin -b1 -s30 "A:installserver" "run-puppet-agent": T366360 [production]
12:53 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno [toolsbeta]
12:53 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [sso]
12:52 <aborrero@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno [toolsbeta]
12:51 <marostegui@cumin2002> dbctl commit (dc=all): 'db1236 (re)pooling @ 5%: 1', diff saved to https://phabricator.wikimedia.org/P65223 and previous config saved to /var/cache/conftool/dbconfig/20240620-125139-root.json [production]
12:51 <jelto@cumin1002> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab Replica to new version [production]
12:50 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [spi-tools]
12:47 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [spi-tools]
12:46 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [spacemedia]
12:45 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [spacemedia]
12:45 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [soweego]
12:44 <jelto@cumin1002> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab Replica to new version [production]
12:44 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [soweego]
12:41 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1050.eqiad.wmnet' [admin]
12:40 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [signwriting]
12:40 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1049.eqiad.wmnet' [admin]
12:38 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [signwriting]
12:37 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [security-tools]
12:37 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1048.eqiad.wmnet with OS bookworm [production]
12:37 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
12:36 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
12:36 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate True, for hosts list: ['cloudvirt1048'] [cloudvirt-canary]
12:36 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate True, for hosts list: ['cloudvirt1048'] [cloudvirt-canary]
12:35 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [security-tools]
12:35 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=1) [search]
12:34 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
12:34 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
12:33 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [search]
12:33 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [schematreerecommender]
12:33 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1047.eqiad.wmnet with OS bookworm [production]
12:32 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [schematreerecommender]
12:31 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=1) [research-collaborations-api]
12:31 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate True, for hosts list: ['cloudvirt1047'] [cloudvirt-canary]
12:31 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate True, for hosts list: ['cloudvirt1047'] [cloudvirt-canary]
12:11 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1048.eqiad.wmnet with reason: host reimage [production]