8651-8700 of 10000 results (60ms)
2024-06-20 ยง
12:53 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno [toolsbeta]
12:53 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [sso]
12:52 <aborrero@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno [toolsbeta]
12:51 <marostegui@cumin2002> dbctl commit (dc=all): 'db1236 (re)pooling @ 5%: 1', diff saved to https://phabricator.wikimedia.org/P65223 and previous config saved to /var/cache/conftool/dbconfig/20240620-125139-root.json [production]
12:51 <jelto@cumin1002> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab Replica to new version [production]
12:50 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [spi-tools]
12:47 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [spi-tools]
12:46 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [spacemedia]
12:45 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [spacemedia]
12:45 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [soweego]
12:44 <jelto@cumin1002> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab Replica to new version [production]
12:44 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [soweego]
12:41 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1050.eqiad.wmnet' [admin]
12:40 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [signwriting]
12:40 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1049.eqiad.wmnet' [admin]
12:38 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [signwriting]
12:37 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [security-tools]
12:37 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1048.eqiad.wmnet with OS bookworm [production]
12:37 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
12:36 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
12:36 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate True, for hosts list: ['cloudvirt1048'] [cloudvirt-canary]
12:36 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate True, for hosts list: ['cloudvirt1048'] [cloudvirt-canary]
12:35 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [security-tools]
12:35 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=1) [search]
12:34 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
12:34 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
12:33 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [search]
12:33 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [schematreerecommender]
12:33 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1047.eqiad.wmnet with OS bookworm [production]
12:32 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [schematreerecommender]
12:31 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=1) [research-collaborations-api]
12:31 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate True, for hosts list: ['cloudvirt1047'] [cloudvirt-canary]
12:31 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate True, for hosts list: ['cloudvirt1047'] [cloudvirt-canary]
12:11 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1048.eqiad.wmnet with reason: host reimage [production]
12:11 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [quarry]
12:09 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [qrank]
12:08 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1047.eqiad.wmnet with reason: host reimage [production]
12:07 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [qrank]
12:06 <taavi@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1048.eqiad.wmnet with reason: host reimage [production]
12:04 <taavi@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1047.eqiad.wmnet with reason: host reimage [production]
12:04 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [puppet-diffs]
11:55 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [puppet-diffs]
11:54 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [pluggableauth]
11:52 <cgoubert@cumin1002> conftool action : set/pooled=inactive; selector: name=mw2282.codfw.wmnet,cluster=kubernetes,service=kubesvc [production]
11:50 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1049.eqiad.wmnet' [admin]
11:49 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_project_to_ovs [pluggableauth]
11:48 <ayounsi@cumin1002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox [production]
11:48 <taavi@cumin1002> START - Cookbook sre.hosts.reimage for host cloudvirt1048.eqiad.wmnet with OS bookworm [production]
11:47 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_project_to_ovs (exit_code=0) [paws]
11:47 <taavi@cumin1002> START - Cookbook sre.hosts.reimage for host cloudvirt1047.eqiad.wmnet with OS bookworm [production]