1-50 of 5876 results (34ms)
2024-03-06 §
17:46 <dhinus> running "wmcs-dnsleaks --delete" to clean up 2 leaked records (tools-sgeweblight-10-32) [admin]
15:36 <dcaro> renewing puppet ca cert for cloud-puppetmaster-03 [admin]
15:24 <dcaro> renewing puppet ca cert for cloudinfra-internal puppetmaster [admin]
2024-03-04 §
14:56 <dhinus> delete project "loggerdiscordbot" in favor of new project "discordbots" T358337,T358427 [admin]
12:54 <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.ceph.reboot_node (exit_code=0) (T359049) [admin]
12:48 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.reboot_node (T359049) [admin]
2024-03-01 §
14:59 <taavi> removing wmf-auto-restart-cron from all VMs without cron via cumin - https://gerrit.wikimedia.org/r/c/operations/puppet/+/1007328/ T358343 [admin]
12:07 <dcaro> restarted nova-api on cloudcontrol100* as it was very slow [admin]
12:04 <dcaro> restarted nova-api on cloudcontrol1005 as it was very slow [admin]
2024-02-27 §
18:28 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
18:26 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
2024-02-26 §
10:02 <arturo> deleting nskaggs account from gerrit's wmcs-trusted group [admin]
2024-02-22 §
13:58 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
13:58 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
12:58 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1034.eqiad.wmnet' (T319184) [admin]
12:57 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1034.eqiad.wmnet' (T319184) [admin]
12:53 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) on host 'cloudvirt1034.eqiad.wmnet' (T319184) [admin]
12:32 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1034.eqiad.wmnet' (T319184) [admin]
11:55 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
11:54 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
09:01 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
09:00 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
2024-02-21 §
13:44 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) (T319184) [admin]
13:43 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.set_maintenance (T319184) [admin]
13:20 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T319184) [admin]
13:19 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T319184) [admin]
12:50 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1033.eqiad.wmnet' (T319184) [admin]
12:50 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1033.eqiad.wmnet' (T319184) [admin]
12:03 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1033.eqiad.wmnet' (T319184) [admin]
11:44 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1033.eqiad.wmnet' (T319184) [admin]
2024-02-20 §
11:45 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
11:45 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
11:45 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=99) [admin]
11:45 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
11:30 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.post-reimage (exit_code=0) preparing cloudvirt cloudvirt1032.eqiad.wmnet for duty (nova discovery, canary VM) Pending aggregates though. (T319184) [admin]
11:30 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.post-reimage preparing cloudvirt cloudvirt1032.eqiad.wmnet for duty (nova discovery, canary VM) Pending aggregates though. (T319184) [admin]
2024-02-19 §
12:33 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.post-reimage (exit_code=99) preparing cloudvirt cloudvirt1032.eqiad.wmnet for duty (nova discovery, canary VM) Pending aggregates though. (T319184) [admin]
12:32 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.post-reimage preparing cloudvirt cloudvirt1032.eqiad.wmnet for duty (nova discovery, canary VM) Pending aggregates though. (T319184) [admin]
12:02 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.post-reimage (exit_code=99) preparing cloudvirt cloudvirt1032.eqiad.wmnet for duty (nova discovery, canary VM) Pending aggregates though. (T319184) [admin]
12:02 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.post-reimage preparing cloudvirt cloudvirt1032.eqiad.wmnet for duty (nova discovery, canary VM) Pending aggregates though. (T319184) [admin]
12:00 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.post-reimage (exit_code=99) preparing cloudvirt cloudvirt1032.eqiad.wmnet for duty (nova discovery, canary VM) Pending aggregates though. (T319184) [admin]
12:00 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.post-reimage preparing cloudvirt cloudvirt1032.eqiad.wmnet for duty (nova discovery, canary VM) Pending aggregates though. (T319184) [admin]
10:09 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.pre-reimage (exit_code=0) prepare cloudvirt1032.eqiad.wmnet for reimage (drain, remove nova agent, etc) (T319184) [admin]
09:52 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.pre-reimage prepare cloudvirt1032.eqiad.wmnet for reimage (drain, remove nova agent, etc) (T319184) [admin]
09:49 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.pre-reimage (exit_code=99) prepare cloudvirt1032.eqiad.wmnet for reimage (drain, remove nova agent, etc) (T319184) [admin]
09:49 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.pre-reimage prepare cloudvirt1032.eqiad.wmnet for reimage (drain, remove nova agent, etc) (T319184) [admin]
2024-02-15 §
17:34 <wmbot~fran@wmf3169> START - Cookbook wmcs.openstack.roll_reboot_cloudnets (T356975) [admin]
15:34 <taavi> restart radosgw in eqiad as I am seeing 500 errors [admin]
14:22 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
14:22 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]