2023-05-10
§
|
15:53 |
<wm-bot2> |
Restarting openstack services on cloudvirt1036: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:53 |
<wm-bot2> |
Restarting openstack services on cloudvirt1034: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:53 |
<wm-bot2> |
Restarting openstack services on cloudvirt1039: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:53 |
<wm-bot2> |
Restarting openstack services on cloudvirt1037: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:53 |
<wm-bot2> |
Restarting openstack services on cloudvirt1035: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:53 |
<wm-bot2> |
Restarting openstack services on cloudvirt1033: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:53 |
<wm-bot2> |
Restarting openstack services on cloudvirt1031: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:53 |
<wm-bot2> |
Restarting openstack services on cloudvirt1032: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:52 |
<wm-bot2> |
Restarting openstack services on cloudcontrol1005: ['nova-conductor', 'nova-scheduler', 'nova-api', 'nova-api-metadata', 'cinder-volume', 'cinder-scheduler', 'neutron-api', 'neutron-rpc-server', 'trove-api', 'trove-conductor', 'trove-taskmanager', 'keystone', 'keystone-admin', 'glance-api', 'magnum-api', 'magnum-conductor', 'heat-api', 'heat-api-cfn', 'heat-engine'] - cookbook ran by andrew@bullseye |
[admin] |
15:52 |
<wm-bot2> |
Restarting openstack services on cloudvirt1028: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:52 |
<wm-bot2> |
Restarting openstack services on cloudvirt1030: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:52 |
<andrewbogott> |
running "cookbook -c ~/.config/spicerack/cookbook_config.yaml wmcs.openstack.restart_openstack --cluster-name eqiad1 --all" to pick up changes for testing T336379 |
[admin] |
15:52 |
<wm-bot2> |
Restarting openstack services on cloudvirt1027: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:52 |
<wm-bot2> |
Restarting openstack services on cloudvirt1026: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:52 |
<wm-bot2> |
Restarting openstack services on cloudvirt1029: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
15:52 |
<wm-bot2> |
Restarting openstack services on cloudvirt1025: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by andrew@bullseye |
[admin] |
03:05 |
<andrewbogott> |
"systemctl restart puppet-enc" on enc-1.cloudinfra.eqiad1.wikimedia.cloud. Seems to have crashed. |
[admin] |
2023-05-05
§
|
16:07 |
<wm-bot2> |
Drained cloudvirt1024.eqiad.wmnet (T336064) - cookbook ran by andrew@bullseye |
[admin] |
16:03 |
<wm-bot2> |
Set cloudvirt cloudvirt1024.eqiad.wmnet maintenance (downtime id: 95995009-09d6-496e-8cd2-0cfac93d3cf7, use this to unset) (T336064) - cookbook ran by andrew@bullseye |
[admin] |
16:02 |
<wm-bot2> |
Draining cloudvirt1024.eqiad.wmnet (T336064) - cookbook ran by andrew@bullseye |
[admin] |
16:01 |
<wm-bot2> |
Drained cloudvirt1023.eqiad.wmnet (T336064) - cookbook ran by andrew@bullseye |
[admin] |
15:51 |
<wm-bot2> |
Set cloudvirt cloudvirt1023.eqiad.wmnet maintenance (downtime id: 53c46cae-00af-4664-97ff-266b393335bb, use this to unset) (T336064) - cookbook ran by andrew@bullseye |
[admin] |
15:50 |
<wm-bot2> |
Draining cloudvirt1023.eqiad.wmnet (T336064) - cookbook ran by andrew@bullseye |
[admin] |
15:49 |
<wm-bot2> |
Set cloudvirt cloudvirt1024.eqiad.wmnet maintenance (downtime id: 528ea4f6-8088-475e-937f-098ffba861b6, use this to unset) - cookbook ran by andrew@bullseye |
[admin] |
15:47 |
<wm-bot2> |
Set cloudvirt cloudvirt1023.eqiad.wmnet maintenance (downtime id: 3ef85b5e-d9d9-4b24-901b-a3058a7d0615, use this to unset) - cookbook ran by andrew@bullseye |
[admin] |
15:44 |
<andrewbogott> |
moved cloudvirt1023 and cloudvirt1024 from 'ceph' aggregate to 'maintenance' aggregate, prep for decom T336064 |
[admin] |
15:44 |
<andrewbogott> |
moved cloudvirt1028 from 'localdisk' aggregate to 'maintenance' aggregate. Nothing new should be scheduled here, local storage should now move to cloudvirtlocal100x |
[admin] |
15:41 |
<andrewbogott> |
moved cloudvirt1055 and cloudvirt1056 from 'spare' to 'ceph' aggregate. Prep for removing two obsolete cloudvirts, 1023 and 1024. T336064 |
[admin] |
2023-05-02
§
|
13:01 |
<wm-bot2> |
Adding OSD cloudcephosd2001-dev.codfw.wmnet... (1/1) - cookbook ran by dcaro@vulcanus |
[admin] |
13:01 |
<wm-bot2> |
Adding new OSDs ['cloudcephosd2001-dev.codfw.wmnet'] to the cluster - cookbook ran by dcaro@vulcanus |
[admin] |
12:31 |
<wm-bot2> |
Destroying OSDs with ids in [0] on cloudcephosd2001-dev from codfw1 - cookbook ran by dcaro@vulcanus |
[admin] |
12:30 |
<wm-bot2> |
Depooling OSDs with ids in [0] on cloudcephosd2001-dev from codfw1 - cookbook ran by dcaro@vulcanus |
[admin] |
11:53 |
<wm-bot2> |
The cluster is now rebalanced after adding the new OSDs ['cloudcephosd2001-dev.codfw.wmnet'] - cookbook ran by dcaro@vulcanus |
[admin] |
11:53 |
<wm-bot2> |
Added 1 new OSDs ['cloudcephosd2001-dev.codfw.wmnet'] - cookbook ran by dcaro@vulcanus |
[admin] |
11:53 |
<wm-bot2> |
Added OSD cloudcephosd2001-dev.codfw.wmnet... (1/1) - cookbook ran by dcaro@vulcanus |
[admin] |
11:53 |
<wm-bot2> |
Adding OSD cloudcephosd2001-dev.codfw.wmnet... (1/1) - cookbook ran by dcaro@vulcanus |
[admin] |
11:52 |
<wm-bot2> |
Adding new OSDs ['cloudcephosd2001-dev.codfw.wmnet'] to the cluster - cookbook ran by dcaro@vulcanus |
[admin] |