| 
      
        2021-03-09
      
      §
     | 
  
    
  | 16:27 | 
  <arturo> | 
  rebooting cloudvirt1027 (T275753) | 
  [admin] | 
            
  | 13:38 | 
  <arturo> | 
  draining cloudvrit1027 for T275753 | 
  [admin] | 
            
  | 13:35 | 
  <arturo> | 
  icinga-downtime cloudvirt1038 for 30 days for T276922 | 
  [admin] | 
            
  | 13:21 | 
  <arturo> | 
  add cloudvirt1039 to the ceph host aggregate (no longer a spare, we have cloudvirt1038 with HW failures) | 
  [admin] | 
            
  | 12:52 | 
  <arturo> | 
  cloudvirt1038 hard powerdown / powerup for T276922 | 
  [admin] | 
            
  | 12:33 | 
  <arturo> | 
  rebooting cloudvirt1038 (T275753) | 
  [admin] | 
            
  | 10:58 | 
  <arturo> | 
  draining cloudvirt1038 (T275753) | 
  [admin] | 
            
  | 10:54 | 
  <arturo> | 
  rebooting cloudvirt1037 (T275753) | 
  [admin] | 
            
  | 09:59 | 
  <arturo> | 
  draining cloudvirt1037 (T275753) | 
  [admin] | 
            
  | 09:12 | 
  <dcaro> | 
  restarted the wmcs-backup service on cloudvirt1024 to retry the backups (failed because a VM was removed in-between, T276892) | 
  [admin] | 
            
  
    | 
      
        2021-03-04
      
      §
     | 
  
    
  | 18:36 | 
  <andrewbogott> | 
  rebooting cloudmetrics1002; the console is hanging | 
  [admin] | 
            
  | 16:59 | 
  <arturo> | 
  rebooting cloudvirt1032 for T275753 | 
  [admin] | 
            
  | 16:34 | 
  <arturo> | 
  draining cloudvirt1032 for T275753 | 
  [admin] | 
            
  | 16:33 | 
  <arturo> | 
  rebooting cloudvirt1031 for T275753 | 
  [admin] | 
            
  | 16:11 | 
  <arturo> | 
  draining cloudvirt1031 for T275753 | 
  [admin] | 
            
  | 16:09 | 
  <arturo> | 
  rebooting cloudvirt1026 for T275753 | 
  [admin] | 
            
  | 15:57 | 
  <arturo> | 
  draining cloudvirt1026 for T275753 | 
  [admin] | 
            
  | 15:55 | 
  <arturo> | 
  rebooting cloudvirt1025 for T275753 | 
  [admin] | 
            
  | 15:41 | 
  <arturo> | 
  draining cloudvirt1025 for T275753 | 
  [admin] | 
            
  | 15:12 | 
  <arturo> | 
  rebooting cloudvirt1024 for T275753 | 
  [admin] | 
            
  | 11:29 | 
  <arturo> | 
  draining cloudvirt1024 for T275753 | 
  [admin] | 
            
  | 11:24 | 
  <dcaro> | 
  rebooted cloudvirt1022, re-adding to ceph and removing from maintenance host aggregate for T275753 | 
  [admin] | 
            
  | 11:01 | 
  <dcaro> | 
  rebooting cloudvirt1022 for T275753 | 
  [admin] | 
            
  | 09:12 | 
  <dcaro> | 
  draining cloudvirt1022 for T275753 | 
  [admin] | 
            
  
    | 
      
        2021-03-03
      
      §
     | 
  
    
  | 17:16 | 
  <andrewbogott> | 
  restarting rabbitmq-server on cloudcontrol1003,1004,1005; trying to explain amqp errors in scheduler logs | 
  [admin] | 
            
  | 16:03 | 
  <dcaro> | 
  draining cloudvirt1022 for T275753 | 
  [admin] | 
            
  | 16:03 | 
  <dcaro> | 
  draining cloudvirt1022 for TT275753 | 
  [admin] | 
            
  | 16:00 | 
  <arturo> | 
  move cloudvirt1013 into the 'toobusy' host aggregate, it has 221% cpu subscription and 82% MEM subscription | 
  [admin] | 
            
  | 15:34 | 
  <arturo> | 
  rebooting cloudvirt1021 for T275753 | 
  [admin] | 
            
  | 14:31 | 
  <arturo> | 
  draining cloudvirt1021 for T275753 | 
  [admin] | 
            
  | 13:59 | 
  <arturo> | 
  rebooting cloudvirt1018 for T275753 | 
  [admin] | 
            
  | 13:28 | 
  <arturo> | 
  draining cloudvirt1018 for T275753 | 
  [admin] | 
            
  | 12:49 | 
  <arturo> | 
  rebooting cloudvirt1017 for T275753 | 
  [admin] | 
            
  | 12:22 | 
  <arturo> | 
  draining cloudvirt1017 for T275753 | 
  [admin] | 
            
  | 12:20 | 
  <arturo> | 
  rebooting cloudvirt1016 for T275753 | 
  [admin] | 
            
  | 12:01 | 
  <arturo> | 
  draining cloudvirt1016 for T275753 | 
  [admin] | 
            
  | 11:59 | 
  <arturo> | 
  cloudvirt1014 now in the ceph host aggregate | 
  [admin] |