| 
      
        2025-08-14
      
      §
     | 
  
    
  | 15:53 | 
  <raymond-ndibe@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli | 
  [tools] | 
            
  | 15:44 | 
  <raymond-ndibe@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli | 
  [tools] | 
            
  | 15:15 | 
  <raymond-ndibe@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | 
  [tools] | 
            
  | 15:03 | 
  <raymond-ndibe@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | 
  [tools] | 
            
  | 11:38 | 
  <wmbot~dcaro@acme> | 
  END (FAIL) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=99) for tools-k8s-worker-107, tools-k8s-worker-nfs-11, tools-k8s-worker-nfs-16, tools-k8s-worker-nfs-3, tools-k8s-worker-nfs-41 | 
  [tools] | 
            
  | 11:38 | 
  <wmbot~dcaro@acme> | 
  START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers for tools-k8s-worker-107, tools-k8s-worker-nfs-11, tools-k8s-worker-nfs-16, tools-k8s-worker-nfs-3, tools-k8s-worker-nfs-41 | 
  [tools] | 
            
  | 11:33 | 
  <wmbot~dcaro@acme> | 
  END (PASS) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=0) no stuck workers found | 
  [tools] | 
            
  | 11:33 | 
  <wmbot~dcaro@acme> | 
  START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers no stuck workers found | 
  [tools] | 
            
  | 02:30 | 
  <raymond-ndibe@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | 
  [tools] | 
            
  | 02:19 | 
  <raymond-ndibe@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | 
  [tools] | 
            
  
    | 
      
        2025-08-13
      
      §
     | 
  
    
  | 16:36 | 
  <dcaro> | 
  reverting jobs-api release (T401846) | 
  [tools] | 
            
  | 11:18 | 
  <taavi> | 
  delete tools-prometheus-6, shutdown for a while | 
  [tools] | 
            
  | 08:51 | 
  <godog> | 
  bounce stashbot | 
  [tools] | 
            
  | 08:33 | 
  <godog> | 
  refresh machine-id on tools-k8s-worker-[102-103,105-112].tools.eqiad1.wikimedia.cloud,tools-k8s-worker-nfs-[1-3,5,7-14,16-17,19,21-24,26-27,32-48,50,53-55 ,57-58,61,65-82].tools.eqiad1.wikimedia.cloud | 
  [tools] | 
            
  
    | 
      
        2025-08-12
      
      §
     | 
  
    
  | 16:04 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component image-config | 
  [tools] | 
            
  | 16:04 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component image-config | 
  [tools] | 
            
  | 15:34 | 
  <taavi> | 
  building initial trixie based images T400255 | 
  [tools] | 
            
  | 12:50 | 
  <dcaro> | 
  redepoly kyverno (T394787) | 
  [tools] | 
            
  | 12:49 | 
  <dcaro> | 
  manually migrate cleanuppolicies.kyverno.io and clustercleanuppolicies.kyverno.io (using kyverno cli) (T394787) | 
  [tools] | 
            
  | 10:01 | 
  <dcaro> | 
  starting upgrade for kyverno (T394787) | 
  [tools] | 
            
  | 10:00 | 
  <wmbot~dcaro@acme> | 
  END (PASS) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=0) for tools-k8s-worker-103, tools-k8s-worker-nfs-36 | 
  [tools] | 
            
  | 09:54 | 
  <wmbot~dcaro@acme> | 
  START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers for tools-k8s-worker-103, tools-k8s-worker-nfs-36 | 
  [tools] | 
            
  | 09:53 | 
  <wmbot~dcaro@acme> | 
  END (PASS) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=0) for tools-k8s-worker-103, tools-k8s-worker-nfs-36 | 
  [tools] | 
            
  | 09:53 | 
  <wmbot~dcaro@acme> | 
  START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers for tools-k8s-worker-103, tools-k8s-worker-nfs-36 | 
  [tools] | 
            
  | 09:52 | 
  <wmbot~dcaro@acme> | 
  END (PASS) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=0) for tools-k8s-worker-103, tools-k8s-worker-nfs-36 | 
  [tools] | 
            
  | 09:52 | 
  <wmbot~dcaro@acme> | 
  START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers for tools-k8s-worker-103, tools-k8s-worker-nfs-36 | 
  [tools] | 
            
  | 03:21 | 
  <raymond-ndibe@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-cli | 
  [tools] | 
            
  | 03:19 | 
  <raymond-ndibe@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component builds-cli | 
  [tools] | 
            
  
    | 
      
        2025-08-11
      
      §
     | 
  
    
  | 12:37 | 
  <dcaro@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api | 
  [tools] | 
            
  | 12:32 | 
  <dcaro@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component components-api | 
  [tools] | 
            
  | 12:16 | 
  <dcaro@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-cli | 
  [tools] | 
            
  | 12:12 | 
  <dcaro@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component components-cli | 
  [tools] | 
            
  | 10:26 | 
  <dcaro@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api | 
  [tools] | 
            
  | 10:21 | 
  <dcaro@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.component.deploy for component components-api | 
  [tools] | 
            
  | 08:46 | 
  <dcaro@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on tools-harbor-2.tools.eqiad1.wikimedia.cloud | 
  [tools] | 
            
  | 08:44 | 
  <dcaro@cloudcumin1001> | 
  START - Cookbook wmcs.vps.refresh_puppet_certs on tools-harbor-2.tools.eqiad1.wikimedia.cloud | 
  [tools] | 
            
  | 08:37 | 
  <dcaro@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-39, tools-k8s-worker-nfs-58 | 
  [tools] | 
            
  | 08:26 | 
  <dcaro@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-39, tools-k8s-worker-nfs-58 | 
  [tools] |