| 
      
        2024-11-18
      
      ยง
     | 
  
    
  | 21:15 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['es2042'] | 
  [production] | 
            
  | 21:15 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['es2042'] | 
  [production] | 
            
  | 21:15 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['es2041'] | 
  [production] | 
            
  | 21:15 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['es2041'] | 
  [production] | 
            
  | 21:14 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es2042.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 21:11 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es2044.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 21:11 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es2045.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 21:10 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es2043.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 21:10 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es2041.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 21:03 | 
  <jhathaway@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 21:01 | 
  <jhathaway@cumin2002> | 
  END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host thanos-be2005.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 21:01 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es2046.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 20:52 | 
  <jhathaway@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 20:51 | 
  <jhathaway@cumin2002> | 
  END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host thanos-be2005.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 20:51 | 
  <jhathaway@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 20:49 | 
  <jhathaway> | 
  disabling auto-reboot on re-imaging for debugging | 
  [production] | 
            
  | 20:49 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host maps-test2001.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 20:39 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hosts.provision for host es2046.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 20:39 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hosts.provision for host es2045.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 20:39 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hosts.provision for host es2044.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 20:39 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hosts.provision for host es2043.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 20:39 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hosts.provision for host es2042.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 20:39 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hosts.provision for host es2041.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 20:39 | 
  <jhathaway@cumin2002> | 
  END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host thanos-be2005.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 20:37 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 20:37 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding es2041 to codfw - jhancock@cumin2002" | 
  [production] | 
            
  | 20:37 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding es2041 to codfw - jhancock@cumin2002" | 
  [production] | 
            
  | 20:33 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 20:29 | 
  <jhathaway@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 20:23 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase2037.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 20:23 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | 
  [production] | 
            
  | 20:19 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | 
  [production] | 
            
  | 20:19 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host elastic2112.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 20:19 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | 
  [production] | 
            
  | 20:14 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | 
  [production] | 
            
  | 20:12 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host elastic2113.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 20:12 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | 
  [production] | 
            
  | 20:11 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | 
  [production] | 
            
  | 20:00 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on restbase2037.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 19:57 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on restbase2037.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 19:57 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on elastic2112.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 19:56 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2163.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 19:56 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | 
  [production] | 
            
  | 19:55 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | 
  [production] | 
            
  | 19:55 | 
  <ebernhardson@deploy2002> | 
  Finished deploy [airflow-dags/search@594d3b5]: T377153 Release glent 0.3.5 (duration: 00m 27s) | 
  [production] | 
            
  | 19:54 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on elastic2113.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 19:54 | 
  <ebernhardson@deploy2002> | 
  Started deploy [airflow-dags/search@594d3b5]: T377153 Release glent 0.3.5 | 
  [production] | 
            
  | 19:52 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on elastic2112.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 19:51 | 
  <jhancock@cumin2002> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on elastic2113.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 19:37 | 
  <jhancock@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2163.codfw.wmnet with reason: host reimage | 
  [production] |