| 2023-11-21
      
      ยง | 
    
  | 17:40 | <jclark@cumin1001> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1171'] | [production] | 
            
  | 17:40 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1171'] | [production] | 
            
  | 17:40 | <jclark@cumin1001> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1171'] | [production] | 
            
  | 17:40 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1171'] | [production] | 
            
  | 17:40 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1170'] | [production] | 
            
  | 17:39 | <jclark@cumin1001> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1164'] | [production] | 
            
  | 17:39 | <jclark@cumin1001> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1165'] | [production] | 
            
  | 17:38 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1169'] | [production] | 
            
  | 17:38 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1168'] | [production] | 
            
  | 17:38 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1167'] | [production] | 
            
  | 17:38 | <jclark@cumin1001> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1160'] | [production] | 
            
  | 17:38 | <jclark@cumin1001> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1159'] | [production] | 
            
  | 17:37 | <jclark@cumin1001> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-worker1163'] | [production] | 
            
  | 17:33 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1166'] | [production] | 
            
  | 17:33 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1165'] | [production] | 
            
  | 17:32 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1164'] | [production] | 
            
  | 17:32 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['an-worker1162'] | [production] | 
            
  | 17:32 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['an-worker1161'] | [production] | 
            
  | 17:32 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1163'] | [production] | 
            
  | 17:32 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1162'] | [production] | 
            
  | 17:32 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1161'] | [production] | 
            
  | 17:31 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1160'] | [production] | 
            
  | 17:31 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1159'] | [production] | 
            
  | 17:31 | <jclark@cumin1001> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-worker1158'] | [production] | 
            
  | 17:30 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1171.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:29 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1174.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:29 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1170.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:29 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1173.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:29 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1172.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:29 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1169.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:29 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1173.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:29 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1174.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:29 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1171.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:29 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1170.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:28 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1169.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:28 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1172.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:27 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1166.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:27 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1164.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:27 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1168.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:27 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1163.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:27 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1167.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:26 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1165.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:26 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1168.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:26 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1167.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:26 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1166.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:26 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1165.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:26 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1164.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:25 | <jclark@cumin1001> | START - Cookbook sre.hosts.provision for host an-worker1163.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:25 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1161.mgmt.eqiad.wmnet with reboot policy FORCED | [production] | 
            
  | 17:25 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host an-worker1162.mgmt.eqiad.wmnet with reboot policy FORCED | [production] |