| 2023-11-10
      
      ยง | 
    
  | 16:59 | <andrew@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1063.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:59 | <andrew@cumin1001> | END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cloudvirt1067.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:58 | <andrew@cumin1001> | END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cloudvirt1064.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:56 | <andrew@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1065.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:54 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1063.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:54 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1067.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:54 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1066.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:53 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1064.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:53 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1065.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:51 | <cmooney@cumin1001> | END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1001.eqiad.wmnet with reason: Release v0.6.4 - cmooney@cumin1001 | [production] | 
            
  | 16:49 | <cmooney@cumin1001> | START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1001.eqiad.wmnet with reason: Release v0.6.4 - cmooney@cumin1001 | [production] | 
            
  | 16:39 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1064.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:39 | <andrew@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=93) for host cloudvirt1064.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:39 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1066.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:39 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1065.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:38 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1063.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:38 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1067.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:38 | <andrew@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=93) for host cloudvirt1066.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:38 | <andrew@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=93) for host cloudvirt1065.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:38 | <andrew@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=93) for host cloudvirt1063.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:38 | <andrew@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=93) for host cloudvirt1067.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:36 | <cmooney@cumin1001> | END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cloudvirt1062.private.eqiad.wikimedia.cloud on all recursors | [production] | 
            
  | 16:36 | <cmooney@cumin1001> | START - Cookbook sre.dns.wipe-cache cloudvirt1062.private.eqiad.wikimedia.cloud on all recursors | [production] | 
            
  | 16:34 | <cmooney@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:34 | <cmooney@cumin1001> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add cloud-private subnet entries for new cloudvirt hosts - cmooney@cumin1001" | [production] | 
            
  | 16:33 | <cmooney@cumin1001> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add cloud-private subnet entries for new cloudvirt hosts - cmooney@cumin1001" | [production] | 
            
  | 16:31 | <cmooney@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:31 | <cmooney@cumin1001> | END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | [production] | 
            
  | 16:29 | <andrew@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1067.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:29 | <cmooney@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:27 | <andrew@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1066.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:25 | <andrew@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1065.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:24 | <andrew@cumin1001> | END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cloudvirt1064.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:24 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1066.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:23 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1067.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:22 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1064.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:22 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1065.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:20 | <andrew@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1063.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:18 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1063.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:12 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1067.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:11 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1066.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:10 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1065.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:10 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1064.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:06 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1063.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:54 | <andrew@cumin1001> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1062.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:38 | <andrew@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1062.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 15:36 | <andrew@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1062.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 15:23 | <andrew@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudvirt1062.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:15 | <denisse@deploy2002> | Finished deploy [librenms/librenms@f049593]: Upgrade LibreNMS to v23.10.0 - T349492 (duration: 00m 10s) | [production] | 
            
  | 14:15 | <denisse@deploy2002> | Started deploy [librenms/librenms@f049593]: Upgrade LibreNMS to v23.10.0 - T349492 | [production] |