501-550 of 10000 results (73ms)
2024-02-09 ยง
13:07 <jclark@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['restbase1039'] [production]
13:07 <jclark@cumin1002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['restbase1034'] [production]
13:07 <jclark@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['restbase1034'] [production]
13:06 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:06 <cmooney@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add new entries for puppetserver2003 - cmooney@cumin1002" [production]
13:05 <cmooney@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add new entries for puppetserver2003 - cmooney@cumin1002" [production]
13:03 <jclark@cumin1002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['restbase1034'] [production]
13:03 <jclark@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['restbase1034'] [production]
13:02 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
13:00 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host restbase1035.mgmt.eqiad.wmnet with reboot policy FORCED [production]
13:00 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host restbase1040.mgmt.eqiad.wmnet with reboot policy FORCED [production]
13:00 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host restbase1041.mgmt.eqiad.wmnet with reboot policy FORCED [production]
13:00 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host restbase1034.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:59 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host restbase1038.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:59 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host restbase1037.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:58 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host restbase1039.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:57 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host restbase1042.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:50 <stran@deploy2002> helmfile [codfw] DONE helmfile.d/services/ipoid: apply [production]
12:49 <stran@deploy2002> helmfile [codfw] START helmfile.d/services/ipoid: apply [production]
12:49 <stran@deploy2002> helmfile [eqiad] DONE helmfile.d/services/ipoid: apply [production]
12:48 <stran@deploy2002> helmfile [eqiad] START helmfile.d/services/ipoid: apply [production]
12:47 <stran@deploy2002> helmfile [staging] DONE helmfile.d/services/ipoid: apply [production]
12:47 <stran@deploy2002> helmfile [staging] START helmfile.d/services/ipoid: apply [production]
12:47 <stran@deploy2002> helmfile [staging] DONE helmfile.d/services/ipoid: apply [production]
12:45 <stran@deploy2002> helmfile [staging] START helmfile.d/services/ipoid: apply [production]
12:45 <stran@deploy2002> helmfile [staging] DONE helmfile.d/services/ipoid: apply [production]
12:44 <stran@deploy2002> helmfile [staging] START helmfile.d/services/ipoid: apply [production]
12:43 <mvernon@cumin2002> END (FAIL) - Cookbook sre.swift.convert-disks (exit_code=99) for host ms-be1044 [production]
12:36 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:36 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: puppetmaster2003 rename - jmm@cumin2002" [production]
12:35 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: puppetmaster2003 rename - jmm@cumin2002" [production]
12:35 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1034.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:35 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1035.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:33 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
12:32 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1037.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:31 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host restbase1037.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:31 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1037.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:30 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1039.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:30 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1040.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:28 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1041.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:27 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host restbase1041.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:27 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host restbase1040.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:27 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host restbase1037.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:26 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host restbase1039.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:26 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1037.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:26 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1038.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:26 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1039.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:26 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1040.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:26 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1041.mgmt.eqiad.wmnet with reboot policy FORCED [production]
12:26 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host restbase1042.mgmt.eqiad.wmnet with reboot policy FORCED [production]