951-1000 of 10000 results (103ms)
2024-10-08 ยง
16:26 <sukhe@cumin1002> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on A:lvs-low-traffic-eqiad [production]
16:25 <sukhe@cumin1002> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on A:lvs-low-traffic-eqiad [production]
16:24 <sukhe@cumin1002> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on A:lvs-secondary-eqiad [production]
16:23 <sukhe@cumin1002> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on A:lvs-secondary-eqiad [production]
16:13 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
16:09 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
16:08 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudlb2004-dev [production]
16:08 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cloudlb2004-dev [production]
16:08 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
16:08 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
16:06 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
16:06 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host cloudlb2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTARTand with Dell SCP reboot policy FORCED [production]
16:06 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudlb2004-dev [production]
16:06 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cloudlb2004-dev [production]
16:06 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:05 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding mc-misc2001 to codfw - jhancock@cumin2002" [production]
16:05 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding mc-misc2001 to codfw - jhancock@cumin2002" [production]
16:02 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
15:41 <papaul> mr1-magru end of maintenance [production]
15:34 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f7-eqiad [production]
15:34 <ayounsi@cumin1002> START - Cookbook sre.network.tls for network device lsw1-f7-eqiad [production]
15:34 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e7-eqiad [production]
15:34 <ayounsi@cumin1002> START - Cookbook sre.network.tls for network device lsw1-e7-eqiad [production]
15:34 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e6-eqiad [production]
15:34 <ayounsi@cumin1002> START - Cookbook sre.network.tls for network device lsw1-e6-eqiad [production]
15:34 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f6-eqiad [production]
15:33 <ayounsi@cumin1002> START - Cookbook sre.network.tls for network device lsw1-f6-eqiad [production]
15:33 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f5-eqiad [production]
15:33 <ayounsi@cumin1002> START - Cookbook sre.network.tls for network device lsw1-f5-eqiad [production]
15:33 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudlb2004-dev.codfw.wmnet with OS bookworm [production]
15:32 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e5-eqiad [production]
15:32 <ayounsi@cumin1002> START - Cookbook sre.network.tls for network device lsw1-e5-eqiad [production]
15:31 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cloudlb2004-dev'] [production]
15:26 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudlb2004-dev'] [production]
15:20 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cloudlb2004-dev'] [production]
15:19 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudlb2004-dev'] [production]
15:19 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cloudlb2004-dev'] [production]
15:19 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudlb2004-dev'] [production]
15:05 <brennen@deploy2002> Finished deploy [phabricator/deployment@40a63c9]: deploy phab1004 for T376720 (duration: 01m 07s) [production]
15:04 <brennen@deploy2002> Started deploy [phabricator/deployment@40a63c9]: deploy phab1004 for T376720 [production]
15:03 <brennen@deploy2002> Finished deploy [phabricator/deployment@40a63c9]: test deploy phab2002 for T376720 (duration: 00m 26s) [production]
15:03 <brennen@deploy2002> Started deploy [phabricator/deployment@40a63c9]: test deploy phab2002 for T376720 [production]
15:02 <dzahn@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:30:00 on phab.wmfusercontent.org with reason: version upgrade [production]
15:02 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab.wmfusercontent.org with reason: version upgrade [production]
15:02 <dzahn@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:30:00 on phabricator.wikimedia.org with reason: version upgrade [production]
15:02 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on phabricator.wikimedia.org with reason: version upgrade [production]
15:02 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab2002.codfw.wmnet with reason: version upgrade [production]
15:02 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab2002.codfw.wmnet with reason: version upgrade [production]
15:01 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab1004.eqiad.wmnet with reason: version upgrade [production]
15:01 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab1004.eqiad.wmnet with reason: version upgrade [production]