3501-3550 of 10000 results (42ms)
2024-12-04 ยง
10:33 <brouberol@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts an-presto1004.eqiad.wmnet [production]
10:33 <moritzm> removing ganeti2018 from active Ganeti nodes T376594 [production]
10:33 <brouberol@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:30 <brouberol@cumin2002> START - Cookbook sre.dns.netbox [production]
10:30 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw2444 to wikikube-worker2172 [production]
10:30 <jayme@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2171 [production]
10:30 <jayme@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:30 <jayme@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2172 [production]
10:29 <jayme@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2172 [production]
10:29 <jayme@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:29 <jayme@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2444 to wikikube-worker2172 - jayme@cumin2002" [production]
10:28 <vgutierrez> enabling outbound bandwidth limits enforced by haproxy on the upload cluster [production]
10:28 <jayme@cumin2002> START - Cookbook sre.dns.netbox [production]
10:27 <jayme@cumin2002> END (FAIL) - Cookbook sre.hosts.rename (exit_code=93) from mw2442 to wikikube-worker2016 [production]
10:27 <jayme@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2444 to wikikube-worker2172 - jayme@cumin2002" [production]
10:27 <jayme@cumin2002> START - Cookbook sre.hosts.rename from mw2442 to wikikube-worker2016 [production]
10:23 <jayme@cumin2002> END (FAIL) - Cookbook sre.hosts.rename (exit_code=93) from mw2442 to wikikube-worker2016 [production]
10:23 <jayme@cumin2002> START - Cookbook sre.hosts.rename from mw2442 to wikikube-worker2016 [production]
10:23 <jayme@cumin2002> START - Cookbook sre.dns.netbox [production]
10:23 <jayme@cumin2002> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
10:22 <jayme@cumin2002> START - Cookbook sre.hosts.rename from mw2444 to wikikube-worker2172 [production]
10:22 <jayme@cumin2002> START - Cookbook sre.hosts.rename from mw2443 to wikikube-worker2171 [production]
10:22 <jayme@cumin2002> END (FAIL) - Cookbook sre.hosts.rename (exit_code=93) from mw2442 to wikikube-worker20160 [production]
10:22 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be1086.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
10:22 <jayme@cumin2002> START - Cookbook sre.hosts.rename from mw2442 to wikikube-worker20160 [production]
10:22 <brouberol@cumin2002> START - Cookbook sre.hosts.decommission for hosts an-presto1004.eqiad.wmnet [production]
10:21 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1086.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
10:21 <jayme@cumin2002> START - Cookbook sre.dns.netbox [production]
10:20 <jayme@cumin2002> START - Cookbook sre.hosts.rename from mw2440 to wikikube-worker2015 [production]
10:19 <brouberol@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts an-presto1003.eqiad.wmnet [production]
10:19 <brouberol@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:19 <brouberol@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: an-presto1003.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brouberol@cumin2002" [production]
10:19 <elukey@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1086.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
10:19 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1086.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
10:19 <elukey@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1086.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
10:19 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1086.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
10:13 <brouberol@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: an-presto1003.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brouberol@cumin2002" [production]
10:10 <brouberol@cumin2002> START - Cookbook sre.dns.netbox [production]
10:09 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 8 hosts with reason: Rebooting [production]
10:09 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on 8 hosts with reason: Rebooting [production]
10:04 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2018.codfw.wmnet [production]
10:04 <brouberol@cumin2002> START - Cookbook sre.hosts.decommission for hosts an-presto1003.eqiad.wmnet [production]
10:03 <brouberol@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts an-presto1002.eqiad.wmnet [production]
10:03 <brouberol@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:03 <brouberol@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: an-presto1002.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brouberol@cumin2002" [production]
10:02 <brouberol@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: an-presto1002.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brouberol@cumin2002" [production]
09:58 <brouberol@cumin2002> START - Cookbook sre.dns.netbox [production]
09:56 <godog> bump space for prometheus k8s-mlserve in eqiad [production]
09:50 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2444.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
09:50 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2443.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]