8101-8150 of 10000 results (133ms)
2024-09-23 §
08:16 <jiji@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2424 to wikikube-worker2124 - jiji@cumin1002" [production]
08:16 <elukey> elukey@puppetmaster1001:~$ sudo puppet cert destroy performance.discovery.wmnet [production]
08:12 <jiji@cumin1002> START - Cookbook sre.dns.netbox [production]
08:12 <jiji@cumin1002> START - Cookbook sre.hosts.rename from mw2424 to wikikube-worker2124 [production]
08:08 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . [production]
07:53 <elukey@cumin1002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts poolcounter1004.eqiad.wmnet [production]
07:52 <elukey@cumin1002> START - Cookbook sre.hosts.decommission for hosts poolcounter1004.eqiad.wmnet [production]
2024-09-22 §
13:16 <cmooney@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on cr3-ulsfo,cr3-ulsfo IPv6,cr3-ulsfo.mgmt with reason: cr3-ulsfo fpc restart and hw instability [production]
13:16 <cmooney@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on cr3-ulsfo,cr3-ulsfo IPv6,cr3-ulsfo.mgmt with reason: cr3-ulsfo fpc restart and hw instability [production]
13:15 <vgutierrez> depooled ulsfo due to cr3-ulsfo issues [production]
13:14 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool site ulsfo [reason: cr3-ulsfo issues, no task ID specified] [production]
13:14 <vgutierrez@cumin1002> START - Cookbook sre.dns.admin DNS admin: depool site ulsfo [reason: cr3-ulsfo issues, no task ID specified] [production]
2024-09-20 §
23:38 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host db1246.eqiad.wmnet with OS bullseye [production]
23:02 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host ganeti1040.eqiad.wmnet with OS bookworm [production]
23:01 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1040.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
23:01 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1040.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:59 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1039.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:59 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1039.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:31 <dwisehaupt@cumin1002> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
21:31 <dwisehaupt@cumin1002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: decommission frlog2001 and frpm2001 - dwisehaupt@cumin1002" [production]
21:31 <dwisehaupt@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: decommission frlog2001 and frpm2001 - dwisehaupt@cumin1002" [production]
21:24 <dwisehaupt@cumin1002> START - Cookbook sre.dns.netbox [production]
19:28 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logging-hd2004.codfw.wmnet with OS bookworm [production]
19:28 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logging-hd2005.codfw.wmnet with OS bookworm [production]
19:28 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
19:28 <jhancock@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
18:42 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
18:36 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
18:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logging-hd2005.codfw.wmnet with reason: host reimage [production]
18:18 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on logging-hd2005.codfw.wmnet with reason: host reimage [production]
18:16 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logging-hd2004.codfw.wmnet with reason: host reimage [production]
18:12 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on logging-hd2004.codfw.wmnet with reason: host reimage [production]
17:46 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host logging-hd2005.codfw.wmnet with OS bookworm [production]
17:41 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host logging-hd2004.codfw.wmnet with OS bookworm [production]
17:37 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host logging-hd2005 [production]
17:37 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host logging-hd2005 [production]
17:37 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host logging-hd2004 [production]
17:37 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host logging-hd2004 [production]
17:34 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host logging-hd2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:31 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host logging-hd2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:29 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:29 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding logging-hd2005 to codfw - jhancock@cumin2002" [production]
17:29 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding logging-hd2005 to codfw - jhancock@cumin2002" [production]
17:25 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
17:23 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:20 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:18 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:18 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding logging-hd2004 to codfw - jhancock@cumin2002" [production]
17:18 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding logging-hd2004 to codfw - jhancock@cumin2002" [production]
17:13 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]