3051-3100 of 7785 results (12ms)
2025-03-03 §
23:01 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host elastic1109.eqiad.wmnet with OS bullseye [production]
22:52 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host elastic1108.eqiad.wmnet with OS bullseye [production]
22:24 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host elastic1110.eqiad.wmnet with OS bullseye [production]
22:21 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from relforge1007 to elastic1110 [production]
22:20 <bking@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host elastic1110 [production]
22:20 <bking@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host elastic1110 [production]
22:20 <bking@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:20 <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming relforge1007 to elastic1110 - bking@cumin2002" [production]
22:20 <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming relforge1007 to elastic1110 - bking@cumin2002" [production]
22:12 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
22:08 <bking@cumin2002> START - Cookbook sre.hosts.rename from relforge1007 to elastic1110 [production]
22:02 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host elastic1109.eqiad.wmnet with OS bullseye [production]
22:01 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from relforge1006 to elastic1109 [production]
22:00 <bking@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host elastic1109 [production]
22:00 <bking@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host elastic1109 [production]
22:00 <bking@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:00 <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming relforge1006 to elastic1109 - bking@cumin2002" [production]
22:00 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 16:00:00 on relforge[1003-1004,1006-1007].eqiad.wmnet with reason: T387782 [production]
21:59 <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming relforge1006 to elastic1109 - bking@cumin2002" [production]
21:56 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
21:55 <bking@cumin2002> START - Cookbook sre.hosts.rename from relforge1006 to elastic1109 [production]
21:54 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host elastic1108.eqiad.wmnet with OS bullseye [production]
21:52 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from relforge1005 to elastic1108 [production]
21:51 <bking@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host elastic1108 [production]
21:51 <bking@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host elastic1108 [production]
21:51 <bking@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:51 <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming relforge1005 to elastic1108 - bking@cumin2002" [production]
21:50 <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming relforge1005 to elastic1108 - bking@cumin2002" [production]
21:45 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
21:44 <bking@cumin2002> START - Cookbook sre.hosts.rename from relforge1005 to elastic1108 [production]
21:44 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.rename (exit_code=99) from relforge1006 to elastic1109 [production]
21:44 <bking@cumin2002> END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) [production]
21:43 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.rename (exit_code=99) from relforge1005 to elastic1108 [production]
21:43 <bking@cumin2002> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
21:42 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
21:38 <bking@cumin2002> START - Cookbook sre.hosts.rename from relforge1006 to elastic1109 [production]
21:37 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
21:36 <bking@cumin2002> START - Cookbook sre.hosts.rename from relforge1005 to elastic1108 [production]
19:26 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: reforge1005*,relforge1006*,relforge1007* for ban hosts prior to revert - bking@cumin2002 - T387176 [production]
19:26 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: reforge1005*,relforge1006*,relforge1007* for ban hosts prior to revert - bking@cumin2002 - T387176 [production]
14:52 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_eqiad [production]
14:52 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_eqiad [production]
14:44 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host elastic1066.eqiad.wmnet [production]
14:21 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: elastic1066* for ban elastic1066 to hopefully stop rejections - bking@cumin2002 - T387176 [production]
14:21 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: elastic1066* for ban elastic1066 to hopefully stop rejections - bking@cumin2002 - T387176 [production]
2025-02-28 §
22:30 <inflatador> bking@elastic1103 restart elastic-chi to apply thread pool settings T387176 [production]
22:13 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_eqiad [production]
22:13 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_eqiad [production]
22:02 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: elastic1103*,elastic1107* for ban hosts to change threadpool settings - bking@cumin2002 - T387176 [production]
22:02 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: elastic1103*,elastic1107* for ban hosts to change threadpool settings - bking@cumin2002 - T387176 [production]