6401-6450 of 10000 results (32ms)
2025-05-05 §
00:06 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.depool_and_destroy [admin]
00:05 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) [admin]
00:05 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.depool_and_destroy [admin]
00:03 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) [admin]
00:03 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
00:03 <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=97) [admin]
00:03 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
00:02 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=99) [admin]
00:02 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
2025-05-04 §
23:53 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) [admin]
23:53 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
23:27 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudcephosd1003.eqiad.wmnet [production]
23:27 <andrew@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudcephosd1003.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]
23:27 <andrew@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
23:27 <andrew@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudcephosd1003.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]
23:22 <andrew@cumin1002> START - Cookbook sre.dns.netbox [production]
23:16 <andrew@cumin1002> START - Cookbook sre.hosts.decommission for hosts cloudcephosd1003.eqiad.wmnet [production]
23:15 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudcephosd1002.eqiad.wmnet [production]
23:15 <andrew@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
23:15 <andrew@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudcephosd1002.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]
23:14 <andrew@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudcephosd1002.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]
23:08 <andrew@cumin1002> START - Cookbook sre.dns.netbox [production]
23:02 <andrew@cumin1002> START - Cookbook sre.hosts.decommission for hosts cloudcephosd1002.eqiad.wmnet [production]
23:02 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudcephosd1001.eqiad.wmnet [production]
23:02 <andrew@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
23:02 <andrew@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudcephosd1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]
23:01 <andrew@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudcephosd1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" [production]
22:57 <andrew@cumin1002> START - Cookbook sre.dns.netbox [production]
22:52 <andrew@cumin1002> START - Cookbook sre.hosts.decommission for hosts cloudcephosd1001.eqiad.wmnet [production]
22:43 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.drain_node (exit_code=0) [admin]
22:43 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node [admin]
22:42 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.drain_node (exit_code=0) [admin]
22:41 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node [admin]
22:41 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.drain_node (exit_code=0) [admin]
22:40 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node [admin]
22:39 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.drain_node (exit_code=0) [admin]
22:38 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node [admin]
22:37 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.drain_node (exit_code=0) [admin]
22:36 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node [admin]
21:31 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) [admin]
21:31 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
21:31 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) [admin]
21:31 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
21:31 <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=97) [admin]
21:30 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
21:30 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) [admin]
21:30 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
20:29 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_eqiad [production]
20:29 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_eqiad [production]
20:07 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: elastic1056*,elastic1063* for host appears to have hot shards - bking@cumin2002 [production]