751-800 of 10000 results (127ms)
2023-10-12 ยง
14:56 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host cloudelastic1007.wikimedia.org with OS bullseye [production]
14:53 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore2003.codfw.wmnet [production]
14:52 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore1003.eqiad.wmnet [production]
14:52 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 35008 [production]
14:51 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 35008 [production]
14:51 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudelastic1007.mgmt.eqiad.wmnet with reboot policy FORCED [production]
14:50 <jclark@cumin1001> START - Cookbook sre.hosts.provision for host cloudelastic1007.mgmt.eqiad.wmnet with reboot policy FORCED [production]
14:50 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 12200 [production]
14:49 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 12200 [production]
14:49 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 28458 [production]
14:49 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 28458 [production]
14:49 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 400474 [production]
14:48 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 400474 [production]
14:48 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 398196 [production]
14:48 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 398196 [production]
14:47 <jclark@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:47 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt cloudelastic1007 - jclark@cumin1001" [production]
14:46 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt cloudelastic1007 - jclark@cumin1001" [production]
14:46 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 3267 [production]
14:46 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 3267 [production]
14:45 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 30132 [production]
14:45 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore1003.eqiad.wmnet [production]
14:45 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 30132 [production]
14:45 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 15703 [production]
14:44 <jclark@cumin1001> START - Cookbook sre.dns.netbox [production]
14:44 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 15703 [production]
14:43 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 25542 [production]
14:42 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudelastic1007.mgmt.eqiad.wmnet with reboot policy FORCED [production]
14:42 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 25542 [production]
14:42 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore1002.eqiad.wmnet [production]
14:38 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 15435 [production]
14:38 <jclark@cumin1001> START - Cookbook sre.hosts.provision for host cloudelastic1007.mgmt.eqiad.wmnet with reboot policy FORCED [production]
14:37 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 15435 [production]
14:37 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudelastic1007.mgmt.eqiad.wmnet with reboot policy FORCED [production]
14:35 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 46562 [production]
14:35 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore1002.eqiad.wmnet [production]
14:35 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 46562 [production]
14:34 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 6412 [production]
14:34 <jclark@cumin1001> START - Cookbook sre.hosts.provision for host cloudelastic1007.mgmt.eqiad.wmnet with reboot policy FORCED [production]
14:33 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 6412 [production]
14:33 <elukey@deploy2002> helmfile [codfw] DONE helmfile.d/services/eventstreams: sync [production]
14:33 <elukey@deploy2002> helmfile [codfw] START helmfile.d/services/eventstreams: sync [production]
14:32 <sukhe> completed restarts of pdns-recursor in doh* and dns* [production]
14:30 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore1001.eqiad.wmnet [production]
14:23 <eevans@cumin1001> START - Cookbook sre.hosts.reboot-single for host sessionstore1001.eqiad.wmnet [production]
14:17 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/services/eventstreams-internal: sync [production]
14:16 <elukey@deploy2002> helmfile [eqiad] START helmfile.d/services/eventstreams-internal: sync [production]
14:16 <elukey@deploy2002> helmfile [codfw] DONE helmfile.d/services/eventstreams-internal: sync [production]
14:15 <elukey@deploy2002> helmfile [codfw] START helmfile.d/services/eventstreams-internal: sync [production]
14:12 <mvernon@cumin1001> START - Cookbook sre.hosts.reimage for host moss-be2003.codfw.wmnet with OS bookworm [production]