2801-2850 of 10000 results (87ms)
2023-10-11 §
13:36 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 38628 [production]
13:36 <jayme@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
13:36 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 38628 [production]
13:35 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 40317 [production]
13:34 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 40317 [production]
13:34 <jayme@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-wikifunctions: apply [production]
13:31 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 38195 [production]
13:30 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 38195 [production]
13:28 <sukhe> disable puppet on P:bird::anycast: T348041 [production]
13:28 <sukhe> disable puppet on P:bird::anycast [production]
13:27 <jbond@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts ['sretest1003.eqiad.wmnet'] [production]
13:27 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9031 [production]
13:27 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 9031 [production]
13:26 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 6368 [production]
13:26 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 6368 [production]
13:25 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 2497 [production]
13:25 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 2497 [production]
13:24 <urandom> starting decommission of restbase2012-a — T328490 [production]
13:24 <pt1979@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1064.eqiad.wmnet with OS bullseye [production]
13:23 <jayme@deploy2002> helmfile [codfw] START helmfile.d/services/mw-wikifunctions: apply [production]
13:16 <jbond@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['sretest1003.eqiad.wmnet'] [production]
13:16 <jbond@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['sretest1003.eqiad.wmnet'] [production]
13:16 <jbond@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['sretest1003.eqiad.wmnet'] [production]
13:15 <jbond@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['sretest1003.eqiad.wmnet'] [production]
13:14 <jayme@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-wikifunctions: apply [production]
13:14 <jayme@deploy2002> helmfile [codfw] START helmfile.d/services/mw-wikifunctions: apply [production]
13:02 <jayme@deploy2002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
12:59 <jbond@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['sretest1003.eqiad.wmnet'] [production]
12:56 <jayme@deploy2002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
12:55 <jayme@deploy2002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
12:53 <jayme@deploy2002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
12:53 <jayme@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
12:52 <jayme@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
12:52 <jayme@deploy2002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
12:51 <jayme@deploy2002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
12:38 <cgoubert@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:38 <cgoubert@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Cleanup decommissioned services apple-search and graphoid - cgoubert@cumin1001" [production]
12:37 <cgoubert@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Cleanup decommissioned services apple-search and graphoid - cgoubert@cumin1001" [production]
12:34 <cgoubert@cumin1001> START - Cookbook sre.dns.netbox [production]
12:34 <cgoubert@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
12:33 <cgoubert@cumin1001> START - Cookbook sre.dns.netbox [production]
12:16 <elukey@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:16 <elukey@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove ORES svc records - elukey@cumin1001" [production]
12:15 <elukey@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove ORES svc records - elukey@cumin1001" [production]
12:12 <elukey@cumin1001> START - Cookbook sre.dns.netbox [production]
12:00 <kart_> Updated cxserver to 2023-10-11-114410-production (T341478, T347939) [production]
12:00 <kartik@deploy2002> helmfile [codfw] DONE helmfile.d/services/cxserver: apply [production]
11:59 <kartik@deploy2002> helmfile [codfw] START helmfile.d/services/cxserver: apply [production]
11:58 <kartik@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
11:57 <kartik@deploy2002> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]