1001-1050 of 10000 results (97ms)
2024-05-07 ยง
13:50 <filippo@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM prometheus7001.magru.wmnet - filippo@cumin1002" [production]
13:49 <filippo@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM prometheus7001.magru.wmnet - filippo@cumin1002" [production]
13:48 <mfossati@deploy1002> Finished deploy [airflow-dags/platform_eng@ad4934c]: (no justification provided) (duration: 00m 32s) [production]
13:47 <mfossati@deploy1002> Started deploy [airflow-dags/platform_eng@ad4934c]: (no justification provided) [production]
13:44 <filippo@cumin1002> START - Cookbook sre.dns.netbox [production]
13:44 <filippo@cumin1002> START - Cookbook sre.ganeti.makevm for new host prometheus7001.magru.wmnet [production]
13:41 <filippo@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts prometheus7001.magru.wmnet [production]
13:40 <filippo@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:40 <filippo@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: prometheus7001.magru.wmnet decommissioned, removing all IPs except the asset tag one - filippo@cumin1002" [production]
13:40 <hnowlan@cumin1002> START - Cookbook sre.hosts.reimage for host mw2359.codfw.wmnet with OS bullseye [production]
13:40 <hnowlan@cumin1002> START - Cookbook sre.hosts.reimage for host mw2390.codfw.wmnet with OS bullseye [production]
13:40 <hnowlan@cumin1002> START - Cookbook sre.hosts.reimage for host mw2407.codfw.wmnet with OS bullseye [production]
13:40 <hnowlan@cumin1002> START - Cookbook sre.hosts.reimage for host mw2338.codfw.wmnet with OS bullseye [production]
13:40 <hnowlan@cumin1002> START - Cookbook sre.hosts.reimage for host mw2305.codfw.wmnet with OS bullseye [production]
13:40 <hnowlan@cumin1002> START - Cookbook sre.hosts.reimage for host mw2325.codfw.wmnet with OS bullseye [production]
13:40 <filippo@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: prometheus7001.magru.wmnet decommissioned, removing all IPs except the asset tag one - filippo@cumin1002" [production]
13:36 <filippo@cumin1002> START - Cookbook sre.dns.netbox [production]
13:31 <filippo@cumin1002> START - Cookbook sre.hosts.decommission for hosts prometheus7001.magru.wmnet [production]
13:31 <filippo@cumin1002> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host prometheus7001.magru.wmnet [production]
13:31 <filippo@cumin1002> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
13:29 <filippo@cumin1002> START - Cookbook sre.dns.netbox [production]
13:29 <filippo@cumin1002> START - Cookbook sre.ganeti.makevm for new host prometheus7001.magru.wmnet [production]
13:25 <filippo@cumin1002> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host prometheus7001.magru.wmnet [production]
13:25 <filippo@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host prometheus7001.magru.wmnet with OS bullseye [production]
13:21 <elukey@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
13:19 <elukey@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
13:17 <elukey@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
13:14 <elukey@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
13:05 <elukey@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
13:04 <elukey@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
12:48 <klausman@deploy1002> helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. [production]
12:46 <klausman@deploy1002> helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. [production]
12:10 <filippo@cumin1002> START - Cookbook sre.hosts.reimage for host prometheus7001.magru.wmnet with OS bullseye [production]
12:09 <filippo@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM prometheus7001.magru.wmnet - filippo@cumin1002" [production]
12:08 <filippo@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM prometheus7001.magru.wmnet - filippo@cumin1002" [production]
12:08 <filippo@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) prometheus7001.magru.wmnet on all recursors [production]
12:08 <filippo@cumin1002> START - Cookbook sre.dns.wipe-cache prometheus7001.magru.wmnet on all recursors [production]
12:08 <filippo@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:08 <filippo@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM prometheus7001.magru.wmnet - filippo@cumin1002" [production]
12:07 <filippo@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM prometheus7001.magru.wmnet - filippo@cumin1002" [production]
12:05 <btullis@deploy1002> Finished deploy [airflow-dags/analytics@e5ba870]: (no justification provided) (duration: 00m 32s) [production]
12:05 <btullis@deploy1002> Started deploy [airflow-dags/analytics@e5ba870]: (no justification provided) [production]
12:03 <moritzm> installing ruby3.1 security updates [production]
12:02 <filippo@cumin1002> START - Cookbook sre.dns.netbox [production]
12:02 <filippo@cumin1002> START - Cookbook sre.ganeti.makevm for new host prometheus7001.magru.wmnet [production]
11:22 <jforrester@deploy1002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
11:19 <jforrester@deploy1002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
11:19 <jforrester@deploy1002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
11:17 <jforrester@deploy1002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
11:16 <jforrester@deploy1002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]