1451-1500 of 10000 results (79ms)
2024-02-27 ยง
12:09 <kamila@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
12:09 <kamila@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-media: apply [production]
12:08 <kamila@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-media: apply [production]
12:08 <kamila@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
12:08 <kamila@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
12:05 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es1025.eqiad.wmnet [production]
12:05 <kamila@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox: apply [production]
12:04 <kamila@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox: apply [production]
12:02 <slyngshede@cumin1002> START - Cookbook sre.hosts.reimage for host idp-test1003.wikimedia.org with OS bookworm [production]
12:01 <slyngshede@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM idp-test1003.wikimedia.org - slyngshede@cumin1002" [production]
12:01 <slyngshede@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM idp-test1003.wikimedia.org - slyngshede@cumin1002" [production]
12:00 <slyngshede@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) idp-test1003.wikimedia.org on all recursors [production]
12:00 <slyngshede@cumin1002> START - Cookbook sre.dns.wipe-cache idp-test1003.wikimedia.org on all recursors [production]
12:00 <slyngshede@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:00 <slyngshede@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM idp-test1003.wikimedia.org - slyngshede@cumin1002" [production]
11:59 <slyngshede@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM idp-test1003.wikimedia.org - slyngshede@cumin1002" [production]
11:58 <claime> Expanding root lv on mw2281,mw2278 by 20G [production]
11:57 <slyngshede@cumin1002> START - Cookbook sre.dns.netbox [production]
11:57 <slyngshede@cumin1002> START - Cookbook sre.ganeti.makevm for new host idp-test1003.wikimedia.org [production]
11:52 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
11:51 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
11:47 <akosiaris@deploy2002> Synchronized tests/src/ClusterConfigTest.php: (no justification provided) (duration: 09m 36s) [production]
11:46 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es1025.eqiad.wmnet [production]
11:44 <kamila@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox: apply [production]
11:43 <kamila@deploy2002> helmfile [staging] START helmfile.d/services/shellbox: apply [production]
11:24 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset: apply [production]
11:24 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset: apply [production]
11:23 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset-next: apply [production]
11:23 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset-next: apply [production]
11:22 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2186.codfw.wmnet [production]
11:09 <jynus@cumin1002> dbctl commit (dc=all): 'Repool db2117', diff saved to https://phabricator.wikimedia.org/P57997 and previous config saved to /var/cache/conftool/dbconfig/20240227-110952-jynus.json [production]
11:08 <jynus@cumin1002> dbctl commit (dc=all): 'Depool db2117', diff saved to https://phabricator.wikimedia.org/P57996 and previous config saved to /var/cache/conftool/dbconfig/20240227-110828-jynus.json [production]
10:54 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2186.codfw.wmnet [production]
10:52 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2185.codfw.wmnet [production]
10:41 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2185.codfw.wmnet [production]
10:34 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2173.codfw.wmnet [production]
10:20 <marostegui@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host es1037.eqiad.wmnet with OS bookworm [production]
10:20 <marostegui@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host es1039.eqiad.wmnet with OS bookworm [production]
10:17 <marostegui@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host es1038.eqiad.wmnet with OS bookworm [production]
10:15 <marostegui@cumin1002> START - Cookbook sre.hosts.reimage for host es1039.eqiad.wmnet with OS bookworm [production]
10:15 <marostegui@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host es1039.eqiad.wmnet with OS bookworm [production]
10:14 <marostegui@cumin1002> START - Cookbook sre.hosts.reimage for host es1037.eqiad.wmnet with OS bookworm [production]
10:13 <marostegui@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host es1037.eqiad.wmnet with OS bookworm [production]
10:11 <klausman@deploy2002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'article-descriptions' for release 'main' . [production]
10:11 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es1040.eqiad.wmnet with OS bookworm [production]
10:11 <marostegui@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - marostegui@cumin1002" [production]
10:10 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2173.codfw.wmnet [production]
10:10 <marostegui@cumin1002> START - Cookbook sre.hosts.reimage for host es1038.eqiad.wmnet with OS bookworm [production]
10:10 <marostegui@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - marostegui@cumin1002" [production]
10:09 <marostegui@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host es1038.eqiad.wmnet with OS bookworm [production]