2551-2600 of 10000 results (74ms)
2023-07-06 ยง
12:43 <stevemunene@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: analytics1064.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - stevemunene@cumin1001" [production]
12:42 <elukey@cumin1001> START - Cookbook sre.hosts.reimage for host zookeeper-test1002.eqiad.wmnet with OS bookworm [production]
12:40 <stevemunene@cumin1001> START - Cookbook sre.dns.netbox [production]
12:35 <stevemunene@cumin1001> START - Cookbook sre.hosts.decommission for hosts analytics1064.eqiad.wmnet [production]
12:32 <samtar@deploy1002> Finished scap: Backport for [[gerrit:935854|Revert "Add tag when reference added to the page" (T341202)]] (duration: 24m 04s) [production]
12:21 <samtar@deploy1002> matmarex and samtar: Backport for [[gerrit:935854|Revert "Add tag when reference added to the page" (T341202)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
12:15 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host zookeeper-test1002.eqiad.wmnet with OS bookworm [production]
12:15 <elukey@cumin1001> START - Cookbook sre.hosts.reimage for host zookeeper-test1002.eqiad.wmnet with OS bookworm [production]
12:08 <samtar@deploy1002> Started scap: Backport for [[gerrit:935854|Revert "Add tag when reference added to the page" (T341202)]] [production]
11:56 <aborrero@cumin1001> START - Cookbook sre.hosts.reimage for host cloudlb1001.eqiad.wmnet with OS bullseye [production]
11:56 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/datahub: sync on main [production]
11:56 <stevemunene@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts analytics1063.eqiad.wmnet [production]
11:56 <stevemunene@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:56 <aborrero@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudlb1002 [production]
11:56 <aborrero@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cloudlb1002 [production]
11:56 <aborrero@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:56 <aborrero@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudlb - aborrero@cumin1001" [production]
11:55 <aborrero@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudlb - aborrero@cumin1001" [production]
11:55 <stevemunene@cumin1001> START - Cookbook sre.dns.netbox [production]
11:54 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cloudlb1001.eqiad.wmnet on all recursors [production]
11:54 <aborrero@cumin2002> START - Cookbook sre.dns.wipe-cache cloudlb1001.eqiad.wmnet on all recursors [production]
11:53 <aborrero@cumin1001> START - Cookbook sre.dns.netbox [production]
11:53 <aborrero@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:53 <aborrero@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudlb - aborrero@cumin1001" [production]
11:52 <aborrero@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudlb - aborrero@cumin1001" [production]
11:52 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
11:50 <aborrero@cumin1001> START - Cookbook sre.dns.netbox [production]
11:50 <stevemunene@cumin1001> START - Cookbook sre.hosts.decommission for hosts analytics1063.eqiad.wmnet [production]
11:50 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cloudlb1001.eqiad.wmnet on all recursors [production]
11:50 <aborrero@cumin2002> START - Cookbook sre.dns.wipe-cache cloudlb1001.eqiad.wmnet on all recursors [production]
11:49 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/api-gateway: apply [production]
11:49 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/api-gateway: apply [production]
11:49 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply [production]
11:48 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/api-gateway: apply [production]
11:48 <aborrero@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudlb1001 [production]
11:48 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/api-gateway: apply [production]
11:48 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/api-gateway: apply [production]
11:48 <aborrero@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cloudlb1001 [production]
11:47 <stevemunene@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts analytics1063.eqiad.wmnet [production]
11:47 <stevemunene@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:46 <stevemunene@cumin1001> START - Cookbook sre.dns.netbox [production]
11:43 <aborrero@cumin1001> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host cloudlb1001 [production]
11:42 <aborrero@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cloudlb1001 [production]
11:41 <stevemunene@cumin1001> START - Cookbook sre.hosts.decommission for hosts analytics1063.eqiad.wmnet [production]
11:41 <stevemunene@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts analytics1063.eqiad.wmnet [production]
11:41 <stevemunene@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
11:39 <aborrero@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:39 <aborrero@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudlb - aborrero@cumin1001" [production]
11:38 <aborrero@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudlb - aborrero@cumin1001" [production]
11:35 <aborrero@cumin1001> START - Cookbook sre.dns.netbox [production]