6651-6700 of 10000 results (117ms)
2023-08-18 ยง
10:07 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM bast3007.wikimedia.org - jmm@cumin2002" [production]
10:07 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM bast3007.wikimedia.org - jmm@cumin2002" [production]
10:06 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) bast3007.wikimedia.org on all recursors [production]
10:06 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache bast3007.wikimedia.org on all recursors [production]
10:06 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:06 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM bast3007.wikimedia.org - jmm@cumin2002" [production]
10:05 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM bast3007.wikimedia.org - jmm@cumin2002" [production]
10:03 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
10:03 <jmm@cumin2002> START - Cookbook sre.ganeti.makevm for new host bast3007.wikimedia.org [production]
10:03 <cmooney@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:03 <cmooney@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add reverses for new link addressing esams - cmooney@cumin1001" [production]
10:01 <cmooney@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add reverses for new link addressing esams - cmooney@cumin1001" [production]
09:56 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
09:55 <cmooney@cumin1001> END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) [production]
09:55 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
09:54 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
09:53 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
09:53 <moritzm> upgrade idp-test to OpenJDK 11.0.20 [production]
09:52 <cmooney@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
09:52 <cmooney@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add reverses for new link addressing esams - cmooney@cumin1001" [production]
09:51 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
09:50 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
09:50 <cmooney@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add reverses for new link addressing esams - cmooney@cumin1001" [production]
09:44 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
09:44 <cmooney@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
09:44 <cmooney@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add reverses for new link addressing esams - cmooney@cumin1001" [production]
09:32 <cmooney@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add reverses for new link addressing esams - cmooney@cumin1001" [production]
09:31 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
09:20 <jayme@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
09:20 <jayme@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
09:20 <jayme@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
09:20 <mvernon@cumin1001> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies (exit_code=0) rolling restart_daemons on A:thanos-fe [production]
09:19 <jayme@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
09:13 <mvernon@cumin1001> START - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies rolling restart_daemons on A:thanos-fe [production]
09:13 <Emperor> roll-restart thanos swift frontends to add user T342620 [production]
08:36 <jmm@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host ganeti-test2002.codfw.wmnet [production]
08:25 <jayme@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
08:24 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti-test2002.codfw.wmnet [production]
08:24 <jayme@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
08:24 <jayme@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
08:23 <jayme@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
08:22 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti-test2002.codfw.wmnet [production]
08:21 <jayme@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
08:21 <jayme@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
08:15 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti-test2002.codfw.wmnet [production]
08:12 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test1002.wikimedia.org [production]
08:07 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host idp-test1002.wikimedia.org [production]
07:47 <cmooney@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
07:46 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
07:41 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1001.eqiad.wmnet [production]