2151-2200 of 10000 results (92ms)
2023-10-30 ยง
18:20 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on search-loader[2001-2002].codfw.wmnet with reason: T346039 [production]
18:19 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on search-loader[2001-2002].codfw.wmnet with reason: T346039 [production]
18:16 <bking@deploy2002> Finished deploy [search/mjolnir/deploy@daf8c32]: T346039 (duration: 00m 06s) [production]
18:16 <bking@deploy2002> Started deploy [search/mjolnir/deploy@daf8c32]: T346039 [production]
18:11 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp4052.ulsfo.wmnet with OS bookworm [production]
18:10 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1103.eqiad.wmnet with OS bullseye [production]
17:56 <jbond> migrate bastionhost to puppet7 [production]
17:50 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4052.ulsfo.wmnet with OS bookworm [production]
17:42 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns3003.wikimedia.org with reason: host reimage [production]
17:40 <jbond> migrate pki::multirootca to puppet7 [production]
17:39 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on dns3003.wikimedia.org with reason: host reimage [production]
17:27 <jbond@cumin1001> END (FAIL) - Cookbook sre.puppet.migrate-host (exit_code=99) for host pki2002.codfw.wmnet [production]
17:23 <jbond@cumin1001> START - Cookbook sre.puppet.migrate-host for host pki2002.codfw.wmnet [production]
17:22 <jbond> migrate pki2002 to puppet7 [production]
17:16 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1103.eqiad.wmnet with OS bullseye [production]
17:14 <otto@deploy2002> helmfile [staging] DONE helmfile.d/services/eventgate-analytics: apply [production]
17:12 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host dns3003.wikimedia.org with OS bookworm [production]
17:10 <jbond> migrate pki::root to puppet7 [production]
17:04 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-analytics: apply [production]
16:51 <sukhe> running authdns-update for CR 969816 [production]
16:39 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp4052.ulsfo.wmnet with reason: depooled, reimaging [production]
16:39 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 4:00:00 on cp4052.ulsfo.wmnet with reason: depooled, reimaging [production]
16:26 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1103.eqiad.wmnet with reason: host reimage [production]
16:23 <fabfur@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp1103.eqiad.wmnet with reason: host reimage [production]
16:22 <taavi@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt-wdqs1003.eqiad.wmnet with OS bookworm [production]
16:22 <taavi@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - taavi@cumin1001" [production]
16:21 <taavi@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - taavi@cumin1001" [production]
16:16 <jbond> migrate O:ganeti_test to puppet7 [production]
16:14 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host ganeti-test1002.eqiad.wmnet [production]
16:07 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1103.eqiad.wmnet with OS bullseye [production]
16:07 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1103.eqiad.wmnet with OS bullseye [production]
16:04 <jbond> migrate ganeti-test1002.eqiad.wmnet to puppet7 [production]
16:03 <jbond@cumin1001> START - Cookbook sre.puppet.migrate-host for host ganeti-test1002.eqiad.wmnet [production]
16:02 <taavi@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt-wdqs1003.eqiad.wmnet with reason: host reimage [production]
15:58 <taavi@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt-wdqs1003.eqiad.wmnet with reason: host reimage [production]
15:57 <taavi@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "cloudvirt-wdqs1003 - taavi@cumin1001" [production]
15:56 <taavi@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "cloudvirt-wdqs1003 - taavi@cumin1001" [production]
15:55 <jbond> migrate failoid to puppet7 [production]
15:51 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1103.eqiad.wmnet with OS bullseye [production]
15:51 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1103.eqiad.wmnet with OS bullseye [production]
15:49 <jbond> move builder to puppet7 [production]
15:49 <jbond> move cluster::unprivmanagement to puppet7 [production]
15:49 <jbond> move config_master to puppet7 [production]
15:43 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1103.eqiad.wmnet with OS bullseye [production]
15:42 <taavi@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt-wdqs1003.eqiad.wmnet with OS bookworm [production]
15:33 <taavi@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudvirt-wdqs1003 [production]
15:33 <taavi@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cloudvirt-wdqs1003 [production]
15:30 <taavi@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:30 <taavi@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: assign new IPs to cloudvirt-wdqs1003 - taavi@cumin1001" [production]
15:29 <taavi@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: assign new IPs to cloudvirt-wdqs1003 - taavi@cumin1001" [production]