951-1000 of 10000 results (85ms)
2023-10-30 ยง
20:21 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-analytics: apply [production]
20:20 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dns3004.wikimedia.org with OS bookworm [production]
20:17 <dancy@deploy2002> Finished scap: Backport for [[gerrit:969353|namespaces:mediawiki: add Extensions/Skins as alias of Extension/Skin (+ tallk) (T349970)]] (duration: 10m 09s) [production]
20:11 <dancy@deploy2002> dancy and rhinosf1: Continuing with sync [production]
20:10 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-analytics: apply [production]
20:08 <dancy@deploy2002> dancy and rhinosf1: Backport for [[gerrit:969353|namespaces:mediawiki: add Extensions/Skins as alias of Extension/Skin (+ tallk) (T349970)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:07 <dancy@deploy2002> Started scap: Backport for [[gerrit:969353|namespaces:mediawiki: add Extensions/Skins as alias of Extension/Skin (+ tallk) (T349970)]] [production]
19:51 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns3004.wikimedia.org with reason: host reimage [production]
19:47 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on dns3004.wikimedia.org with reason: host reimage [production]
19:21 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host dns3004.wikimedia.org with OS bookworm [production]
18:59 <sukhe@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp4052.ulsfo.wmnet with OS bookworm [production]
18:54 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp4052.ulsfo.wmnet with OS bookworm [production]
18:53 <sukhe@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1103.eqiad.wmnet with OS bullseye [production]
18:52 <sukhe@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp4052.ulsfo.wmnet with OS bookworm [production]
18:38 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dns3003.wikimedia.org with OS bookworm [production]
18:36 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp4052.ulsfo.wmnet with OS bookworm [production]
18:35 <sukhe@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp4052.ulsfo.wmnet with OS bookworm [production]
18:34 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp1103.eqiad.wmnet with OS bullseye [production]
18:34 <sukhe@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1103.eqiad.wmnet with OS bullseye [production]
18:33 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: ping_offload [production]
18:27 <jbond> migrate ping_offload to puppet7 [production]
18:27 <jbond@cumin1001> START - Cookbook sre.puppet.migrate-role for role: ping_offload [production]
18:26 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp1103.eqiad.wmnet with OS bullseye [production]
18:24 <sukhe> racadm racreset cp1103.eqiad.wmnet [production]
18:22 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1103.eqiad.wmnet with OS bullseye [production]
18:20 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on search-loader[2001-2002].codfw.wmnet with reason: T346039 [production]
18:19 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on search-loader[2001-2002].codfw.wmnet with reason: T346039 [production]
18:16 <bking@deploy2002> Finished deploy [search/mjolnir/deploy@daf8c32]: T346039 (duration: 00m 06s) [production]
18:16 <bking@deploy2002> Started deploy [search/mjolnir/deploy@daf8c32]: T346039 [production]
18:11 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp4052.ulsfo.wmnet with OS bookworm [production]
18:10 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1103.eqiad.wmnet with OS bullseye [production]
17:56 <jbond> migrate bastionhost to puppet7 [production]
17:50 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4052.ulsfo.wmnet with OS bookworm [production]
17:42 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns3003.wikimedia.org with reason: host reimage [production]
17:40 <jbond> migrate pki::multirootca to puppet7 [production]
17:39 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on dns3003.wikimedia.org with reason: host reimage [production]
17:27 <jbond@cumin1001> END (FAIL) - Cookbook sre.puppet.migrate-host (exit_code=99) for host pki2002.codfw.wmnet [production]
17:23 <jbond@cumin1001> START - Cookbook sre.puppet.migrate-host for host pki2002.codfw.wmnet [production]
17:22 <jbond> migrate pki2002 to puppet7 [production]
17:16 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1103.eqiad.wmnet with OS bullseye [production]
17:14 <otto@deploy2002> helmfile [staging] DONE helmfile.d/services/eventgate-analytics: apply [production]
17:12 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host dns3003.wikimedia.org with OS bookworm [production]
17:10 <jbond> migrate pki::root to puppet7 [production]
17:04 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-analytics: apply [production]
16:51 <sukhe> running authdns-update for CR 969816 [production]
16:39 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp4052.ulsfo.wmnet with reason: depooled, reimaging [production]
16:39 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 4:00:00 on cp4052.ulsfo.wmnet with reason: depooled, reimaging [production]
16:26 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1103.eqiad.wmnet with reason: host reimage [production]
16:23 <fabfur@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp1103.eqiad.wmnet with reason: host reimage [production]
16:22 <taavi@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt-wdqs1003.eqiad.wmnet with OS bookworm [production]