1551-1600 of 10000 results (104ms)
2024-12-03 ยง
23:04 <vriley@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be1084.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
23:02 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on wdqs[2018-2020,2026-2027].codfw.wmnet with reason: T376150 [production]
23:02 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on wdqs[2018-2020,2026-2027].codfw.wmnet with reason: T376150 [production]
23:02 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on wdqs[1026-1027].eqiad.wmnet with reason: T376150 [production]
23:01 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on wdqs[1026-1027].eqiad.wmnet with reason: T376150 [production]
22:57 <vriley@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1002" [production]
22:53 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1084.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:53 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host ms-be1089.eqiad.wmnet with OS bullseye [production]
22:52 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1090.eqiad.wmnet with reason: host reimage [production]
22:52 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be1089.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:52 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1084.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:52 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1084.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:50 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1088.eqiad.wmnet with reason: host reimage [production]
22:46 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1087.eqiad.wmnet with reason: host reimage [production]
22:43 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1090.eqiad.wmnet with reason: host reimage [production]
22:43 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1088.eqiad.wmnet with reason: host reimage [production]
22:43 <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T376150, initialize wdqs internal main tier) xfer wikidata_main from wdqs2021.codfw.wmnet -> wdqs2019.codfw.wmnet w/ force delete existing files, repooling source-only afterwards [production]
22:43 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1087.eqiad.wmnet with reason: host reimage [production]
22:42 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1089.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:38 <ryankemper@deploy2002> Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host (duration: 00m 13s) [production]
22:38 <ryankemper@deploy2002> Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host [production]
22:37 <vriley@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1083.eqiad.wmnet with reason: host reimage [production]
22:35 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on wdqs[1026-1027].eqiad.wmnet with reason: T376150 [production]
22:35 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 4:00:00 on wdqs[1026-1027].eqiad.wmnet with reason: T376150 [production]
22:34 <vriley@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1083.eqiad.wmnet with reason: host reimage [production]
22:32 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host ms-be1088.eqiad.wmnet with OS bullseye [production]
22:32 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host ms-be1090.eqiad.wmnet with OS bullseye [production]
22:32 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host ms-be1087.eqiad.wmnet with OS bullseye [production]
22:32 <ryankemper@deploy2002> Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host (duration: 00m 13s) [production]
22:32 <ryankemper@deploy2002> Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host [production]
22:32 <ryankemper@deploy2002> deploy aborted: deploy to fresh wdqs-internal-scholarly host (duration: 03m 59s) [production]
22:32 <dancy@deploy2002> Installation of scap version "4.132.0" completed for 1 hosts [production]
22:31 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be1090.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:31 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be1088.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:31 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be1087.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:31 <dancy@deploy2002> Installing scap version "4.132.0" for 1 host(s) [production]
22:28 <ryankemper@deploy2002> Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host [production]
22:23 <vriley@cumin1002> START - Cookbook sre.hosts.reimage for host ms-be1083.eqiad.wmnet with OS bullseye [production]
22:21 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1089.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:21 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1090.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:21 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1088.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:21 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1089.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:21 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1087.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:15 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1084.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:15 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1084.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:12 <brett@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:10 <brett@cumin2002> START - Cookbook sre.dns.netbox [production]
21:52 <ebernhardson@deploy2002> Finished scap sync-world: Backport for [[gerrit:1099773|cirrus: Configure MLR buckets (T377128)]] (duration: 17m 47s) [production]
21:45 <ebernhardson@deploy2002> ebernhardson: Continuing with sync [production]
21:40 <ebernhardson@deploy2002> ebernhardson: Backport for [[gerrit:1099773|cirrus: Configure MLR buckets (T377128)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]