301-350 of 10000 results (146ms)
2025-03-27 ยง
22:38 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
22:33 <thcipriani@deploy1003> tgr, thcipriani: Continuing with sync [production]
22:28 <thcipriani@deploy1003> tgr, thcipriani: Backport for [[gerrit:1131482|Disable new WebAuthn credentials creation on local domains (T378402 T354701)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:27 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on elastic1125.eqiad.wmnet with reason: host reimage [production]
22:24 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on elastic1124.eqiad.wmnet with reason: host reimage [production]
22:23 <thcipriani@deploy1003> Started scap sync-world: Backport for [[gerrit:1131482|Disable new WebAuthn credentials creation on local domains (T378402 T354701)]] [production]
22:22 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on elastic1125.eqiad.wmnet with reason: host reimage [production]
22:21 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on elastic1124.eqiad.wmnet with reason: host reimage [production]
22:12 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host elastic1125.eqiad.wmnet with OS bullseye [production]
22:10 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host elastic1124.eqiad.wmnet with OS bullseye [production]
22:09 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host elastic1123.eqiad.wmnet with OS bullseye [production]
22:09 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host elastic1125.eqiad.wmnet with OS bullseye [production]
22:09 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host elastic1125.eqiad.wmnet with OS bullseye [production]
22:05 <thcipriani@deploy1003> Finished scap sync-world: Backport for [[gerrit:1130101|Add "PRE" (for NS_TEMPLATE) and "CAT" (for NS_CATEGORY) as namespace aliases in ptwiki. (T389609)]] (duration: 13m 23s) [production]
21:57 <thcipriani@deploy1003> thcipriani, albertoleoncio: Continuing with sync [production]
21:57 <thcipriani@deploy1003> thcipriani, albertoleoncio: Backport for [[gerrit:1130101|Add "PRE" (for NS_TEMPLATE) and "CAT" (for NS_CATEGORY) as namespace aliases in ptwiki. (T389609)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:52 <thcipriani@deploy1003> Started scap sync-world: Backport for [[gerrit:1130101|Add "PRE" (for NS_TEMPLATE) and "CAT" (for NS_CATEGORY) as namespace aliases in ptwiki. (T389609)]] [production]
21:43 <dancy@deploy1003> Finished scap sync-world: Testing deployments (duration: 24m 24s) [production]
21:30 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2328.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:30 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2329.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:30 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2330.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:25 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2328.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:25 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2329.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:25 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2330.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2326.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2325.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2324.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2323.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:21 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2322.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:21 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp2041.codfw.wmnet} and A:cp [production]
21:21 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp2042.codfw.wmnet} and A:cp [production]
21:19 <dancy@deploy1003> Started scap sync-world: Testing deployments [production]
21:17 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2327.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:17 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2327.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:17 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2326.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:17 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2325.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:16 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp2042.codfw.wmnet} and A:cp [production]
21:16 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp2041.codfw.wmnet} and A:cp [production]
21:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2324.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2323.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2322.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:13 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2320.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:13 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2319.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:13 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2318.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:13 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2321.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:12 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2317.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:12 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2316.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:07 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2321.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:07 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2320.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
21:07 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2319.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]