5101-5150 of 10000 results (116ms)
2025-03-25 ยง
17:48 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2269.codfw.wmnet with reason: host reimage [production]
17:47 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp5029.eqsin.wmnet} and A:cp [production]
17:47 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp5019.eqsin.wmnet} and A:cp [production]
17:45 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2271.codfw.wmnet with reason: host reimage [production]
17:42 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2270.codfw.wmnet with reason: host reimage [production]
17:39 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2269.codfw.wmnet with reason: host reimage [production]
17:39 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2271.codfw.wmnet with reason: host reimage [production]
17:39 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2270.codfw.wmnet with reason: host reimage [production]
17:28 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host wikikube-worker2271.codfw.wmnet with OS bookworm [production]
17:28 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host wikikube-worker2270.codfw.wmnet with OS bookworm [production]
17:28 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host wikikube-worker2269.codfw.wmnet with OS bookworm [production]
17:27 <klausman@cumin2002> conftool action : set/weight=1; selector: name=ml-serve2009.codfw.wmnet [production]
17:27 <klausman@cumin2002> conftool action : set/weight=1; selector: name=ml-serve2010.codfw.wmnet [production]
17:27 <klausman@cumin2002> conftool action : set/weight=1; selector: name=ml-serve2011.codfw.wmnet [production]
17:26 <klausman@cumin2002> conftool action : set/pooled=yes; selector: name=ml-serve2011.codfw.wmnet [production]
17:26 <klausman@cumin2002> conftool action : set/pooled=yes; selector: name=ml-serve2010.codfw.wmnet [production]
17:26 <klausman@cumin2002> conftool action : set/pooled=yes; selector: name=ml-serve2009.codfw.wmnet [production]
17:24 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:24 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2270.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:20 <klausman@cumin2002> conftool action : set/pooled=yes; selector: name=ml-serve2007.codfw.wmnet [production]
17:19 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:18 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:16 <klausman@cumin2002> conftool action : set/pooled=yes; selector: name=ml-serve2007.codfw.wmnet [production]
17:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2270.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:14 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:14 <sukhe> restart pybal on lvs2013 [production]
17:14 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2270.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:13 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp5018.eqsin.wmnet} and A:cp [production]
17:12 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp5030.eqsin.wmnet} and A:cp [production]
17:11 <sukhe> sudo systemctl restart pybal on lvs2014 [production]
17:09 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:08 <swfrench@deploy1003> Finished scap sync-world: Helmfile-only deployment for next and migration release cleanups - T383845 (duration: 02m 45s) [production]
17:07 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-serve2008.codfw.wmnet with OS bookworm [production]
17:06 <swfrench@deploy1003> Started scap sync-world: Helmfile-only deployment for next and migration release cleanups - T383845 [production]
17:05 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp5018.eqsin.wmnet} and A:cp [production]
17:05 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp5030.eqsin.wmnet} and A:cp [production]
17:04 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:04 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:04 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:04 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2270.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:04 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:03 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2271 [production]
17:03 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2271 [production]
17:03 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2270 [production]
17:03 <jhancock@cumin2002> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host wikikube-worker2271 [production]
17:03 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2269 [production]
17:03 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2271 [production]
17:03 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2270 [production]
17:03 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2269 [production]