801-850 of 10000 results (113ms)
2025-03-25 ยง
17:16 <klausman@cumin2002> conftool action : set/pooled=yes; selector: name=ml-serve2007.codfw.wmnet [production]
17:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2270.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:14 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:14 <sukhe> restart pybal on lvs2013 [production]
17:14 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2270.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:13 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp5018.eqsin.wmnet} and A:cp [production]
17:12 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp5030.eqsin.wmnet} and A:cp [production]
17:11 <sukhe> sudo systemctl restart pybal on lvs2014 [production]
17:09 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:08 <swfrench@deploy1003> Finished scap sync-world: Helmfile-only deployment for next and migration release cleanups - T383845 (duration: 02m 45s) [production]
17:07 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-serve2008.codfw.wmnet with OS bookworm [production]
17:06 <swfrench@deploy1003> Started scap sync-world: Helmfile-only deployment for next and migration release cleanups - T383845 [production]
17:05 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp5018.eqsin.wmnet} and A:cp [production]
17:05 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp5030.eqsin.wmnet} and A:cp [production]
17:04 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:04 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:04 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2271.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:04 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2270.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:04 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2269.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:03 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2271 [production]
17:03 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2271 [production]
17:03 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2270 [production]
17:03 <jhancock@cumin2002> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host wikikube-worker2271 [production]
17:03 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2269 [production]
17:03 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2271 [production]
17:03 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2270 [production]
17:03 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2269 [production]
17:02 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:02 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding wikikube-worker2270 to codfw - jhancock@cumin2002" [production]
17:02 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding wikikube-worker2270 to codfw - jhancock@cumin2002" [production]
16:54 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
16:51 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve2008.codfw.wmnet with reason: host reimage [production]
16:49 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2268.codfw.wmnet with OS bookworm [production]
16:49 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
16:48 <klausman@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve2008.codfw.wmnet with reason: host reimage [production]
16:45 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
16:45 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2266.codfw.wmnet with OS bookworm [production]
16:45 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
16:40 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
16:39 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-serve2007.codfw.wmnet with OS bookworm [production]
16:36 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2267.codfw.wmnet with OS bookworm [production]
16:36 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
16:36 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp5017.eqsin.wmnet} and A:cp [production]
16:35 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp5031.eqsin.wmnet} and A:cp [production]
16:35 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
16:34 <brennen@deploy1003> Finished deploy [phabricator/deployment@f01e475]: deploy phab1004 for T389953 (duration: 00m 36s) [production]
16:34 <brennen@deploy1003> Started deploy [phabricator/deployment@f01e475]: deploy phab1004 for T389953 [production]
16:33 <brennen@deploy1003> Finished deploy [phabricator/deployment@f01e475]: deploy phab2002 for T389953 (duration: 00m 39s) [production]
16:33 <brennen@deploy1003> Started deploy [phabricator/deployment@f01e475]: deploy phab2002 for T389953 [production]