51-100 of 10000 results (22ms)
2025-06-23 §
18:30 <urbanecm@deploy1003> Started scap sync-world: Backport for [[gerrit:1163005|Revert "[Growth] Prepare for the Get Started notification experiment" (T394958)]] [production]
18:17 <ryankemper@cumin1003> conftool action : set/pooled=false; selector: dnsdisc=search,name=eqiad [production]
18:16 <ryankemper@cumin1003> conftool action : set/pooled=false; selector: dnsdisc=search-psi,name=eqiad [production]
18:16 <ryankemper@cumin1003> conftool action : set/pooled=false; selector: dnsdisc=search-omega,name=eqiad [production]
18:12 <urandom> bootstrapping Cassandra/sessionstore2005 — T391544 [production]
18:09 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
18:09 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['sretest2003'] [production]
18:09 <jhancock@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['sretest2003'] [production]
18:08 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['sretest2003'] [production]
18:08 <ryankemper@cumin1003> conftool action : set/pooled=true; selector: dnsdisc=search,name=codfw [production]
18:08 <ryankemper@cumin1003> conftool action : set/pooled=true; selector: dnsdisc=search-psi,name=codfw [production]
18:08 <ryankemper@cumin1003> conftool action : set/pooled=true; selector: dnsdisc=search-omega,name=codfw [production]
18:08 <jhancock@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['sretest2003'] [production]
18:08 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
18:02 <ryankemper@cumin1003> conftool action : set/pooled=true; selector: dnsdisc=search,name=eqiad [production]
18:02 <ryankemper@cumin1003> conftool action : set/pooled=true; selector: dnsdisc=search-psi,name=eqiad [production]
18:02 <ryankemper@cumin1003> conftool action : set/pooled=true; selector: dnsdisc=search-omega,name=eqiad [production]
18:00 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore2005.codfw.wmnet [production]
17:54 <eevans@cumin1003> START - Cookbook sre.hosts.reboot-single for host sessionstore2005.codfw.wmnet [production]
17:53 <eevans@cumin1003> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host sessionstore2005.codfw.wmnet [production]
17:53 <eevans@cumin1003> START - Cookbook sre.hosts.reboot-single for host sessionstore2005.codfw.wmnet [production]
17:46 <ryankemper@cumin1003> conftool action : set/pooled=false; selector: dnsdisc=search,name=eqiad [production]
17:46 <ryankemper@cumin1003> conftool action : set/pooled=false; selector: dnsdisc=search-psi,name=eqiad [production]
17:46 <ryankemper@cumin1003> conftool action : set/pooled=false; selector: dnsdisc=search-omega,name=eqiad [production]
17:38 <wfan> payments-wiki upgraded from a50612fa to ffcc4dcc [production]
17:34 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
17:31 <klausman@deploy1003> helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply [production]
17:25 <dancy@deploy1003> Unlocked for deployment [ALL REPOSITORIES]: test (duration: 00m 02s) [production]
17:25 <dancy@deploy1003> Locking from deployment [ALL REPOSITORIES]: test [production]
17:24 <dancy@deploy1003> Installation of scap version "4.182.0" completed for 2 hosts [production]
17:24 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cp2043.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
17:23 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sessionstore2005.codfw.wmnet with OS bullseye [production]
17:23 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host cp2043.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
17:23 <dancy@deploy1003> Installing scap version "4.182.0" for 2 host(s) [production]
17:22 <swfrench@deploy1003> Finished scap sync-world: Deploy bookworm httpd images to mw-debug/next - T378128 (duration: 08m 00s) [production]
17:21 <swfrench@deploy1003> swfrench: Continuing with sync [production]
17:19 <klausman@deploy1003> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
17:19 <klausman@deploy1003> helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply [production]
17:18 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host build2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:17 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host build2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:17 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host build2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:17 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host build2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:16 <swfrench@deploy1003> swfrench: Deploy bookworm httpd images to mw-debug/next - T378128 synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:15 <swfrench@deploy1003> Started scap sync-world: Deploy bookworm httpd images to mw-debug/next - T378128 [production]
17:15 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host build2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:14 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host build2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:12 <ryankemper@cumin1003> conftool action : set/pooled=false; selector: dnsdisc=search-psi,name=eqiad [production]
17:11 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host build2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:11 <klausman@deploy1003> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
17:11 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host build2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]