1-50 of 10000 results (55ms)
2026-09-01 ยง
21:52 <jdlrobson@deploy1003> jdlrobson: Continuing with deployment [production]
21:47 <jdlrobson@deploy1003> jdlrobson: Backport for [[gerrit:1333294|Merge branch 'master' into wmf_deploy]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:41 <jdlrobson@deploy1003> Started scap sync-world: Backport for [[gerrit:1333294|Merge branch 'master' into wmf_deploy]] [production]
21:38 <jdlrobson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1333293|Merge branch 'master' into wmf_deploy]], [[gerrit:1333277|Preserve showlogin query parameter on redirects (T435248)]] (duration: 23m 55s) [production]
21:28 <jdlrobson@deploy1003> jdlrobson: Continuing with deployment [production]
21:20 <jdlrobson@deploy1003> jdlrobson: Backport for [[gerrit:1333293|Merge branch 'master' into wmf_deploy]], [[gerrit:1333277|Preserve showlogin query parameter on redirects (T435248)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:14 <jdlrobson@deploy1003> Started scap sync-world: Backport for [[gerrit:1333293|Merge branch 'master' into wmf_deploy]], [[gerrit:1333277|Preserve showlogin query parameter on redirects (T435248)]] [production]
20:47 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aqs1016.eqiad.wmnet with OS bookworm [production]
20:28 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aqs1016.eqiad.wmnet with reason: host reimage [production]
20:24 <eevans@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on aqs1016.eqiad.wmnet with reason: host reimage [production]
20:11 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm [production]
20:11 <eevans@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:57 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:57 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:56 <eevans@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:56 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:56 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:54 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:52 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:47 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:45 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:42 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host aqs1016.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
19:41 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:40 <eevans@cumin1003> START - Cookbook sre.hosts.provision for host aqs1016.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
19:39 <eevans@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:35 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:32 <jhancock@cumin1003> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host cloudcephosd1055 [production]
19:32 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1055 [production]
19:30 <cdobbins@cumin1003> conftool action : set/pooled=yes; selector: name=cp5022.* [reason: update IP addrs] [production]
19:30 <cdobbins@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp5022.eqsin.wmnet [production]
19:30 <cdobbins@cumin1003> START - Cookbook sre.hosts.remove-downtime for cp5022.eqsin.wmnet [production]
19:25 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:25 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:25 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:25 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:24 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:24 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:23 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:22 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:21 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:16 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:14 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:14 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:13 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:12 <jclark@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd1056 [production]
19:12 <jclark@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1056 [production]
19:12 <jclark@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd1055 [production]
19:12 <jclark@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1055 [production]
19:12 <jclark@cumin1003> END (ERROR) - Cookbook sre.network.configure-switch-interfaces (exit_code=97) for host cloudcephosd1054 [production]
19:12 <jclark@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1054 [production]