151-200 of 10000 results (22ms)
2026-08-12 ยง
13:08 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db1158.eqiad.wmnet onto db1273.eqiad.wmnet [production]
13:07 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1158: Pool db1158.eqiad.wmnet in after cloning [production]
13:07 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component misctools-cli [toolsbeta]
13:02 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6002.drmrs.wmnet [production]
13:02 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti6002.drmrs.wmnet [production]
12:59 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-presto1015.eqiad.wmnet with OS bookworm [production]
12:56 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ganeti6002.drmrs.wmnet [production]
12:54 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component misctools-cli [toolsbeta]
12:49 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component misctools-cli [toolsbeta]
12:48 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component misctools-cli [toolsbeta]
12:46 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component misctools-cli [toolsbeta]
12:46 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component misctools-cli [toolsbeta]
12:45 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance toolsbeta-bastion-6 (T401804) [toolsbeta]
12:44 <dcaro@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance toolsbeta-bastion-6 (T401804) [toolsbeta]
12:44 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-presto1017.eqiad.wmnet with OS bookworm [production]
12:36 <bwojtowicz@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revise-tone-task-generator' for release 'main' . [production]
12:35 <bwojtowicz@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revise-tone-task-generator' for release 'main' . [production]
12:34 <bwojtowicz@deploy1003> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revise-tone-task-generator' for release 'main' . [production]
12:33 <bwojtowicz@deploy1003> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revise-tone-task-generator' for release 'main' . [production]
12:32 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component misctools-cli [toolsbeta]
12:32 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component misctools-cli [toolsbeta]
12:31 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6002.drmrs.wmnet [production]
12:30 <hashar> integration: on Castor: `sudo rm -fR /srv/castor/*/*/mwext-phpunit-coverage*/npm` # T427922 [releng]
12:27 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-cli [tools]
12:26 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-cli [tools]
12:24 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-cli [toolsbeta]
12:24 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-presto1017.eqiad.wmnet with reason: host reimage [production]
12:23 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-cli [toolsbeta]
12:23 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-cli [toolsbeta]
12:23 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-cli [toolsbeta]
12:22 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db1158: Pool db1158.eqiad.wmnet in after cloning [production]
12:20 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-cli [toolsbeta]
12:20 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-cli [toolsbeta]
12:18 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-presto1017.eqiad.wmnet with reason: host reimage [production]
12:15 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-cli [toolsbeta]
12:15 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-cli [toolsbeta]
12:11 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-presto1015.eqiad.wmnet with reason: host reimage [production]
12:07 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-presto1015.eqiad.wmnet with reason: host reimage [production]
12:04 <moritzm> failover ganeti master in drmrs02 to ganeti6004 [production]
12:02 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-presto1009.eqiad.wmnet with OS bookworm [production]
12:01 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-presto1017.eqiad.wmnet with OS bookworm [production]
12:00 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6004.drmrs.wmnet [production]
12:00 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti6004.drmrs.wmnet [production]
11:59 <hashar> integration: on Castor: `sudo rm -fR /srv/castor/*/*/*codehealth*/npm` # T427822 [releng]
11:55 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-cli [toolsbeta]
11:55 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-cli [toolsbeta]
11:53 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ganeti6004.drmrs.wmnet [production]
11:53 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-presto1015.eqiad.wmnet with OS bookworm [production]
11:50 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db1159.eqiad.wmnet onto db1274.eqiad.wmnet [production]
11:50 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1159: Pool db1159.eqiad.wmnet in after cloning [production]