601-650 of 10000 results (14ms)
2026-08-18 ยง
09:31 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
09:31 <fceratto@cumin1003> START - Cookbook sre.ganeti.makevm for new host db1901.eqiad.wmnet [production]
09:31 <fceratto@cumin1003> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db1901.eqiad.wmnet [production]
09:31 <fceratto@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
09:31 <fceratto@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db1901.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - fceratto@cumin1003" [production]
09:31 <fceratto@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db1901.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - fceratto@cumin1003" [production]
09:29 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2040.codfw.wmnet [production]
09:29 <slyngshede@dns1004> END - running authdns-update [production]
09:28 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2039.codfw.wmnet [production]
09:28 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2039.codfw.wmnet [production]
09:27 <slyngshede@dns1004> START - running authdns-update [production]
09:26 <slyngshede@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test2005.wikimedia.org [production]
09:24 <hashar> zuul: restarted zuul-web [releng]
09:22 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ganeti2039.codfw.wmnet [production]
09:22 <slyngshede@cumin1003> START - Cookbook sre.hosts.reboot-single for host idp-test2005.wikimedia.org [production]
09:22 <slyngshede@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp1005.wikimedia.org [production]
09:21 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
09:19 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2039.codfw.wmnet [production]
09:19 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2038.codfw.wmnet [production]
09:18 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1287: Pool back [production]
09:18 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2038.codfw.wmnet [production]
09:18 <slyngshede@cumin1003> START - Cookbook sre.hosts.reboot-single for host idp1005.wikimedia.org [production]
09:18 <slyngshede@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test1005.wikimedia.org [production]
09:17 <fceratto@cumin1003> START - Cookbook sre.hosts.decommission for hosts db1901.eqiad.wmnet [production]
09:15 <fceratto@cumin1003> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host db1901.eqiad.wmnet [production]
09:15 <fceratto@cumin1003> END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) [production]
09:14 <slyngshede@cumin1003> START - Cookbook sre.hosts.reboot-single for host idp-test1005.wikimedia.org [production]
09:13 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ganeti2038.codfw.wmnet [production]
09:13 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
09:13 <fceratto@cumin1003> START - Cookbook sre.ganeti.makevm for new host db1901.eqiad.wmnet [production]
09:13 <wmbot~jeanfred@tools-bastion-15> Deploy b75abe2 (Add pre-commit hook to reformat pyproject.toml using pyproject-fmt) [tools.integraality]
09:13 <wmbot~jeanfred@tools-bastion-15> Deploy fd89068 (Reformat pyproject.toml using pyproject-fmt) [tools.integraality]
09:13 <wmbot~jeanfred@tools-bastion-15> Deploy 5cc67af (Add pre-commit hook to validate docker-compose.yml against Compose schema) [tools.integraality]
09:12 <wmbot~jeanfred@tools-bastion-15> Deploy 5da6acb (Add pre-commit hook to validate toolinfo.json against Toolhub schema) [tools.integraality]
09:12 <wmbot~jeanfred@tools-bastion-15> Deploy 66c6495 (Fix tool type in toolinfo.json, as lists are not accepted) [tools.integraality]
09:11 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host bast4006.wikimedia.org [production]
09:10 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1288: Pool back [production]
09:04 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast5005.wikimedia.org [production]
09:03 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2038.codfw.wmnet [production]
08:57 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2037.codfw.wmnet [production]
08:57 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host bast5005.wikimedia.org [production]
08:57 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2037.codfw.wmnet [production]
08:56 <filippo@cumin1003> START - Cookbook sre.mysql.multiinstance_reboot for 10 hosts [production]
08:52 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ganeti2037.codfw.wmnet [production]
08:51 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1289: Pool back [production]
08:35 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudidp2001-dev.codfw.wmnet [production]
08:34 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudbackup1002-dev.eqiad.wmnet [production]
08:33 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db1287: Pool back [production]
08:33 <marostegui@cumin1003> dbctl commit (dc=all): 'Add db1287 to dbctl T407942', diff saved to https://phabricator.wikimedia.org/P96150 and previous config saved to /var/cache/conftool/dbconfig/20260818-083311-marostegui.json [production]
08:32 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudbackup1001-dev.eqiad.wmnet [production]