5251-5300 of 10000 results (51ms)
2025-06-10 ยง
15:29 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
15:27 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1227 (T395241)', diff saved to https://phabricator.wikimedia.org/P77546 and previous config saved to /var/cache/conftool/dbconfig/20250610-152738-fceratto.json [production]
15:22 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2238 (T396130)', diff saved to https://phabricator.wikimedia.org/P77545 and previous config saved to /var/cache/conftool/dbconfig/20250610-152243-marostegui.json [production]
15:22 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
15:21 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission [tools]
15:15 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [tools]
15:14 <klausman@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-lab1002.eqiad.wmnet [production]
15:10 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission [toolsbeta]
15:09 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2238 (T396130)', diff saved to https://phabricator.wikimedia.org/P77544 and previous config saved to /var/cache/conftool/dbconfig/20250610-150954-marostegui.json [production]
15:09 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2238.codfw.wmnet with reason: Maintenance [production]
15:09 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2226 (T396130)', diff saved to https://phabricator.wikimedia.org/P77543 and previous config saved to /var/cache/conftool/dbconfig/20250610-150931-marostegui.json [production]
15:08 <brennen@deploy1003> Finished deploy [phabricator/deployment@f8d7b38]: deploy phab1004 for T396490 (duration: 00m 39s) [production]
15:08 <brennen@deploy1003> Started deploy [phabricator/deployment@f8d7b38]: deploy phab1004 for T396490 [production]
15:08 <klausman@cumin1003> START - Cookbook sre.hosts.reboot-single for host ml-lab1002.eqiad.wmnet [production]
15:07 <brennen@deploy1003> Finished deploy [phabricator/deployment@f8d7b38]: test deploy phab2002 for T396490 (duration: 00m 40s) [production]
15:07 <klausman@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-lab1001.eqiad.wmnet [production]
15:07 <brennen@deploy1003> Started deploy [phabricator/deployment@f8d7b38]: test deploy phab2002 for T396490 [production]
15:07 <aokoth@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab2002.codfw.wmnet with reason: Phorge Update [production]
15:05 <stevemunene> roll restart analytics zookeeper to add new host T374922 [analytics]
15:05 <aokoth@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab1004.eqiad.wmnet with reason: Phorge Update [production]
15:04 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [toolsbeta]
15:02 <jmm@cumin1003> START - Cookbook sre.hosts.reimage for host install7002.wikimedia.org with OS bookworm [production]
15:02 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1028.eqiad.wmnet [production]
15:02 <jmm@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1028.eqiad.wmnet [production]
15:01 <klausman@cumin1003> START - Cookbook sre.hosts.reboot-single for host ml-lab1001.eqiad.wmnet [production]
15:01 <taavi@dns1004> END - running authdns-update [production]
15:00 <taavi@dns1004> START - running authdns-update [production]
14:59 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [tools]
14:58 <taavi@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:58 <taavi@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add wiki replica cloudlb v6 addresses - taavi@cumin1003" [production]
14:58 <taavi@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add wiki replica cloudlb v6 addresses - taavi@cumin1003" [production]
14:57 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [tools]
14:56 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [toolsbeta]
14:56 <jmm@cumin1003> START - Cookbook sre.hosts.reboot-single for host ganeti1028.eqiad.wmnet [production]
14:55 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1028.eqiad.wmnet [production]
14:54 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [toolsbeta]
14:54 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P77542 and previous config saved to /var/cache/conftool/dbconfig/20250610-145424-marostegui.json [production]
14:54 <taavi@cumin1003> START - Cookbook sre.dns.netbox [production]
14:53 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
14:53 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
14:51 <marostegui@cumin1002> dbctl commit (dc=all): 'Repool pc1 T378715', diff saved to https://phabricator.wikimedia.org/P77541 and previous config saved to /var/cache/conftool/dbconfig/20250610-145137-marostegui.json [production]
14:49 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts cirrussearch1063.eqiad.wmnet [production]
14:49 <bking@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:49 <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cirrussearch1063.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - bking@cumin2002" [production]
14:49 <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cirrussearch1063.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - bking@cumin2002" [production]
14:39 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P77539 and previous config saved to /var/cache/conftool/dbconfig/20250610-143917-marostegui.json [production]
14:37 <James_F> Zuul: [maps/*] Mark all as archived [releng]
14:36 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
14:36 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
14:36 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1227 (T395241)', diff saved to https://phabricator.wikimedia.org/P77538 and previous config saved to /var/cache/conftool/dbconfig/20250610-143623-fceratto.json [production]