351-400 of 10000 results (100ms)
2026-01-09 ยง
18:44 <cmooney@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add DNS for codfw lsw1-a4 to mr1-codfw IPv6 IPs - cmooney@cumin1003" [production]
18:41 <cmooney@cumin1003> START - Cookbook sre.dns.netbox [production]
18:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1233', diff saved to https://phabricator.wikimedia.org/P87019 and previous config saved to /var/cache/conftool/dbconfig/20260109-184111-marostegui.json [production]
18:39 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2238 (T413525)', diff saved to https://phabricator.wikimedia.org/P87018 and previous config saved to /var/cache/conftool/dbconfig/20260109-183939-marostegui.json [production]
18:39 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2238.codfw.wmnet with reason: Maintenance [production]
18:39 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2226 (T413525)', diff saved to https://phabricator.wikimedia.org/P87017 and previous config saved to /var/cache/conftool/dbconfig/20260109-183926-marostegui.json [production]
18:39 <jhathaway@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
18:31 <jhathaway@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
18:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1233 (T413525)', diff saved to https://phabricator.wikimedia.org/P87016 and previous config saved to /var/cache/conftool/dbconfig/20260109-183103-marostegui.json [production]
18:29 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P87015 and previous config saved to /var/cache/conftool/dbconfig/20260109-182917-marostegui.json [production]
18:19 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P87014 and previous config saved to /var/cache/conftool/dbconfig/20260109-181908-marostegui.json [production]
18:13 <jhathaway@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1029.eqiad.wmnet with OS trixie [production]
18:09 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2226 (T413525)', diff saved to https://phabricator.wikimedia.org/P87013 and previous config saved to /var/cache/conftool/dbconfig/20260109-180900-marostegui.json [production]
18:01 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1233 (T413525)', diff saved to https://phabricator.wikimedia.org/P87012 and previous config saved to /var/cache/conftool/dbconfig/20260109-180112-marostegui.json [production]
18:01 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1233.eqiad.wmnet with reason: Maintenance [production]
18:00 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1229 (T413525)', diff saved to https://phabricator.wikimedia.org/P87011 and previous config saved to /var/cache/conftool/dbconfig/20260109-180047-marostegui.json [production]
17:56 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2226 (T413525)', diff saved to https://phabricator.wikimedia.org/P87010 and previous config saved to /var/cache/conftool/dbconfig/20260109-175609-marostegui.json [production]
17:56 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2226.codfw.wmnet with reason: Maintenance [production]
17:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2225 (T413525)', diff saved to https://phabricator.wikimedia.org/P87009 and previous config saved to /var/cache/conftool/dbconfig/20260109-175544-marostegui.json [production]
17:50 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1229', diff saved to https://phabricator.wikimedia.org/P87008 and previous config saved to /var/cache/conftool/dbconfig/20260109-175039-marostegui.json [production]
17:48 <jhathaway@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1029.eqiad.wmnet with OS trixie [production]
17:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2225', diff saved to https://phabricator.wikimedia.org/P87007 and previous config saved to /var/cache/conftool/dbconfig/20260109-174536-marostegui.json [production]
17:40 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1229', diff saved to https://phabricator.wikimedia.org/P87006 and previous config saved to /var/cache/conftool/dbconfig/20260109-174031-marostegui.json [production]
17:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2225', diff saved to https://phabricator.wikimedia.org/P87005 and previous config saved to /var/cache/conftool/dbconfig/20260109-173527-marostegui.json [production]
17:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1229 (T413525)', diff saved to https://phabricator.wikimedia.org/P87004 and previous config saved to /var/cache/conftool/dbconfig/20260109-173023-marostegui.json [production]
17:29 <jhathaway@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
17:25 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2225 (T413525)', diff saved to https://phabricator.wikimedia.org/P87003 and previous config saved to /var/cache/conftool/dbconfig/20260109-172519-marostegui.json [production]
17:23 <jhathaway@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
17:13 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:13 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
17:13 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
17:10 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
17:07 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:07 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
17:07 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
17:04 <jhathaway@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1029.eqiad.wmnet with OS trixie [production]
17:00 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1229 (T413525)', diff saved to https://phabricator.wikimedia.org/P87002 and previous config saved to /var/cache/conftool/dbconfig/20260109-170033-marostegui.json [production]
17:00 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1229.eqiad.wmnet with reason: Maintenance [production]
16:57 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:56 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply [production]
16:56 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2225 (T413525)', diff saved to https://phabricator.wikimedia.org/P87001 and previous config saved to /var/cache/conftool/dbconfig/20260109-165619-marostegui.json [production]
16:56 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply [production]
16:56 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2225.codfw.wmnet with reason: Maintenance [production]
16:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2207 (T413525)', diff saved to https://phabricator.wikimedia.org/P87000 and previous config saved to /var/cache/conftool/dbconfig/20260109-165554-marostegui.json [production]
16:54 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:54 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
16:54 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
16:49 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P86999 and previous config saved to /var/cache/conftool/dbconfig/20260109-164546-marostegui.json [production]
16:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P86998 and previous config saved to /var/cache/conftool/dbconfig/20260109-163538-marostegui.json [production]