51-100 of 10000 results (22ms)
2026-01-09 ยง
18:13 <jhathaway@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1029.eqiad.wmnet with OS trixie [production]
18:09 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2226 (T413525)', diff saved to https://phabricator.wikimedia.org/P87013 and previous config saved to /var/cache/conftool/dbconfig/20260109-180900-marostegui.json [production]
18:01 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1233 (T413525)', diff saved to https://phabricator.wikimedia.org/P87012 and previous config saved to /var/cache/conftool/dbconfig/20260109-180112-marostegui.json [production]
18:01 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1233.eqiad.wmnet with reason: Maintenance [production]
18:00 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1229 (T413525)', diff saved to https://phabricator.wikimedia.org/P87011 and previous config saved to /var/cache/conftool/dbconfig/20260109-180047-marostegui.json [production]
17:56 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2226 (T413525)', diff saved to https://phabricator.wikimedia.org/P87010 and previous config saved to /var/cache/conftool/dbconfig/20260109-175609-marostegui.json [production]
17:56 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2226.codfw.wmnet with reason: Maintenance [production]
17:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2225 (T413525)', diff saved to https://phabricator.wikimedia.org/P87009 and previous config saved to /var/cache/conftool/dbconfig/20260109-175544-marostegui.json [production]
17:50 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1229', diff saved to https://phabricator.wikimedia.org/P87008 and previous config saved to /var/cache/conftool/dbconfig/20260109-175039-marostegui.json [production]
17:48 <jhathaway@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1029.eqiad.wmnet with OS trixie [production]
17:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2225', diff saved to https://phabricator.wikimedia.org/P87007 and previous config saved to /var/cache/conftool/dbconfig/20260109-174536-marostegui.json [production]
17:40 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1229', diff saved to https://phabricator.wikimedia.org/P87006 and previous config saved to /var/cache/conftool/dbconfig/20260109-174031-marostegui.json [production]
17:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2225', diff saved to https://phabricator.wikimedia.org/P87005 and previous config saved to /var/cache/conftool/dbconfig/20260109-173527-marostegui.json [production]
17:33 <thcipriani> re-enabling beta update jobs after test bad extension-list T411516 [releng]
17:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1229 (T413525)', diff saved to https://phabricator.wikimedia.org/P87004 and previous config saved to /var/cache/conftool/dbconfig/20260109-173023-marostegui.json [production]
17:29 <jhathaway@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
17:25 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2225 (T413525)', diff saved to https://phabricator.wikimedia.org/P87003 and previous config saved to /var/cache/conftool/dbconfig/20260109-172519-marostegui.json [production]
17:23 <jhathaway@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
17:19 <wmftkbot> Test Kitchen edge-unique experiments (poll 132501) - adds: synth-aa-test-traffic-impact; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
17:13 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:13 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
17:13 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
17:10 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
17:09 <thcipriani> disabling beta update jobs to test bad extension-list T411516) [releng]
17:07 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:07 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
17:07 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
17:04 <jhathaway@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1029.eqiad.wmnet with OS trixie [production]
17:00 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1229 (T413525)', diff saved to https://phabricator.wikimedia.org/P87002 and previous config saved to /var/cache/conftool/dbconfig/20260109-170033-marostegui.json [production]
17:00 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1229.eqiad.wmnet with reason: Maintenance [production]
16:57 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:56 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply [production]
16:56 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2225 (T413525)', diff saved to https://phabricator.wikimedia.org/P87001 and previous config saved to /var/cache/conftool/dbconfig/20260109-165619-marostegui.json [production]
16:56 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply [production]
16:56 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2225.codfw.wmnet with reason: Maintenance [production]
16:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2207 (T413525)', diff saved to https://phabricator.wikimedia.org/P87000 and previous config saved to /var/cache/conftool/dbconfig/20260109-165554-marostegui.json [production]
16:54 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:54 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
16:54 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add missing DNS for IPV6 - pt1979@cumin2002" [production]
16:49 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P86999 and previous config saved to /var/cache/conftool/dbconfig/20260109-164546-marostegui.json [production]
16:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P86998 and previous config saved to /var/cache/conftool/dbconfig/20260109-163538-marostegui.json [production]
16:33 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1225.eqiad.wmnet with reason: Maintenance [production]
16:33 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1197 (T413525)', diff saved to https://phabricator.wikimedia.org/P86997 and previous config saved to /var/cache/conftool/dbconfig/20260109-163320-marostegui.json [production]
16:25 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2207 (T413525)', diff saved to https://phabricator.wikimedia.org/P86996 and previous config saved to /var/cache/conftool/dbconfig/20260109-162529-marostegui.json [production]
16:23 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1197', diff saved to https://phabricator.wikimedia.org/P86995 and previous config saved to /var/cache/conftool/dbconfig/20260109-162312-marostegui.json [production]
16:13 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2199.codfw.wmnet with reason: Maintenance [production]
16:13 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2172 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86994 and previous config saved to /var/cache/conftool/dbconfig/20260109-161326-marostegui.json [production]
16:13 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1197', diff saved to https://phabricator.wikimedia.org/P86993 and previous config saved to /var/cache/conftool/dbconfig/20260109-161304-marostegui.json [production]
16:03 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P86992 and previous config saved to /var/cache/conftool/dbconfig/20260109-160318-marostegui.json [production]