1-50 of 10000 results (97ms)
2026-01-09 ยง
21:28 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
21:28 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1259 (T413525)', diff saved to https://phabricator.wikimedia.org/P87035 and previous config saved to /var/cache/conftool/dbconfig/20260109-212830-marostegui.json [production]
21:18 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to https://phabricator.wikimedia.org/P87034 and previous config saved to /var/cache/conftool/dbconfig/20260109-211822-marostegui.json [production]
21:08 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to https://phabricator.wikimedia.org/P87033 and previous config saved to /var/cache/conftool/dbconfig/20260109-210813-marostegui.json [production]
20:58 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1259 (T413525)', diff saved to https://phabricator.wikimedia.org/P87032 and previous config saved to /var/cache/conftool/dbconfig/20260109-205805-marostegui.json [production]
20:28 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1259 (T413525)', diff saved to https://phabricator.wikimedia.org/P87031 and previous config saved to /var/cache/conftool/dbconfig/20260109-202821-marostegui.json [production]
20:28 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1259.eqiad.wmnet with reason: Maintenance [production]
20:27 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1254 (T413525)', diff saved to https://phabricator.wikimedia.org/P87030 and previous config saved to /var/cache/conftool/dbconfig/20260109-202756-marostegui.json [production]
20:23 <jhathaway@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on wdqs1029.eqiad.wmnet with reason: T412451 [production]
20:21 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcontrol1008-dev.eqiad.wmnet with OS trixie [production]
20:19 <jhathaway@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1029.eqiad.wmnet with OS trixie [production]
20:17 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P87029 and previous config saved to /var/cache/conftool/dbconfig/20260109-201748-marostegui.json [production]
20:07 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P87028 and previous config saved to /var/cache/conftool/dbconfig/20260109-200739-marostegui.json [production]
20:02 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcontrol1008-dev.eqiad.wmnet with reason: host reimage [production]
20:00 <jhathaway@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
19:59 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcontrol1008-dev.eqiad.wmnet with reason: host reimage [production]
19:57 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1254 (T413525)', diff saved to https://phabricator.wikimedia.org/P87027 and previous config saved to /var/cache/conftool/dbconfig/20260109-195731-marostegui.json [production]
19:54 <jhathaway@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
19:49 <cstone> payments-wiki upgraded from 02dbb1e2 to 14d8501a [production]
19:43 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcontrol1008-dev.eqiad.wmnet with OS trixie [production]
19:40 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2238 (T413525)', diff saved to https://phabricator.wikimedia.org/P87026 and previous config saved to /var/cache/conftool/dbconfig/20260109-194001-marostegui.json [production]
19:36 <jhathaway@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1029.eqiad.wmnet with OS trixie [production]
19:29 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2238', diff saved to https://phabricator.wikimedia.org/P87025 and previous config saved to /var/cache/conftool/dbconfig/20260109-192953-marostegui.json [production]
19:28 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1254 (T413525)', diff saved to https://phabricator.wikimedia.org/P87024 and previous config saved to /var/cache/conftool/dbconfig/20260109-192844-marostegui.json [production]
19:28 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1254.eqiad.wmnet with reason: Maintenance [production]
19:19 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2238', diff saved to https://phabricator.wikimedia.org/P87023 and previous config saved to /var/cache/conftool/dbconfig/20260109-191944-marostegui.json [production]
19:09 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2238 (T413525)', diff saved to https://phabricator.wikimedia.org/P87022 and previous config saved to /var/cache/conftool/dbconfig/20260109-190936-marostegui.json [production]
19:01 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1239.eqiad.wmnet with reason: Maintenance [production]
19:01 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1233 (T413525)', diff saved to https://phabricator.wikimedia.org/P87021 and previous config saved to /var/cache/conftool/dbconfig/20260109-190128-marostegui.json [production]
18:57 <jhathaway@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1029.eqiad.wmnet with OS trixie [production]
18:51 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1233', diff saved to https://phabricator.wikimedia.org/P87020 and previous config saved to /var/cache/conftool/dbconfig/20260109-185120-marostegui.json [production]
18:49 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:47 <cmooney@cumin1003> START - Cookbook sre.dns.netbox [production]
18:46 <cmooney@dns2005> END - running authdns-update [production]
18:46 <cmooney@dns2005> START - running authdns-update [production]
18:44 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:44 <cmooney@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add DNS for codfw lsw1-a4 to mr1-codfw IPv6 IPs - cmooney@cumin1003" [production]
18:44 <cmooney@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add DNS for codfw lsw1-a4 to mr1-codfw IPv6 IPs - cmooney@cumin1003" [production]
18:41 <cmooney@cumin1003> START - Cookbook sre.dns.netbox [production]
18:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1233', diff saved to https://phabricator.wikimedia.org/P87019 and previous config saved to /var/cache/conftool/dbconfig/20260109-184111-marostegui.json [production]
18:39 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2238 (T413525)', diff saved to https://phabricator.wikimedia.org/P87018 and previous config saved to /var/cache/conftool/dbconfig/20260109-183939-marostegui.json [production]
18:39 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2238.codfw.wmnet with reason: Maintenance [production]
18:39 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2226 (T413525)', diff saved to https://phabricator.wikimedia.org/P87017 and previous config saved to /var/cache/conftool/dbconfig/20260109-183926-marostegui.json [production]
18:39 <jhathaway@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
18:31 <jhathaway@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
18:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1233 (T413525)', diff saved to https://phabricator.wikimedia.org/P87016 and previous config saved to /var/cache/conftool/dbconfig/20260109-183103-marostegui.json [production]
18:29 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P87015 and previous config saved to /var/cache/conftool/dbconfig/20260109-182917-marostegui.json [production]
18:19 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P87014 and previous config saved to /var/cache/conftool/dbconfig/20260109-181908-marostegui.json [production]
18:13 <jhathaway@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1029.eqiad.wmnet with OS trixie [production]
18:09 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2226 (T413525)', diff saved to https://phabricator.wikimedia.org/P87013 and previous config saved to /var/cache/conftool/dbconfig/20260109-180900-marostegui.json [production]