1201-1250 of 10000 results (94ms)
2025-07-22 ยง
21:36 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2173', diff saved to https://phabricator.wikimedia.org/P79665 and previous config saved to /var/cache/conftool/dbconfig/20250722-213652-fceratto.json [production]
21:29 <andrew@cumin1003> START - Cookbook sre.hosts.reimage for host cloudcephmon2005-dev.codfw.wmnet with OS bullseye [production]
21:21 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2173 (T399728)', diff saved to https://phabricator.wikimedia.org/P79664 and previous config saved to /var/cache/conftool/dbconfig/20250722-212144-fceratto.json [production]
21:18 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2173 (T399728)', diff saved to https://phabricator.wikimedia.org/P79662 and previous config saved to /var/cache/conftool/dbconfig/20250722-211803-fceratto.json [production]
21:17 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2173.codfw.wmnet with reason: Maintenance [production]
21:17 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2170 (T399728)', diff saved to https://phabricator.wikimedia.org/P79661 and previous config saved to /var/cache/conftool/dbconfig/20250722-211739-fceratto.json [production]
21:02 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2170', diff saved to https://phabricator.wikimedia.org/P79660 and previous config saved to /var/cache/conftool/dbconfig/20250722-210232-fceratto.json [production]
20:56 <andrew@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephmon2004-dev.codfw.wmnet with OS bullseye [production]
20:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2220 (T399249)', diff saved to https://phabricator.wikimedia.org/P79659 and previous config saved to /var/cache/conftool/dbconfig/20250722-205039-marostegui.json [production]
20:50 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2220.codfw.wmnet with reason: Maintenance [production]
20:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2208 (T399249)', diff saved to https://phabricator.wikimedia.org/P79658 and previous config saved to /var/cache/conftool/dbconfig/20250722-205017-marostegui.json [production]
20:47 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2170', diff saved to https://phabricator.wikimedia.org/P79657 and previous config saved to /var/cache/conftool/dbconfig/20250722-204725-fceratto.json [production]
20:38 <andrew@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephmon2004-dev.codfw.wmnet with reason: host reimage [production]
20:35 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2208', diff saved to https://phabricator.wikimedia.org/P79656 and previous config saved to /var/cache/conftool/dbconfig/20250722-203509-marostegui.json [production]
20:32 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2170 (T399728)', diff saved to https://phabricator.wikimedia.org/P79655 and previous config saved to /var/cache/conftool/dbconfig/20250722-203217-fceratto.json [production]
20:31 <andrew@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephmon2004-dev.codfw.wmnet with reason: host reimage [production]
20:28 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2170 (T399728)', diff saved to https://phabricator.wikimedia.org/P79654 and previous config saved to /var/cache/conftool/dbconfig/20250722-202835-fceratto.json [production]
20:28 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2170.codfw.wmnet with reason: Maintenance [production]
20:28 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2153 (T399728)', diff saved to https://phabricator.wikimedia.org/P79653 and previous config saved to /var/cache/conftool/dbconfig/20250722-202813-fceratto.json [production]
20:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2208', diff saved to https://phabricator.wikimedia.org/P79651 and previous config saved to /var/cache/conftool/dbconfig/20250722-202002-marostegui.json [production]
20:15 <andrew@cumin1003> START - Cookbook sre.hosts.reimage for host cloudcephmon2004-dev.codfw.wmnet with OS bullseye [production]
20:13 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2153', diff saved to https://phabricator.wikimedia.org/P79650 and previous config saved to /var/cache/conftool/dbconfig/20250722-201305-fceratto.json [production]
20:04 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2208 (T399249)', diff saved to https://phabricator.wikimedia.org/P79649 and previous config saved to /var/cache/conftool/dbconfig/20250722-200454-marostegui.json [production]
19:57 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2153', diff saved to https://phabricator.wikimedia.org/P79648 and previous config saved to /var/cache/conftool/dbconfig/20250722-195757-fceratto.json [production]
19:44 <otto@deploy1003> helmfile [codfw] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
19:43 <otto@deploy1003> helmfile [codfw] START helmfile.d/services/eventgate-analytics-external: apply [production]
19:42 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2153 (T399728)', diff saved to https://phabricator.wikimedia.org/P79647 and previous config saved to /var/cache/conftool/dbconfig/20250722-194250-fceratto.json [production]
19:41 <otto@deploy1003> helmfile [staging] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
19:41 <otto@deploy1003> helmfile [staging] START helmfile.d/services/eventgate-analytics-external: apply [production]
19:41 <ottomata> deploying eventgate-logging-external and eventgate-analytics-external to pick up meta.dt change - T376026 [production]
19:41 <eileen> civicrm upgraded from 63c1860b to 5eed1b2a [production]
19:40 <otto@deploy1003> helmfile [eqiad] DONE helmfile.d/services/eventgate-logging-external: apply [production]
19:39 <otto@deploy1003> helmfile [eqiad] START helmfile.d/services/eventgate-logging-external: apply [production]
19:39 <otto@deploy1003> helmfile [codfw] DONE helmfile.d/services/eventgate-logging-external: apply [production]
19:39 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2153 (T399728)', diff saved to https://phabricator.wikimedia.org/P79646 and previous config saved to /var/cache/conftool/dbconfig/20250722-193908-fceratto.json [production]
19:39 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2153.codfw.wmnet with reason: Maintenance [production]
19:38 <otto@deploy1003> helmfile [codfw] START helmfile.d/services/eventgate-logging-external: apply [production]
19:38 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2146 (T399728)', diff saved to https://phabricator.wikimedia.org/P79645 and previous config saved to /var/cache/conftool/dbconfig/20250722-193846-fceratto.json [production]
19:37 <otto@deploy1003> helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply [production]
19:36 <otto@deploy1003> helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply [production]
19:23 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P79644 and previous config saved to /var/cache/conftool/dbconfig/20250722-192338-fceratto.json [production]
19:15 <jgreen@dns1004> END - running authdns-update [production]
19:14 <jgreen@dns1004> START - running authdns-update [production]
19:08 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P79643 and previous config saved to /var/cache/conftool/dbconfig/20250722-190830-fceratto.json [production]
19:01 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2208 (T399249)', diff saved to https://phabricator.wikimedia.org/P79642 and previous config saved to /var/cache/conftool/dbconfig/20250722-190144-marostegui.json [production]
19:01 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2208.codfw.wmnet with reason: Maintenance [production]
18:53 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2146 (T399728)', diff saved to https://phabricator.wikimedia.org/P79641 and previous config saved to /var/cache/conftool/dbconfig/20250722-185323-fceratto.json [production]
18:49 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2146 (T399728)', diff saved to https://phabricator.wikimedia.org/P79640 and previous config saved to /var/cache/conftool/dbconfig/20250722-184932-fceratto.json [production]
18:49 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2146.codfw.wmnet with reason: Maintenance [production]
18:49 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host doh7004.wikimedia.org with OS bookworm [production]