701-750 of 10000 results (123ms)
2025-07-23 ยง
10:13 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2180 (T399728)', diff saved to https://phabricator.wikimedia.org/P79721 and previous config saved to /var/cache/conftool/dbconfig/20250723-101358-fceratto.json [production]
10:12 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2180 (T399728)', diff saved to https://phabricator.wikimedia.org/P79720 and previous config saved to /var/cache/conftool/dbconfig/20250723-101226-fceratto.json [production]
10:12 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2180.codfw.wmnet with reason: Maintenance [production]
10:12 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2169 (T399728)', diff saved to https://phabricator.wikimedia.org/P79719 and previous config saved to /var/cache/conftool/dbconfig/20250723-101204-fceratto.json [production]
10:01 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
10:01 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
10:01 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
09:59 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
09:59 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
09:56 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2169', diff saved to https://phabricator.wikimedia.org/P79718 and previous config saved to /var/cache/conftool/dbconfig/20250723-095656-fceratto.json [production]
09:56 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
09:54 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
09:49 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
09:41 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2169', diff saved to https://phabricator.wikimedia.org/P79717 and previous config saved to /var/cache/conftool/dbconfig/20250723-094149-fceratto.json [production]
09:28 <gmodena@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
09:27 <gmodena@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
09:26 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2169 (T399728)', diff saved to https://phabricator.wikimedia.org/P79716 and previous config saved to /var/cache/conftool/dbconfig/20250723-092641-fceratto.json [production]
09:24 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2169 (T399728)', diff saved to https://phabricator.wikimedia.org/P79715 and previous config saved to /var/cache/conftool/dbconfig/20250723-092359-fceratto.json [production]
09:23 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2169.codfw.wmnet with reason: Maintenance [production]
09:23 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2158 (T399728)', diff saved to https://phabricator.wikimedia.org/P79714 and previous config saved to /var/cache/conftool/dbconfig/20250723-092336-fceratto.json [production]
09:15 <arnaudb@cumin1003> START - Cookbook sre.gitlab.failover Failover of gitlab from gitlab1004.wikimedia.org to gitlab1003.wikimedia.org [production]
09:08 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2158', diff saved to https://phabricator.wikimedia.org/P79712 and previous config saved to /var/cache/conftool/dbconfig/20250723-090829-fceratto.json [production]
08:53 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2158', diff saved to https://phabricator.wikimedia.org/P79711 and previous config saved to /var/cache/conftool/dbconfig/20250723-085321-fceratto.json [production]
08:38 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2158 (T399728)', diff saved to https://phabricator.wikimedia.org/P79710 and previous config saved to /var/cache/conftool/dbconfig/20250723-083814-fceratto.json [production]
08:35 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2158 (T399728)', diff saved to https://phabricator.wikimedia.org/P79709 and previous config saved to /var/cache/conftool/dbconfig/20250723-083531-fceratto.json [production]
08:35 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2158.codfw.wmnet with reason: Maintenance [production]
08:35 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2151 (T399728)', diff saved to https://phabricator.wikimedia.org/P79708 and previous config saved to /var/cache/conftool/dbconfig/20250723-083508-fceratto.json [production]
08:20 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2151', diff saved to https://phabricator.wikimedia.org/P79707 and previous config saved to /var/cache/conftool/dbconfig/20250723-082000-fceratto.json [production]
08:15 <gmodena@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
08:15 <gmodena@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
08:04 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2151', diff saved to https://phabricator.wikimedia.org/P79706 and previous config saved to /var/cache/conftool/dbconfig/20250723-080453-fceratto.json [production]
07:51 <gmodena@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
07:51 <gmodena@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
07:49 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2151 (T399728)', diff saved to https://phabricator.wikimedia.org/P79705 and previous config saved to /var/cache/conftool/dbconfig/20250723-074945-fceratto.json [production]
07:47 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2151 (T399728)', diff saved to https://phabricator.wikimedia.org/P79704 and previous config saved to /var/cache/conftool/dbconfig/20250723-074700-fceratto.json [production]
07:46 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2151.codfw.wmnet with reason: Maintenance [production]
07:19 <mvernon@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7:00:00 on aqs1012.eqiad.wmnet with reason: wait for eevans [production]
02:15 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2216 (T399728)', diff saved to https://phabricator.wikimedia.org/P79703 and previous config saved to /var/cache/conftool/dbconfig/20250723-021507-fceratto.json [production]
02:06 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2222 (T399249)', diff saved to https://phabricator.wikimedia.org/P79702 and previous config saved to /var/cache/conftool/dbconfig/20250723-020643-marostegui.json [production]
02:04 <swfrench@deploy1003> Finished scap sync-world: Test deployment to verify new php8.1 images - T383557 (duration: 34m 39s) [production]
02:00 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2216', diff saved to https://phabricator.wikimedia.org/P79701 and previous config saved to /var/cache/conftool/dbconfig/20250723-015959-fceratto.json [production]
01:51 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P79700 and previous config saved to /var/cache/conftool/dbconfig/20250723-015135-marostegui.json [production]
01:44 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2216', diff saved to https://phabricator.wikimedia.org/P79699 and previous config saved to /var/cache/conftool/dbconfig/20250723-014451-fceratto.json [production]
01:36 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P79698 and previous config saved to /var/cache/conftool/dbconfig/20250723-013627-marostegui.json [production]
01:32 <swfrench@deploy1003> Started scap sync-world: Test deployment to verify new php8.1 images - T383557 [production]
01:29 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2216 (T399728)', diff saved to https://phabricator.wikimedia.org/P79697 and previous config saved to /var/cache/conftool/dbconfig/20250723-012944-fceratto.json [production]
01:26 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2216 (T399728)', diff saved to https://phabricator.wikimedia.org/P79696 and previous config saved to /var/cache/conftool/dbconfig/20250723-012559-fceratto.json [production]
01:25 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2216.codfw.wmnet with reason: Maintenance [production]
01:21 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2222 (T399249)', diff saved to https://phabricator.wikimedia.org/P79695 and previous config saved to /var/cache/conftool/dbconfig/20250723-012120-marostegui.json [production]
00:46 <swfrench-wmf> rebuilt php8.1 production images (8.1.33-1-s2) on build2001 - T383557 [production]