201-250 of 10000 results (21ms)
2025-07-30 ยง
11:56 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1241 (T399728)', diff saved to https://phabricator.wikimedia.org/P80298 and previous config saved to /var/cache/conftool/dbconfig/20250730-115614-fceratto.json [production]
11:56 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-search: apply [production]
11:55 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-search: apply [production]
11:54 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-research: apply [production]
11:53 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-research: apply [production]
11:52 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-ml: apply [production]
11:51 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-ml: apply [production]
11:51 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1241 (T399728)', diff saved to https://phabricator.wikimedia.org/P80297 and previous config saved to /var/cache/conftool/dbconfig/20250730-115112-fceratto.json [production]
11:51 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1241.eqiad.wmnet with reason: Maintenance [production]
11:50 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply [production]
11:50 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1238 (T399728)', diff saved to https://phabricator.wikimedia.org/P80296 and previous config saved to /var/cache/conftool/dbconfig/20250730-115049-fceratto.json [production]
11:50 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply [production]
11:47 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply [production]
11:47 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply [production]
11:46 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
11:45 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
11:41 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
11:41 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
11:40 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
11:39 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
11:35 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P80295 and previous config saved to /var/cache/conftool/dbconfig/20250730-113541-fceratto.json [production]
11:34 <mvolz@deploy1003> helmfile [eqiad] DONE helmfile.d/services/zotero: apply [production]
11:34 <mvolz@deploy1003> helmfile [eqiad] START helmfile.d/services/zotero: apply [production]
11:33 <mvolz@deploy1003> helmfile [codfw] DONE helmfile.d/services/zotero: apply [production]
11:33 <mvolz@deploy1003> helmfile [codfw] START helmfile.d/services/zotero: apply [production]
11:32 <mvolz@deploy1003> helmfile [codfw] DONE helmfile.d/services/zotero: apply [production]
11:32 <mvolz@deploy1003> helmfile [codfw] START helmfile.d/services/zotero: apply [production]
11:21 <mvolz@deploy1003> helmfile [staging] DONE helmfile.d/services/zotero: apply [production]
11:20 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P80294 and previous config saved to /var/cache/conftool/dbconfig/20250730-112034-fceratto.json [production]
11:19 <mvolz@deploy1003> helmfile [staging] START helmfile.d/services/zotero: apply [production]
11:16 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/thumbor: sync [production]
11:15 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/thumbor: sync [production]
11:07 <mvolz@deploy1003> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
11:07 <mvolz@deploy1003> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
11:05 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1238 (T399728)', diff saved to https://phabricator.wikimedia.org/P80293 and previous config saved to /var/cache/conftool/dbconfig/20250730-110526-fceratto.json [production]
11:05 <mvolz@deploy1003> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
11:04 <mvolz@deploy1003> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
11:01 <mvolz@deploy1003> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
11:01 <mvolz@deploy1003> helmfile [staging] START helmfile.d/services/citoid: apply [production]
10:59 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1238 (T399728)', diff saved to https://phabricator.wikimedia.org/P80292 and previous config saved to /var/cache/conftool/dbconfig/20250730-105926-fceratto.json [production]
10:59 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1238.eqiad.wmnet with reason: Maintenance [production]
10:59 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1221 (T399728)', diff saved to https://phabricator.wikimedia.org/P80291 and previous config saved to /var/cache/conftool/dbconfig/20250730-105904-fceratto.json [production]
10:43 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P80290 and previous config saved to /var/cache/conftool/dbconfig/20250730-104357-fceratto.json [production]
10:28 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P80289 and previous config saved to /var/cache/conftool/dbconfig/20250730-102850-fceratto.json [production]
10:13 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1221 (T399728)', diff saved to https://phabricator.wikimedia.org/P80288 and previous config saved to /var/cache/conftool/dbconfig/20250730-101343-fceratto.json [production]
10:09 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1221 (T399728)', diff saved to https://phabricator.wikimedia.org/P80287 and previous config saved to /var/cache/conftool/dbconfig/20250730-100934-fceratto.json [production]
10:09 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
10:09 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1221.eqiad.wmnet with reason: Maintenance [production]
10:08 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1199 (T399728)', diff saved to https://phabricator.wikimedia.org/P80286 and previous config saved to /var/cache/conftool/dbconfig/20250730-100854-fceratto.json [production]
09:53 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P80285 and previous config saved to /var/cache/conftool/dbconfig/20250730-095346-fceratto.json [production]