851-900 of 10000 results (70ms)
2023-06-20 ยง
19:13 <otto@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
19:13 <otto@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
19:13 <otto@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
19:13 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on dbproxy1022.eqiad.wmnet with reason: host reimage [production]
19:13 <otto@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
19:09 <otto@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
19:08 <otto@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:07 <otto@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:06 <otto@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
19:05 <otto@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
19:05 <otto@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
19:04 <otto@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
18:54 <otto@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:54 <otto@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:50 <otto@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:50 <otto@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:47 <otto@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:47 <otto@deploy1002> helmfile [codfw] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:37 <otto@deploy1002> helmfile [staging] START helmfile.d/services/eventstreams-internal: apply [production]
18:37 <robh@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy1022.eqiad.wmnet with OS bullseye [production]
18:33 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
18:28 <otto@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:28 <otto@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:28 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
18:26 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
18:24 <otto@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:24 <otto@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:18 <otto@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:17 <otto@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:13 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@d55173d]: (no justification provided) (duration: 00m 11s) [production]
18:12 <mforns@deploy1002> Started deploy [airflow-dags/analytics@d55173d]: (no justification provided) [production]
18:03 <joal@deploy1002> Finished deploy [analytics/refinery@181eac6] (hadoop-test): Hotfix analytics deploy TEST [analytics/refinery@181eac6] (duration: 01m 52s) [production]
18:01 <joal@deploy1002> Started deploy [analytics/refinery@181eac6] (hadoop-test): Hotfix analytics deploy TEST [analytics/refinery@181eac6] [production]
18:01 <joal@deploy1002> Finished deploy [analytics/refinery@181eac6] (thin): Hotfix analytics deploy THIN [analytics/refinery@181eac6] (duration: 00m 04s) [production]
18:01 <joal@deploy1002> Started deploy [analytics/refinery@181eac6] (thin): Hotfix analytics deploy THIN [analytics/refinery@181eac6] [production]
18:00 <joal@deploy1002> Finished deploy [analytics/refinery@181eac6]: Hotfix analytics deploy [analytics/refinery@181eac6] (duration: 06m 22s) [production]
17:54 <joal@deploy1002> Started deploy [analytics/refinery@181eac6]: Hotfix analytics deploy [analytics/refinery@181eac6] [production]
17:54 <sukhe> running authdns-update for T339942 [production]
17:44 <ottomata> remove stream-enrichment-poc namespace and related resources from dse-k8s-eqiad - T325303 [production]
17:44 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:44 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
17:13 <brett@cumin2002> START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-text_esams [production]
16:59 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
16:55 <brett@cumin2002> START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp3053.esams.wmnet,cp3055.esams.wmnet,cp3057.esams.wmnet,cp3059.esams.wmnet,cp3061.esams.wmnet,cp3063.esams.wmnet,cp3065.esams.wmnet} and A:cp [production]
16:52 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
16:52 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
16:52 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
16:52 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
16:49 <brett@cumin2002> END (ERROR) - Cookbook sre.cdn.roll-reboot (exit_code=97) rolling reboot on P{cp3053.esams.wmnet,cp3055.esams.wmnet,cp3057.esams.wmnet,cp3059.esams.wmnet,cp3061.esams.wmnet,cp3063.esams.wmnet,cp3065.esams.wmnet} and A:cp [production]
16:49 <brett@cumin2002> START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp3053.esams.wmnet,cp3055.esams.wmnet,cp3057.esams.wmnet,cp3059.esams.wmnet,cp3061.esams.wmnet,cp3063.esams.wmnet,cp3065.esams.wmnet} and A:cp [production]