6251-6300 of 10000 results (138ms)
2024-09-26 ยง
20:23 <thcipriani@deploy2002> Finished scap sync-world: Backport for [[gerrit:1075333|Bump coverage of the add-a-fact quicksurvey to 0.2]] (duration: 13m 53s) [production]
20:23 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
20:22 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
20:16 <thcipriani@deploy2002> thcipriani, derenrich: Continuing with sync [production]
20:13 <thcipriani@deploy2002> thcipriani, derenrich: Backport for [[gerrit:1075333|Bump coverage of the add-a-fact quicksurvey to 0.2]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:11 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
20:11 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
20:09 <thcipriani@deploy2002> Started scap sync-world: Backport for [[gerrit:1075333|Bump coverage of the add-a-fact quicksurvey to 0.2]] [production]
19:30 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.24 refs T373643 [production]
19:04 <brennen@deploy2002> Sync cancelled. [production]
19:04 <brennen@deploy2002> brennen, jdlrobson: Backport for [[gerrit:1075652|Limit a heading selector to Parsoid HTML (T375701)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
18:31 <brennen@deploy2002> Started scap sync-world: Backport for [[gerrit:1075652|Limit a heading selector to Parsoid HTML (T375701)]] [production]
18:23 <sukhe> repooling cp2037; downtimed removed for some time, looks good to repool: T375766 [production]
18:20 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
18:20 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
18:07 <VRiley> rebooting msw-e1-eqiad for maintenance [production]
17:40 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
17:40 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
17:36 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
17:36 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
17:14 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
17:14 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
17:14 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
17:13 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
17:13 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
17:13 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
17:12 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host snapshot1017.eqiad.wmnet [production]
17:09 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-video: sync [production]
17:09 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-video: sync [production]
17:08 <swfrench-wmf> cleared contents of a stale scap dsh group resource on deploy2002 - T370962 [production]
17:06 <btullis@cumin1002> START - Cookbook sre.hosts.reboot-single for host snapshot1017.eqiad.wmnet [production]
17:03 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2037.codfw.wmnet [production]
17:03 <sukhe@cumin1002> START - Cookbook sre.hosts.remove-downtime for cp2037.codfw.wmnet [production]
17:03 <sukhe> removing downtime on cp2037 but still keeping it depooled: T375766 [production]
16:34 <fnegri@cumin1002> END (FAIL) - Cookbook sre.wikireplicas.update-views (exit_code=99) [production]
16:32 <fnegri@cumin1002> START - Cookbook sre.wikireplicas.update-views [production]
16:31 <jiawang@deploy2002> Finished deploy [airflow-dags/analytics_product@8f6a9ed]: (no justification provided) (duration: 01m 13s) [production]
16:30 <jiawang@deploy2002> Started deploy [airflow-dags/analytics_product@8f6a9ed]: (no justification provided) [production]
16:29 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:29 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:27 <swfrench-wmf> done with switchover day 3 deployment server switch - T370962 [production]
16:23 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on cp2037.codfw.wmnet with reason: T375766 [production]
16:23 <sukhe@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on cp2037.codfw.wmnet with reason: T375766 [production]
16:09 <cwhite> `systemctl restart zuul` on contint1002 T233089 [production]
16:07 <jayme@deploy1003> helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
16:07 <jayme@deploy1003> helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
16:07 <jayme@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
16:07 <jayme@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
16:07 <jayme@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. [production]
16:06 <jayme@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. [production]