6301-6350 of 10000 results (97ms)
2023-01-17 ยง
22:25 <bblack> cp2031: restart ats-be [production]
22:20 <ebernhardson@deploy1002> ebernhardson and ebernhardson: Backport for [[gerrit:880915|Resolve deprecations and type changes in elastica 7.3.0]], [[gerrit:880917|UpdateSuggesterIndex: Properly cleanup bad indices]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
22:18 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:880915|Resolve deprecations and type changes in elastica 7.3.0]], [[gerrit:880917|UpdateSuggesterIndex: Properly cleanup bad indices]] [production]
22:14 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:880533|Show edit button in sticky header for desktop-improvement wikis (T324799)]] (duration: 10m 43s) [production]
22:05 <ebernhardson@deploy1002> ebernhardson and jdrewniak: Backport for [[gerrit:880533|Show edit button in sticky header for desktop-improvement wikis (T324799)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
22:04 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:880533|Show edit button in sticky header for desktop-improvement wikis (T324799)]] [production]
21:54 <ebernhardson> Finished scap: Backport for [[gerrit:880913|Table of contents Collapse/Expand not working (T327064)]] [production]
21:54 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:881008|Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"]] (duration: 09m 20s) [production]
21:52 <zabe> zabe@mwmaint1002:~$ mwscript extensions/CheckUser/maintenance/populateCulComment.php --wiki testwiki [production]
21:46 <ebernhardson@deploy1002> ebernhardson and trainbranchbot: Backport for [[gerrit:881008|Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
21:44 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:881008|Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"]] [production]
21:42 <ebernhardson@deploy1002> Sync cancelled. [production]
21:35 <ebernhardson@deploy1002> ebernhardson and dreamyjazz: Backport for [[gerrit:879653|Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis (T233004)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
21:34 <ebernhardson> scap also backporting [[gerrit:880913|Table of contents Collapse/Expand not working (T327064)]] [production]
21:33 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:879653|Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis (T233004)]] [production]
21:29 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:880568|Enable Phonos on afwiktionary and arwiki (T324561)]] (duration: 12m 21s) [production]
21:18 <ebernhardson@deploy1002> ebernhardson and hmonroy: Backport for [[gerrit:880568|Enable Phonos on afwiktionary and arwiki (T324561)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
21:17 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:880568|Enable Phonos on afwiktionary and arwiki (T324561)]] [production]
21:00 <ryankemper> [WDQS] `ryankemper@wdqs1005:~$ sudo pool` (had been left depooled from previous powercycle) [production]
20:47 <ryankemper> [WDQS] Depooled `wdqs1016` [production]
20:25 <herron> ran preferred-replica-election on kafka-logging codfw to clear replica imbalance [production]
20:18 <ryankemper> [WDQS] Restart blazegraph on `wdqs1016` to clear alert: `ryankemper@wdqs1016:~$ sudo systemctl restart wdqs-blazegraph` [production]
20:06 <jhuneidi@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.40.0-wmf.19 refs T325582 [production]
20:04 <eileen> config revision changed from 2e5cee3c to 7425df0b [production]
19:50 <ryankemper> T327175 Reprocessing last several hours of updates (`2023-01-17T12:00:00Z` -> `2023-01-17T17:30:00Z`) on codfw elasticsearch, running on `ryankemper@mwmaint2002` tmux session `reindex` [production]
19:43 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/flink-app-example: apply [production]
19:43 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/services/flink-app-example: apply [production]
19:41 <zabe@deploy1002> Finished scap: Backport for [[gerrit:880916|Revert "Revert "Enable visual enhancements on all talk namespaces""]] (duration: 10m 25s) [production]
19:32 <zabe@deploy1002> zabe and zabe: Backport for [[gerrit:880916|Revert "Revert "Enable visual enhancements on all talk namespaces""]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
19:30 <zabe@deploy1002> Started scap: Backport for [[gerrit:880916|Revert "Revert "Enable visual enhancements on all talk namespaces""]] [production]
18:48 <zabe@deploy1002> Finished scap: Backport for [[gerrit:880914|Revert "Enable visual enhancements on all talk namespaces"]] (duration: 09m 08s) [production]
18:44 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/flink-app-example: apply [production]
18:44 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/services/flink-app-example: apply [production]
18:41 <zabe@deploy1002> zabe and zabe: Backport for [[gerrit:880914|Revert "Enable visual enhancements on all talk namespaces"]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
18:41 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
18:41 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
18:39 <zabe@deploy1002> Started scap: Backport for [[gerrit:880914|Revert "Enable visual enhancements on all talk namespaces"]] [production]
18:39 <zabe@deploy1002> backport aborted: (duration: 00m 26s) [production]
18:35 <zabe@deploy1002> backport aborted: (duration: 19m 41s) [production]
18:29 <otto@deploy1002> Finished deploy [analytics/refinery@55f90ac]: Regular analytics weekly train [analytics/refinery@55f90ac] (duration: 04m 28s) [production]
18:29 <otto@deploy1002> Finished deploy [airflow-dags/analytics@8d0e919]: Regular analytics weekly train @8d0e919] (duration: 00m 15s) [production]
18:29 <otto@deploy1002> Started deploy [airflow-dags/analytics@8d0e919]: Regular analytics weekly train @8d0e919] [production]
18:25 <otto@deploy1002> Started deploy [analytics/refinery@55f90ac]: Regular analytics weekly train [analytics/refinery@55f90ac] [production]
18:25 <zabe@deploy1002> zabe and matmarex and zabe: Backport for [[gerrit:880908|objectcache: Fix DI for MultiWriteBagOStuff sub caches (T327158)]], [[gerrit:878169|Use new DiscussionTools heading markup on enwiki (T314714)]], [[gerrit:879158|Add "Clear Affordances" to DiscussionTools beta feature on remaining wikis (T321955)]], [[gerrit:879159|Add "Page Frame" to DiscussionTools beta feature on partner wikis (T317907)]], [[ [production]
18:23 <zabe@deploy1002> Started scap: Backport for [[gerrit:880908|objectcache: Fix DI for MultiWriteBagOStuff sub caches (T327158)]], [[gerrit:878169|Use new DiscussionTools heading markup on enwiki (T314714)]], [[gerrit:879158|Add "Clear Affordances" to DiscussionTools beta feature on remaining wikis (T321955)]], [[gerrit:879159|Add "Page Frame" to DiscussionTools beta feature on partner wikis (T317907)]], [[gerrit:879103| [production]
18:13 <jgiannelos@deploy1002> helmfile [eqiad] DONE helmfile.d/services/proton: apply [production]
18:10 <mutante> gerrit1002/gerrit2002: sudo rmdir /srv/gerrit/jvmlogs [production]
18:07 <jgiannelos@deploy1002> helmfile [eqiad] START helmfile.d/services/proton: apply [production]
18:07 <jgiannelos@deploy1002> helmfile [codfw] DONE helmfile.d/services/proton: apply [production]
18:05 <jgiannelos@deploy1002> helmfile [codfw] START helmfile.d/services/proton: apply [production]