4001-4050 of 10000 results (89ms)
2023-01-18 §
01:02 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on cp2031.codfw.wmnet with reason: downtimed, host unreachable [production]
01:02 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2031.codfw.wmnet,service=ats-be [production]
01:02 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2031.codfw.wmnet,service=cdn [production]
00:28 <zabe> enwiki: rename the "discretionary sanctions alert" tag to "contentious topics alert" # T327118 [production]
00:26 <zabe@deploy1002> Finished scap: Backport for [[gerrit:881030|Add script to rename a change tag in wmf prod (T327118)]] (duration: 08m 29s) [production]
00:20 <zabe@deploy1002> zabe and zabe: Backport for [[gerrit:881030|Add script to rename a change tag in wmf prod (T327118)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
00:18 <zabe@deploy1002> Started scap: Backport for [[gerrit:881030|Add script to rename a change tag in wmf prod (T327118)]] [production]
00:08 <zabe> mwscript extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --wiki=testwiki --key=180p.vp9.webm # T312153 [production]
00:07 <zabe> mwscript extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --wiki=testwiki --key=120p.vp9.webm # T312153 [production]
2023-01-17 §
23:51 <zabe> mwscript extensions/Translate/scripts/moveTranslatableBundle.php --wiki metawiki "User:Amire80/frg" "Movement Multilingual Termbase" "Zabe" "per request [[:phab:T327149|T327149]]" # T327149 [production]
23:33 <zabe@deploy1002> Finished scap: Backport for [[gerrit:880905|Start reading from cuc_comment_id on testwiki (T233004)]], [[gerrit:880904|Start reading from cuc_actor everywhere (T233004)]] (duration: 09m 58s) [production]
23:25 <zabe@deploy1002> zabe and zabe: Backport for [[gerrit:880905|Start reading from cuc_comment_id on testwiki (T233004)]], [[gerrit:880904|Start reading from cuc_actor everywhere (T233004)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
23:24 <zabe@deploy1002> Started scap: Backport for [[gerrit:880905|Start reading from cuc_comment_id on testwiki (T233004)]], [[gerrit:880904|Start reading from cuc_actor everywhere (T233004)]] [production]
23:19 <zabe@deploy1002> Finished scap: Backport for [[gerrit:881026|Revert "Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"" (T233004)]], [[gerrit:880925|Revert "Add read new support for cu_log comment ID columns" (T327219)]] (duration: 11m 46s) [production]
23:09 <zabe@deploy1002> zabe and dreamyjazz and zabe: Backport for [[gerrit:881026|Revert "Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"" (T233004)]], [[gerrit:880925|Revert "Add read new support for cu_log comment ID columns" (T327219)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
23:07 <zabe@deploy1002> Started scap: Backport for [[gerrit:881026|Revert "Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"" (T233004)]], [[gerrit:880925|Revert "Add read new support for cu_log comment ID columns" (T327219)]] [production]
23:06 <zabe@deploy1002> Finished scap: Backport for [[gerrit:880903|Stop writing to cul_user and cul_user_text everywhere (T233004)]], [[gerrit:880902|Start writing to rev_comment_id everywhere (T299954)]] (duration: 10m 29s) [production]
22:57 <zabe@deploy1002> zabe and zabe: Backport for [[gerrit:880903|Stop writing to cul_user and cul_user_text everywhere (T233004)]], [[gerrit:880902|Start writing to rev_comment_id everywhere (T299954)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
22:55 <zabe@deploy1002> Started scap: Backport for [[gerrit:880903|Stop writing to cul_user and cul_user_text everywhere (T233004)]], [[gerrit:880902|Start writing to rev_comment_id everywhere (T299954)]] [production]
22:51 <bblack> repooling codfw [production]
22:48 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:881016|Make sticky header edit button default for all wikis (T324799)]] (duration: 10m 34s) [production]
22:39 <ebernhardson@deploy1002> ebernhardson and jdrewniak: Backport for [[gerrit:881016|Make sticky header edit button default for all wikis (T324799)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
22:38 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:881016|Make sticky header edit button default for all wikis (T324799)]] [production]
22:30 <volans@cumin1001> conftool action : set/pooled=inactive; selector: name=non-existent1001 [production]
22:27 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:880915|Resolve deprecations and type changes in elastica 7.3.0]], [[gerrit:880917|UpdateSuggesterIndex: Properly cleanup bad indices]] (duration: 09m 42s) [production]
22:25 <bblack> cp2031: restart ats-be [production]
22:20 <ebernhardson@deploy1002> ebernhardson and ebernhardson: Backport for [[gerrit:880915|Resolve deprecations and type changes in elastica 7.3.0]], [[gerrit:880917|UpdateSuggesterIndex: Properly cleanup bad indices]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
22:18 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:880915|Resolve deprecations and type changes in elastica 7.3.0]], [[gerrit:880917|UpdateSuggesterIndex: Properly cleanup bad indices]] [production]
22:14 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:880533|Show edit button in sticky header for desktop-improvement wikis (T324799)]] (duration: 10m 43s) [production]
22:05 <ebernhardson@deploy1002> ebernhardson and jdrewniak: Backport for [[gerrit:880533|Show edit button in sticky header for desktop-improvement wikis (T324799)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
22:04 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:880533|Show edit button in sticky header for desktop-improvement wikis (T324799)]] [production]
21:54 <ebernhardson> Finished scap: Backport for [[gerrit:880913|Table of contents Collapse/Expand not working (T327064)]] [production]
21:54 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:881008|Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"]] (duration: 09m 20s) [production]
21:52 <zabe> zabe@mwmaint1002:~$ mwscript extensions/CheckUser/maintenance/populateCulComment.php --wiki testwiki [production]
21:46 <ebernhardson@deploy1002> ebernhardson and trainbranchbot: Backport for [[gerrit:881008|Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
21:44 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:881008|Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"]] [production]
21:42 <ebernhardson@deploy1002> Sync cancelled. [production]
21:35 <ebernhardson@deploy1002> ebernhardson and dreamyjazz: Backport for [[gerrit:879653|Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis (T233004)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
21:34 <ebernhardson> scap also backporting [[gerrit:880913|Table of contents Collapse/Expand not working (T327064)]] [production]
21:33 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:879653|Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis (T233004)]] [production]
21:29 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:880568|Enable Phonos on afwiktionary and arwiki (T324561)]] (duration: 12m 21s) [production]
21:18 <ebernhardson@deploy1002> ebernhardson and hmonroy: Backport for [[gerrit:880568|Enable Phonos on afwiktionary and arwiki (T324561)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
21:17 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:880568|Enable Phonos on afwiktionary and arwiki (T324561)]] [production]
21:00 <ryankemper> [WDQS] `ryankemper@wdqs1005:~$ sudo pool` (had been left depooled from previous powercycle) [production]
20:47 <ryankemper> [WDQS] Depooled `wdqs1016` [production]
20:25 <herron> ran preferred-replica-election on kafka-logging codfw to clear replica imbalance [production]
20:18 <ryankemper> [WDQS] Restart blazegraph on `wdqs1016` to clear alert: `ryankemper@wdqs1016:~$ sudo systemctl restart wdqs-blazegraph` [production]
20:06 <jhuneidi@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.40.0-wmf.19 refs T325582 [production]
20:04 <eileen> config revision changed from 2e5cee3c to 7425df0b [production]
19:50 <ryankemper> T327175 Reprocessing last several hours of updates (`2023-01-17T12:00:00Z` -> `2023-01-17T17:30:00Z`) on codfw elasticsearch, running on `ryankemper@mwmaint2002` tmux session `reindex` [production]