6251-6300 of 10000 results (84ms)
2023-01-18 §
09:49 <godog> start migration from webperf1004 to arclamp1001 - T319434 [production]
09:41 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host arclamp2001.codfw.wmnet [production]
09:39 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host arclamp1001.eqiad.wmnet [production]
09:35 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host arclamp2001.codfw.wmnet [production]
09:33 <jelto@cumin1001> END (FAIL) - Cookbook sre.gitlab.upgrade (exit_code=99) [production]
09:32 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host arclamp1001.eqiad.wmnet [production]
09:24 <jnuche@deploy1002> Synchronized php: group1 wikis to 1.40.0-wmf.19 refs T325582 (duration: 08m 20s) [production]
09:15 <jnuche@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.40.0-wmf.19 refs T325582 [production]
08:54 <jelto@cumin1001> START - Cookbook sre.gitlab.upgrade [production]
08:34 <mvernon@cumin1001> conftool action : set/pooled=yes; selector: name=thanos-fe2002.codfw.wmnet [production]
08:34 <mvernon@cumin1001> conftool action : set/pooled=yes; selector: name=ms-fe2010.codfw.wmnet [production]
08:32 <mvernon@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=thanos-query,name=codfw [production]
08:32 <mvernon@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=thanos-swift,name=codfw [production]
08:32 <mvernon@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=swift,name=codfw [production]
08:30 <jelto@cumin1001> END (FAIL) - Cookbook sre.gitlab.upgrade (exit_code=99) [production]
07:56 <jelto@cumin1001> START - Cookbook sre.gitlab.upgrade [production]
02:37 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on cp2031.codfw.wmnet with reason: downtimed, host unreachable [production]
02:37 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on cp2031.codfw.wmnet with reason: downtimed, host unreachable [production]
02:36 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2031.codfw.wmnet,service=ats-be [production]
02:36 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2031.codfw.wmnet,service=cdn [production]
01:27 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2031.codfw.wmnet,service=ats-be [production]
01:27 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2031.codfw.wmnet,service=cdn [production]
01:13 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2031.codfw.wmnet [production]
01:06 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host cp2031.codfw.wmnet [production]
01:03 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on cp2031.codfw.wmnet with reason: downtimed, host unreachable [production]
01:02 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on cp2031.codfw.wmnet with reason: downtimed, host unreachable [production]
01:02 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2031.codfw.wmnet,service=ats-be [production]
01:02 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2031.codfw.wmnet,service=cdn [production]
00:28 <zabe> enwiki: rename the "discretionary sanctions alert" tag to "contentious topics alert" # T327118 [production]
00:26 <zabe@deploy1002> Finished scap: Backport for [[gerrit:881030|Add script to rename a change tag in wmf prod (T327118)]] (duration: 08m 29s) [production]
00:20 <zabe@deploy1002> zabe and zabe: Backport for [[gerrit:881030|Add script to rename a change tag in wmf prod (T327118)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
00:18 <zabe@deploy1002> Started scap: Backport for [[gerrit:881030|Add script to rename a change tag in wmf prod (T327118)]] [production]
00:08 <zabe> mwscript extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --wiki=testwiki --key=180p.vp9.webm # T312153 [production]
00:07 <zabe> mwscript extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --wiki=testwiki --key=120p.vp9.webm # T312153 [production]
2023-01-17 §
23:51 <zabe> mwscript extensions/Translate/scripts/moveTranslatableBundle.php --wiki metawiki "User:Amire80/frg" "Movement Multilingual Termbase" "Zabe" "per request [[:phab:T327149|T327149]]" # T327149 [production]
23:33 <zabe@deploy1002> Finished scap: Backport for [[gerrit:880905|Start reading from cuc_comment_id on testwiki (T233004)]], [[gerrit:880904|Start reading from cuc_actor everywhere (T233004)]] (duration: 09m 58s) [production]
23:25 <zabe@deploy1002> zabe and zabe: Backport for [[gerrit:880905|Start reading from cuc_comment_id on testwiki (T233004)]], [[gerrit:880904|Start reading from cuc_actor everywhere (T233004)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
23:24 <zabe@deploy1002> Started scap: Backport for [[gerrit:880905|Start reading from cuc_comment_id on testwiki (T233004)]], [[gerrit:880904|Start reading from cuc_actor everywhere (T233004)]] [production]
23:19 <zabe@deploy1002> Finished scap: Backport for [[gerrit:881026|Revert "Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"" (T233004)]], [[gerrit:880925|Revert "Add read new support for cu_log comment ID columns" (T327219)]] (duration: 11m 46s) [production]
23:09 <zabe@deploy1002> zabe and dreamyjazz and zabe: Backport for [[gerrit:881026|Revert "Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"" (T233004)]], [[gerrit:880925|Revert "Add read new support for cu_log comment ID columns" (T327219)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
23:07 <zabe@deploy1002> Started scap: Backport for [[gerrit:881026|Revert "Revert "Start writing to cul_reason[_plaintext]_id on group0 and group1 wikis"" (T233004)]], [[gerrit:880925|Revert "Add read new support for cu_log comment ID columns" (T327219)]] [production]
23:06 <zabe@deploy1002> Finished scap: Backport for [[gerrit:880903|Stop writing to cul_user and cul_user_text everywhere (T233004)]], [[gerrit:880902|Start writing to rev_comment_id everywhere (T299954)]] (duration: 10m 29s) [production]
22:57 <zabe@deploy1002> zabe and zabe: Backport for [[gerrit:880903|Stop writing to cul_user and cul_user_text everywhere (T233004)]], [[gerrit:880902|Start writing to rev_comment_id everywhere (T299954)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
22:55 <zabe@deploy1002> Started scap: Backport for [[gerrit:880903|Stop writing to cul_user and cul_user_text everywhere (T233004)]], [[gerrit:880902|Start writing to rev_comment_id everywhere (T299954)]] [production]
22:51 <bblack> repooling codfw [production]
22:48 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:881016|Make sticky header edit button default for all wikis (T324799)]] (duration: 10m 34s) [production]
22:39 <ebernhardson@deploy1002> ebernhardson and jdrewniak: Backport for [[gerrit:881016|Make sticky header edit button default for all wikis (T324799)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
22:38 <ebernhardson@deploy1002> Started scap: Backport for [[gerrit:881016|Make sticky header edit button default for all wikis (T324799)]] [production]
22:30 <volans@cumin1001> conftool action : set/pooled=inactive; selector: name=non-existent1001 [production]
22:27 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:880915|Resolve deprecations and type changes in elastica 7.3.0]], [[gerrit:880917|UpdateSuggesterIndex: Properly cleanup bad indices]] (duration: 09m 42s) [production]