1051-1100 of 10000 results (26ms)
2020-11-15 §
09:50 <elukey> restart purged on cp4022 (consumer stuck due to kafka-main2003 down) [production]
09:42 <elukey> restart purged on cp2028 (kafka-main2003 is down and there are connect timeouts errors) [production]
09:07 <Urbanecm> Change email for SUL user Botopol via resetUserEmail.php (T267866) [production]
08:27 <elukey> truncate -s 10g /var/lib/hadoop/data/n/yarn/logs/application_1601916545561_173219/container_e25_1601916545561_173219_01_000177/stderr on an-worker1100 [production]
08:24 <elukey> sudo truncate -s 10g /var/lib/hadoop/data/c/yarn/logs/application_1601916545561_173219/container_e25_1601916545561_173219_01_000019/stderr on an-worker1098 [production]
2020-11-13 §
22:06 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=myvwiki autopatrolled # T105570 [production]
22:04 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=testwiki editor # T105570 [production]
21:42 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=enwikinews reviewer # T105570 [production]
21:40 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=bnwiki editor # T105570 [production]
21:39 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=testwiki flood # T105570 [production]
21:38 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=test2wiki upwizcampeditors # T105570 [production]
21:33 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=aawiki communityapplica # T105570 [production]
21:28 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=enwiki epadmin # T105570 [production]
16:50 <_joe_> manually rotate user.log on centrallog1001 and moved it to /srv/user.log.manual-rotation [production]
15:31 <ejegg|away> updated fundraising CiviCRM from f7954c6659 to 74d795408f [production]
08:15 <vgutierrez> restart acme-chief on acmechief1001 [production]
01:30 <TimStarling> on mwmaint1002 running fixT260485.php unmerged fixup script from https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikimediaMaintenance/+/640348 [production]
2020-11-12 §
19:12 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 0f0f8397424d4337cdcd61f7acb276d4f0b1facd: Enable "Cite" button in toolbar for enwiktionary (T267504) (duration: 00m 58s) [production]
19:08 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 3ce18e6f63abe060c05c40239b651086f65a1a33: Add artsdatabanken.no to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T267784) (duration: 01m 00s) [production]
16:12 <Urbanecm> Start of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux at mwmaint1002 (wiki=jawiki; T246539) [production]
16:11 <Urbanecm> End of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux session updateVarDumps at mwmaint1002 (wiki=cswiki; T246539) [production]
13:38 <Urbanecm> Start of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux session updateVarDumps at mwmaint1002 (wiki=cswiki; T246539) [production]
11:40 <mvolz@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]
11:35 <mvolz@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]
11:30 <mvolz@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'citoid' for release 'staging' . [production]
11:12 <mvolz@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
11:08 <mvolz@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
11:02 <mvolz@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'zotero' for release 'staging' . [production]
09:19 <hashar@deploy1001> Synchronized php-1.36.0-wmf.16/includes/filerepo: Revert "filerepo: clean up shared cache keys to avoid key metrics clutter" - T267668 (duration: 01m 01s) [production]
09:12 <hashar> Pulled https://gerrit.wikimedia.org/r/640746 on deployment server for # T267668 [production]
04:04 <Krinkle> cleaned up and unlocked [production]
03:53 <Krinkle> krinkle@deploy1001 I've locked scap deployments. See https://phabricator.wikimedia.org/T267668#6619762 [production]
03:46 <ejegg> updated python fundraising tools from 7853f426ee to 68e054c9ad [production]
2020-11-11 §
16:44 <XioNoX> Revert "temporarily route Italy to codfw" [production]
16:38 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
16:38 <ayounsi@cumin1001> START - Cookbook sre.network.cf [production]
16:30 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
16:30 <ayounsi@cumin1001> START - Cookbook sre.network.cf [production]
15:52 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
15:52 <ayounsi@cumin1001> START - Cookbook sre.network.cf [production]
14:29 <akosiaris@cumin1001> conftool action : set/pooled=yes; selector: name=cp3054.esams.wmnet [production]
13:52 <akosiaris@cumin1001> conftool action : set/pooled=no; selector: name=cp3054.esams.wmnet [production]
12:25 <Lucas_WMDE> EU backport&config window done [production]
12:23 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:640676|Remove propagateChangeVisibility repo setting]] (duration: 00m 58s) [production]
12:16 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:636453|Enable propagatePageDeletion on Wikidata]] (duration: 00m 59s) [production]
12:11 <lucaswerkmeister-wmde@deploy1001> Synchronized php-1.36.0-wmf.16/extensions/DiscussionTools/includes/CommentParser.php: Backport: [[gerrit:640497|Fix getHeadlineNodeAndOffset() returning text nodes (T267284)]] (duration: 01m 01s) [production]
10:34 <XioNoX> delete unused interfaces from asw-d-codfw [production]
09:53 <XioNoX> prioritized DE-CIX IXP - T262681 [production]
02:18 <ryankemper> (WDQS deploy completed) [production]
00:48 <ryankemper> Restarting `wdqs-categories` one host at a time across all wdqs production instances: `sudo -E cumin -b 1 'A:wdqs-all and not A:wdqs-test' 'depool && sleep 60 && systemctl restart wdqs-categories && sleep 30 && pool'` [production]