6751-6800 of 10000 results (75ms)
2020-03-03 ยง
13:00 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
12:48 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
12:45 <addshore> START warm cache for db1111 & db1126 for Q20-25 million T219123 (pass 1) [production]
12:38 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Reading up to Q20M for the new term store everywhere (was Q15M) + warm db1126 & db1111 caches (T219123) cache bust (duration: 00m 56s) [production]
12:37 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Reading up to Q20M for the new term store everywhere (was Q15M) + warm db1126 & db1111 caches (T219123) (duration: 00m 55s) [production]
12:35 <addshore> END warm cache for db1111 & db1126 for Q15-20 million T219123 (pass 3) (finished it early) [production]
12:19 <urbanecm@deploy1001> Synchronized wmf-config/throttle.php: SWAT: 7b48737: Throttle rule for Czech Wikigap (T246356) (duration: 00m 56s) [production]
12:14 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 10s) [production]
12:12 <urbanecm@deploy1001> update-interwiki-cache aborted: Update interwiki cache (duration: 00m 01s) [production]
12:12 <urbanecm@deploy1001> update-interwiki-cache aborted: Update interwiki cache (duration: 00m 00s) [production]
12:10 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|575974|ContentTranslation: Add URL campaign for WikiGapFinder (T246335)]], take II (duration: 00m 56s) [production]
12:09 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|575974|ContentTranslation: Add URL campaign for WikiGapFinder (T246335)]] (duration: 00m 56s) [production]
12:06 <addshore> START warm cache for db1111 & db1126 for Q15-20 million T219123 (pass 3) [production]
12:03 <liw> cutting branch for 1.35.0-wmf.22 train [production]
11:54 <jbond42> disable puppet in order to add netbox hiera backend [production]
11:09 <moritzm> installing Java security updates on an-airflow, an-launcher and an-presto* [production]
11:08 <addshore> START warm cache for db1111 & db1126 for Q15-20 million T219123 (pass 2) [production]
11:04 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:01 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:01 <elukey@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-mirror-maker (exit_code=0) [production]
10:49 <elukey@cumin1001> START - Cookbook sre.kafka.roll-restart-mirror-maker [production]
10:47 <elukey@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) [production]
10:47 <vgutierrez@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:46 <vgutierrez> running the decommission cookbook against lvs2002 - T246756 [production]
10:46 <vgutierrez@cumin2001> START - Cookbook sre.hosts.decommission [production]
10:44 <vgutierrez> replace lvs2002 with lvs2008 - T196560 [production]
10:14 <addshore> START warm cache for db1111 & db1126 for Q15-20 million T219123 (pass 1) [production]
10:10 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Reading up to Q15M for the new term store everywhere (was Q12M) + warm db1126 & db1111 caches (T219123) cache bust (duration: 00m 56s) [production]
10:09 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Reading up to Q15M for the new term store everywhere (was Q12M) + warm db1126 & db1111 caches (T219123) (duration: 00m 56s) [production]
10:06 <addshore> END warm cache for db1111 & db1126 for Q12-15 million T219123 (pass 4) [production]
10:05 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:03 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:57 <marostegui> es4 deployment window finished [production]
09:43 <vgutierrez> reimage lvs3005 with buster - T245984 [production]
09:36 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Enable es4 as new writable external store section - T246072 (duration: 00m 56s) [production]
09:35 <addshore> START warm cache for db1111 & db1126 for Q12-15 million T219123 (pass 4) [production]
09:33 <marostegui@deploy1001> sync-file aborted: Enable es4 as new writable external store section - T246072 (duration: 00m 02s) [production]
09:33 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Enable es4 as new writable external store section - T246072 (duration: 00m 56s) [production]
09:32 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Enable es4 as new writable external store section - T246072 (duration: 00m 57s) [production]
09:09 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Add es4 to the available es sections, not in use yet - T246072 (duration: 00m 57s) [production]
09:07 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Add es4 to the available es sections, not in use yet - T246072 (duration: 00m 57s) [production]
08:53 <addshore> START warm cache for db1111 & db1126 for Q12-15 million T219123 (pass 3) [production]
08:36 <elukey@cumin1001> START - Cookbook sre.kafka.roll-restart-brokers [production]
08:25 <addshore> addshore@mwmaint1002:~$ time mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=wikidatawiki --batch-size=25 --sleep=1 --file=27feb1125-40to50-holes # T219123 [production]
08:13 <addshore> START warm cache for db1111 & db1126 for Q12-15 million T219123 (pass 2) [production]
08:11 <elukey@cumin1001> END (PASS) - Cookbook sre.zookeeper.roll-restart-zookeeper (exit_code=0) [production]
08:08 <addshore> addshore@mwmaint1002:~$ time mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=wikidatawiki --batch-size=25 --sleep=1 --file=27feb1125-30to40-holes # T219123 [production]
08:05 <elukey@cumin1001> START - Cookbook sre.zookeeper.roll-restart-zookeeper [production]
07:55 <elukey@cumin1001> END (PASS) - Cookbook sre.zookeeper.roll-restart-zookeeper (exit_code=0) [production]
07:48 <elukey@cumin1001> START - Cookbook sre.zookeeper.roll-restart-zookeeper [production]