2351-2400 of 7348 results (22ms)
2020-03-10 §
21:51 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@dda3d28]: re-sync latest version to trigger scap scripts on new elastic nodes in codfw [production]
20:39 <brennen@deploy1001> Finished scap: testwiki to php-1.35.0-wmf.23 and rebuild l10n cache (duration: 163m 37s) [production]
19:30 <brennen> scap-cdb-rebuild currently at 29%; at present rate wmf.23 will roll to group0 a bit after the official window [production]
17:55 <brennen@deploy1001> Started scap: testwiki to php-1.35.0-wmf.23 and rebuild l10n cache [production]
2020-03-06 §
18:07 <mutante> sudo -i cumin -b 15 'mw23[25-34].codfw.wmnet' 'sudo -u dzahn scap pull' [production]
2020-03-05 §
22:40 <mutante> [cumin1001:~] $ sudo -i cumin -b 15 'mw13[85-92].eqiad.wmnet' 'sudo -u dzahn scap pull' [production]
15:18 <_joe_> fixing the envoy installation on mw1394-1404, running scap pull [production]
2020-03-03 §
15:55 <liw@deploy1001> Finished scap: group0 to 1.35.0-wmf.22 (duration: 24m 29s) [production]
15:45 <mutante> wtp1025 - scap pull as user cscott - testing sudo privs issue [production]
15:43 <mutante> wtp1025 - scap pull [production]
15:31 <liw@deploy1001> Started scap: group0 to 1.35.0-wmf.22 [production]
15:22 <liw@deploy1001> Finished scap: testwiki to php-1.35.0-wmf.22 and rebuild l10n cache (duration: 71m 23s) [production]
14:11 <liw@deploy1001> Started scap: testwiki to php-1.35.0-wmf.22 and rebuild l10n cache [production]
00:13 <jforrester@deploy1001> Started scap: wmf-config/CommonSettings.php T240055: Point the Parsoid cluster at the train version of Parsoid, not a special check-out [production]
00:05 <mutante> wtp1025 - scap pull [production]
2020-03-01 §
16:08 <reedy@deploy1001> scap failed: average error rate on 5/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2020-02-27 §
22:49 <James_F> Manually `scap pull`ed on mw1349 and mw1351 as they were emitting odd errors. [production]
21:39 <jforrester@deploy1001> scap failed: average error rate on 11/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
21:22 <jforrester@deploy1001> Scap failed!: 8/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
21:19 <jforrester@deploy1001> Scap failed!: 10/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
21:19 <jforrester@deploy1001> Scap failed!: 10/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
21:10 <jforrester@deploy1001> Scap failed!: 10/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
21:07 <jforrester@deploy1001> Scap failed!: 10/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
2020-02-25 §
21:19 <jhuneidi@deploy1001> Finished scap: testwikis wikis to 1.35.0-wmf.21 refs T233869 (duration: 75m 21s) [production]
20:04 <jhuneidi@deploy1001> Started scap: testwikis wikis to 1.35.0-wmf.21 refs T233869 [production]
00:39 <jforrester@deploy1001> Scap failed!: Call to mwscript eval.php stderr: not empty [production]
2020-02-24 §
10:59 <effie> upgrading scap in eqiad and codfw - T245530 [production]
2020-02-21 §
22:01 <sbassett@deploy1001> Finished scap: Deploy security fix for T232932 (duration: 05m 35s) [production]
21:56 <sbassett@deploy1001> Started scap: Deploy security fix for T232932 [production]
2020-02-19 §
19:54 <rlazarus> scap pull on new api servers mw13[56-62] [production]
2020-02-18 §
23:56 <mutante> mw1349 - scap pull [production]
19:52 <jforrester@deploy1001> Finished scap: testwiki to 1.35.0-wmf.20 and re-build l10n cache T233868 (duration: 61m 01s) [production]
18:51 <jforrester@deploy1001> Started scap: testwiki to 1.35.0-wmf.20 and re-build l10n cache T233868 [production]
18:25 <James_F> Running `scap prep` for 1.35.0-wmf.20 ref. T233868 [production]
2020-02-13 §
17:09 <jforrester@deploy1001> Started scap: wmf-config/CommonSettings.php No-op (code style only) deploy sync [production]
2020-02-11 §
20:32 <dduvall@deploy1001> Finished scap: testwiki to php-1.35.0-wmf.19 and rebuild l10n cache (duration: 37m 31s) [production]
19:55 <dduvall@deploy1001> Started scap: testwiki to php-1.35.0-wmf.19 and rebuild l10n cache [production]
19:35 <marxarelli> running `scap clean --delete` for old wmf branches wmf.11, wmf.14, wmf.15, wmf.16 (T233867) [production]
2020-02-10 §
19:07 <jforrester@deploy1001> Scap failed!: Call to mwscript eval.php stderr: not empty [production]
15:04 <twentyafterfour@deploy1001> Finished scap: full scap sync prior to wmf.18 rollout (duration: 20m 13s) [production]
14:44 <twentyafterfour@deploy1001> Started scap: full scap sync prior to wmf.18 rollout [production]
14:40 <twentyafterfour> MediaWiki Train: Running a full scap to prepare for moving forward to 1.35.0-wmf.18 ( T233866 ) [production]
12:49 <urbanecm@deploy1001> Finished scap: SWAT: 799224f: 137a40e (T241242; T243974) (duration: 20m 18s) [production]
12:28 <urbanecm@deploy1001> Started scap: SWAT: 799224f: 137a40e (T241242; T243974) [production]
12:18 <_joe_> running puppet, scap pull on mwdebug1001 [production]
2020-02-07 §
14:40 <hoo@deploy1001> Scap failed!: 9/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
2020-02-06 §
22:13 <mutante> turning mw2271 and mw2163 into canary appservers for codfw, this adds mediawiki-testers shell users and removes scap sql scripts, rest stays as is (T242606) [production]
20:30 <twentyafterfour@deploy1001> Scap failed!: 9/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
2020-02-05 §
19:10 <jforrester@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2020-02-04 §
22:13 <twentyafterfour@deploy1001> Finished scap: testwikis wikis to 1.35.0-wmf.18 refs T233866 (duration: 32m 03s) [production]