3201-3250 of 8220 results (23ms)
2020-04-10 §
13:12 <mutante> restarted and re-armed keyholder on deploy1001 to pick up changes for zuul scap deploy [production]
2020-04-07 §
20:09 <jhuneidi@deploy1001> Finished scap: testwikis wikis to 1.35.0-wmf.27 (duration: 60m 34s) [production]
19:08 <jhuneidi@deploy1001> Started scap: testwikis wikis to 1.35.0-wmf.27 [production]
2020-03-31 §
21:47 <dduvall@deploy1001> Started scap: testwiki to php-1.35.0-wmf.26 (T247773) [production]
20:04 <dduvall@deploy1001> Finished scap: testwiki to php-1.35.0-wmf.26 and rebuild l10n cache (duration: 142m 48s) [production]
17:42 <dduvall@deploy1001> Started scap: testwiki to php-1.35.0-wmf.26 and rebuild l10n cache [production]
2020-03-25 §
19:26 <twentyafterfour> scap sync-proxies failed on mw1251 [production]
2020-03-24 §
19:29 <twentyafterfour@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
19:28 <twentyafterfour@deploy1001> scap failed: average error rate on 7/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
17:12 <hashar@deploy1001> Finished scap: testwiki to 1.35.0-wmf.25 and rebuild l10n cache # T233873 (duration: 77m 52s) [production]
15:54 <hashar@deploy1001> Started scap: testwiki to 1.35.0-wmf.25 and rebuild l10n cache # T233873 [production]
14:59 <hashar> scap prep 1.35.0-wmf.25 # T233873 [production]
2020-03-18 §
21:56 <Krinkle> krinkle@mw1385: scap pull # clean up AdHoc debugging for T248010 [production]
18:20 <Lucas_WMDE> scap pull on mwdebug1001, attempting to fix mismatched wikiversions alert [production]
16:00 <hashar@deploy1001> Finished scap: testwiki to 1.35.0-wmf.24 and rebuild l10n cache - T233872 (duration: 61m 23s) [production]
14:58 <hashar@deploy1001> Started scap: testwiki to 1.35.0-wmf.24 and rebuild l10n cache - T233872 [production]
2020-03-17 §
16:56 <mutante> mw1280 - scap pull - had ancient mw version due to downtime [production]
15:01 <hashar> scap prep 1.35.0-wmf.24 and applying security patches # T233872 [production]
2020-03-11 §
14:21 <akosiaris@deploy1001> Started scap: wmf-config/ProductionServices.php [production]
2020-03-10 §
21:58 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@dda3d28]: re-sync latest version to trigger scap scripts on new elastic nodes in codfw (duration: 02m 15s) [production]
21:56 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@dda3d28]: re-sync latest version to trigger scap scripts on new elastic nodes in codfw [production]
21:51 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@dda3d28]: re-sync latest version to trigger scap scripts on new elastic nodes in codfw (duration: 00m 23s) [production]
21:51 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@dda3d28]: re-sync latest version to trigger scap scripts on new elastic nodes in codfw [production]
20:39 <brennen@deploy1001> Finished scap: testwiki to php-1.35.0-wmf.23 and rebuild l10n cache (duration: 163m 37s) [production]
19:30 <brennen> scap-cdb-rebuild currently at 29%; at present rate wmf.23 will roll to group0 a bit after the official window [production]
17:55 <brennen@deploy1001> Started scap: testwiki to php-1.35.0-wmf.23 and rebuild l10n cache [production]
2020-03-06 §
18:07 <mutante> sudo -i cumin -b 15 'mw23[25-34].codfw.wmnet' 'sudo -u dzahn scap pull' [production]
2020-03-05 §
22:40 <mutante> [cumin1001:~] $ sudo -i cumin -b 15 'mw13[85-92].eqiad.wmnet' 'sudo -u dzahn scap pull' [production]
15:18 <_joe_> fixing the envoy installation on mw1394-1404, running scap pull [production]
2020-03-03 §
15:55 <liw@deploy1001> Finished scap: group0 to 1.35.0-wmf.22 (duration: 24m 29s) [production]
15:45 <mutante> wtp1025 - scap pull as user cscott - testing sudo privs issue [production]
15:43 <mutante> wtp1025 - scap pull [production]
15:31 <liw@deploy1001> Started scap: group0 to 1.35.0-wmf.22 [production]
15:22 <liw@deploy1001> Finished scap: testwiki to php-1.35.0-wmf.22 and rebuild l10n cache (duration: 71m 23s) [production]
14:11 <liw@deploy1001> Started scap: testwiki to php-1.35.0-wmf.22 and rebuild l10n cache [production]
00:13 <jforrester@deploy1001> Started scap: wmf-config/CommonSettings.php T240055: Point the Parsoid cluster at the train version of Parsoid, not a special check-out [production]
00:05 <mutante> wtp1025 - scap pull [production]
2020-03-01 §
16:08 <reedy@deploy1001> scap failed: average error rate on 5/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2020-02-27 §
22:49 <James_F> Manually `scap pull`ed on mw1349 and mw1351 as they were emitting odd errors. [production]
21:39 <jforrester@deploy1001> scap failed: average error rate on 11/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
21:22 <jforrester@deploy1001> Scap failed!: 8/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
21:19 <jforrester@deploy1001> Scap failed!: 10/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
21:19 <jforrester@deploy1001> Scap failed!: 10/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
21:10 <jforrester@deploy1001> Scap failed!: 10/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
21:07 <jforrester@deploy1001> Scap failed!: 10/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
2020-02-25 §
21:19 <jhuneidi@deploy1001> Finished scap: testwikis wikis to 1.35.0-wmf.21 refs T233869 (duration: 75m 21s) [production]
20:04 <jhuneidi@deploy1001> Started scap: testwikis wikis to 1.35.0-wmf.21 refs T233869 [production]
00:39 <jforrester@deploy1001> Scap failed!: Call to mwscript eval.php stderr: not empty [production]
2020-02-24 §
10:59 <effie> upgrading scap in eqiad and codfw - T245530 [production]
2020-02-21 §
22:01 <sbassett@deploy1001> Finished scap: Deploy security fix for T232932 (duration: 05m 35s) [production]