3201-3250 of 8586 results (23ms)
2021-08-30 §
18:48 <tgr@deploy1002> Scap failed!: 5/6 canaries failed their endpoint checks(https://en.wikipedia.org) [production]
18:43 <tgr@deploy1002> scap failed: average error rate on 3/6 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/83629bcb5560d11e61d3085c89dd9ed6 for details) [production]
2021-08-25 §
14:32 <urbanecm> mwmaint2002: scap pull # clearing temporary config changes [production]
2021-08-24 §
20:18 <dancy@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.20 (duration: 36m 32s) [production]
19:41 <dancy@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.20 [production]
2021-08-17 §
20:30 <brennen> running scap pull on mw2383 [production]
17:41 <urbanecm> [urbanecm@mw2383 ~]$ scap pull # to clear an icinga alert [production]
16:56 <brennen@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.19 (duration: 38m 24s) [production]
16:17 <brennen@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.19 [production]
16:13 <brennen> 1.37.0-wmf.19 train: running scap prep, branched at 79c9b9e61350b0edd1acccb5e717875ba64cf9c1 [production]
08:21 <mutante> mw2383 - scap pull (still depooled because T286463 but alerts in Icinga since a while) [production]
05:37 <tstarling@deploy1002> Finished scap: collected SecurePoll maintenance scripts and bug fix (duration: 04m 12s) [production]
05:33 <tstarling@deploy1002> Started scap: collected SecurePoll maintenance scripts and bug fix [production]
2021-08-13 §
12:21 <mutante> mw1444 - scap pull, pooled as new API server for the first time [production]
2021-08-11 §
16:19 <dancy@deploy1002> Synchronized README: Testing scap php-rpm rolling restart (after) (duration: 03m 12s) [production]
16:16 <thcipriani> moment of truth for php-fpm-always-restart in scap [production]
16:05 <dancy@deploy1002> Synchronized README: Testing scap php-rpm rolling restart (before) (duration: 01m 19s) [production]
2021-08-10 §
17:23 <jhuneidi@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.18 (duration: 36m 35s) [production]
16:47 <jhuneidi@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.18 [production]
2021-08-04 §
18:25 <mutante> mw2379, mw2380 - scap pull [production]
17:40 <mutante> mw2357, mw2377, mw2378 - scap pull [production]
16:55 <mutante> mw2351, mw2353, mw2355 - scap pull [production]
2021-08-03 §
18:29 <dduvall@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.17 (duration: 36m 44s) [production]
17:52 <dduvall@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.17 [production]
2021-07-30 §
14:58 <mutante> mw1439, mw1440, mw1445, mw1446 - scap pull, repool as jobrunners after reimaging [production]
2021-07-29 §
18:36 <urbanecm@deploy1002> Finished scap: 796fe8e: 927763c: SecurePoll backports (T283728, T284585) (duration: 17m 06s) [production]
18:19 <urbanecm@deploy1002> Started scap: 796fe8e: 927763c: SecurePoll backports (T283728, T284585) [production]
2021-07-28 §
18:36 <legoktm@deploy1002> Finished scap: Add a tracking category to pages using the <DynamicPageList> tag (duration: 27m 16s) [production]
18:08 <legoktm@deploy1002> Started scap: Add a tracking category to pages using the <DynamicPageList> tag [production]
15:53 <mutante> mw1434,mw1435,mw1436: scap pull, repooled, reimaged, converted from API to appserver for balancing (T279309) [production]
2021-07-27 §
20:02 <twentyafterfour@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.16 (duration: 36m 06s) [production]
19:26 <twentyafterfour@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.16 [production]
10:11 <mutante> replacing scap proxies: mw1269 with mw1420, mw1285 with mw1306 [production]
2021-07-26 §
17:41 <legoktm> ran `scap pull` and repooled mw2336.codfw.wmnet - T287394 [production]
10:53 <ladsgroup@deploy1002> Scap failed!: 3/6 canaries failed their endpoint checks(https://en.wikipedia.org) [production]
10:52 <ladsgroup@deploy1002> Scap failed!: 2/6 canaries failed their endpoint checks(https://en.wikipedia.org) [production]
2021-07-22 §
19:07 <mutante> mw1421, mw1422 - scap pull, re-pool as new API servers after reimaging, previously appservers [production]
2021-07-21 §
20:27 <dancy> testing upcoming Scap release on beta [production]
16:27 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.37.0-wmf.15/extensions/WikibaseLexeme/WikibaseLexeme.entitytypes.php: restore previous state after previous scap failed on canaries with seemingly legitimate error (duration: 01m 04s) [production]
16:23 <lucaswerkmeister-wmde@deploy1002> scap failed: average error rate on 2/6 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/83629bcb5560d11e61d3085c89dd9ed6 for details) [production]
14:51 <reedy@deploy1002> Finished scap: Fix some VE translation issues for T286679 (duration: 04m 45s) [production]
14:46 <reedy@deploy1002> Started scap: Fix some VE translation issues for T286679 [production]
09:00 <hashar@deploy1002> Finished scap: testwiki to php-1.37.0-wmf.15 and rebuild l10n cache # T281156 (duration: 45m 51s) [production]
08:15 <hashar@deploy1002> Started scap: testwiki to php-1.37.0-wmf.15 and rebuild l10n cache # T281156 [production]
2021-07-16 §
12:17 <mutante> mw1426,mw1427,mw1428 - scap pull [production]
2021-07-15 §
13:05 <mutante> mw1413 - pooling, was depooled but for unknown reason, dont see it in SAL, looks ok, scap pulled [production]
12:34 <mutante> mw1423, mw1424, mw1425 - scap pull [production]
2021-07-14 §
12:15 <mutante> mw1422 - scap pull [production]
2021-07-13 §
20:19 <dancy@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.14 (duration: 31m 56s) [production]
19:47 <dancy@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.14 [production]