4451-4500 of 9774 results (22ms)
2021-06-16 §
17:41 <dancy> Reverted Scap release on beta [production]
15:22 <dancy> testing upcoming Scap release on beta [production]
2021-06-15 §
17:54 <dancy> testing upcoming Scap release on beta [production]
2021-06-09 §
20:36 <mutante> deployed temp ferm change on deployment servers to let miscweb dump data, puppetized. scap pull from mwdebug1001 works, deployment good to go [production]
2021-06-08 §
17:06 <jhuneidi@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.9 refs T281150 (duration: 34m 12s) [production]
16:32 <jhuneidi@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.9 refs T281150 [production]
10:16 <liw> testing upcoming Scap release on beta [production]
2021-06-04 §
14:41 <krinkle@deploy1002> Scap failed!: 9/9 canaries failed their endpoint checks(https://en.wikipedia.org) [production]
2021-06-02 §
23:41 <ladsgroup@deploy1002> scap failed: average error rate on 4/9 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/83629bcb5560d11e61d3085c89dd9ed6 for details) [production]
2021-05-25 §
19:12 <twentyafterfour@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.7 (duration: 33m 29s) [production]
18:38 <twentyafterfour@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.7 [production]
2021-05-18 §
14:21 <hashar@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.6 (duration: 79m 07s) [production]
13:02 <hashar@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.6 [production]
12:04 <hashar> scap clean 1.37.0-wmf.1 1.37.0-wmf.3 and 1.37.0-wmf.4 # T281147 [production]
2021-05-17 §
21:46 <sbassett> Deployed security patch (and ran scap sync-l10n) for T260865 [production]
2021-05-11 §
18:20 <dancy@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.5 (duration: 09m 43s) [production]
18:10 <dancy@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.5 [production]
17:07 <dancy@deploy1002> scap failed: average error rate on 9/9 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/83629bcb5560d11e61d3085c89dd9ed6 for details) [production]
15:37 <dancy@deploy1002> scap failed: average error rate on 9/9 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/83629bcb5560d11e61d3085c89dd9ed6 for details) [production]
15:34 <dancy@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.4 [production]
15:31 <dancy@deploy1002> scap failed: RuntimeError scap failed: average error rate on 9/9 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/83629bcb5560d11e61d3085c89dd9ed6 for details) (duration: 17m 36s) [production]
15:31 <dancy@deploy1002> scap failed: average error rate on 9/9 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/83629bcb5560d11e61d3085c89dd9ed6 for details) [production]
15:13 <dancy@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.5 [production]
2021-05-06 §
05:27 <effie> upgrade scap to 3.17.1-1 - T279695 [production]
2021-05-05 §
11:17 <urbanecm@deploy1002> Scap failed!: Call to mwscript eval.php stderr: not empty [production]
2021-05-04 §
17:58 <dancy@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.4 (duration: 42m 33s) [production]
17:16 <dancy@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.4 [production]
2021-04-27 §
16:22 <effie> upgrading scap 3.17.1-1 on mediawiki canaries - T279695 [production]
07:24 <liw@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.3 (duration: 30m 54s) [production]
06:54 <liw@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.3 [production]
2021-04-14 §
20:38 <mutante> wtp1037, wtp1038, wtp1039 - scap pull [production]
08:44 <Urbanecm> Run scap pull on mwdebug1002 [production]
2021-04-13 §
21:45 <mutante> mw2394, mw2395 - scap pull [production]
18:11 <jhuneidi@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.1 (duration: 30m 36s) [production]
17:41 <jhuneidi@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.1 [production]
2021-04-08 §
19:50 <mutante> mw2403 through mw2411 - scap pull - new hardware [production]
17:16 <dancy> Scap 3.17.0 deployed to beta cluster [production]
16:51 <dancy> testing Scap 3.17.0 release on deployment-deploy01 [production]
2021-04-07 §
21:22 <mutante> mw2397 through mw2402 - pooled as new API appservers after scap pull and all monitoring green (T278396) [production]
21:05 <mutante> mw2397 - mw2402 - scap pull [production]
2021-04-06 §
18:41 <dduvall@deploy1002> Finished scap: testwikis wikis to 1.36.0-wmf.38 (duration: 33m 31s) [production]
18:10 <dduvall@deploy1002> Started scap: testwikis wikis to 1.36.0-wmf.38 [production]
2021-04-02 §
21:07 <mutante> mw2383 through mw2394 - 'uptime && scap pull' via ssh -C (not cumin because it needs to run as non-root) [production]
20:58 <mutante> mw238* - scap pull via cumin not possible because it doesnt work as root [production]
2021-04-01 §
20:01 <mutante> mw2379, mw2380, mw2381, mw2382 - scap pull [production]
19:34 <twentyafterfour@deploy1002> scap sync-l10n completed (1.36.0-wmf.37) (duration: 02m 38s) [production]
2021-03-30 §
21:02 <legoktm> scap pulling on mw1298 [production]
20:33 <twentyafterfour@deploy1002> Finished scap: testwikis wikis to 1.36.0-wmf.37 refs T278343 (duration: 80m 32s) [production]
20:02 <twentyafterfour> when syncing 1.36.0-wmf.37 promote to testwikis, one server failed: server mw1298.eqiad.wmnet and two more appear to be hung because scap is stuck at 2 left 99% without making any progress for a long time now. refs T278343 [production]
19:13 <twentyafterfour@deploy1002> Started scap: testwikis wikis to 1.36.0-wmf.37 refs T278343 [production]