To use chat, please login.
Back to contacts

How reliable is backtests?

Rihan
RSTrading
Sep 22 2014 at 19:31
385 posts
How reliable is the MT4's strategy tester with 90% modelling quality?
CrazyTraderfx (CrazyTrader)
Sep 22 2014 at 22:46
1718 posts
It depends on what type of strategy you are backtesting.
- Scalping strategy is 100% useless
Rihan
RSTrading
Sep 23 2014 at 06:33
385 posts
Cholipop
Sep 23 2014 at 07:02
406 posts
CrazyTrader posted:
It depends on what type of strategy you are backtesting.
- Scalping strategy is 100% useless

 Hello. Why would you say scalping strategies and backtesting is 100% useless? Such open ended statements reveals your bias towards BIAS TRADING which is investing. Scalpers make money on both sides of the coin, as investors only look to FOLLOW the trend. We see how well that worked from 1.39xx to 1.30xx on EU huh..
theHand
Sep 23 2014 at 07:08
365 posts
It's very unreliable. MT makes up the data as it goes along. You'll get a different result from running a test while online and while offline. You'll get a different result on a different processor.

It's got no use other than to see if your code is working.
Rihan
RSTrading
Sep 23 2014 at 07:32
385 posts
Is there any way of doing a reliable backtest then to see how your EA will perform before going live?
theHand
Sep 23 2014 at 10:03
365 posts
Just test it. You can run as many instances of MT as you want to. I usually have about 10 going. If you have an idea code it, run it. See what happens.

Your alternative is to ditch MT and write your own systems in JAVA or C++ and go test it on Oanda's data...

Can also try something ike this: https://pepperstone.com/trading-platforms/ctrader-calgo.php

I don't know how accurate they are, but quite frankly anything will be more accurate than MT.
theHand
Sep 23 2014 at 10:03
365 posts
There's no short cuts, fx takes time, money and effort. Lots of time and effort. And money...
Adrian Matusiak (adrian8891)
Sep 23 2014 at 11:17
696 posts
RSTrading posted:
How reliable is the MT4's strategy tester with 90% modelling quality?

Not reliable even at 1% ;)
PAMM MANAGER // Professional Fund Manager
Rihan
RSTrading
Sep 23 2014 at 11:49
385 posts
I suppose you meant 'not even at 100%'?

So does that extra 9% make a huge difference. Should one rather go that route?

I know backtesting doesn't factor in stuff like spread and commission, but lets say you set the spread to a ridiculous figure and know what your commission is per trade, will that do?

What do you guys then do to get accurate backtesting?
CrazyTraderfx (CrazyTrader)
Sep 23 2014 at 12:52
1718 posts
Many people think backtesting is for testing past. No it doesn't. Backtesting is designed to check if EA you coded run as expected. If not, then it means you have to modify logic code until you get what you want. That's is.
Rihan
RSTrading
Sep 23 2014 at 13:06
385 posts
oh ok.. Then I have been under the wrong impression for years.. So backtesting will not give you past performance? You will only be able to see if your coding was done right.
Rihan
RSTrading
Sep 23 2014 at 13:25
385 posts
Is there a way then to see how your (already established 100% working and doing what you want) EA performs on historical info?
theHand
Sep 23 2014 at 13:39
365 posts
I test. Never bothered with backtesting. It's useless.
theHand
Sep 23 2014 at 13:42
365 posts
@CrazyTrader

Well it's pretty useless for that as well. Try more than 1 pair....
theHand
Sep 23 2014 at 13:43
365 posts
RSTrading posted:
Is there a way then to see how your (already established 100% working and doing what you want) EA performs on historical info?

Nope, as I said, use a different platform. Your only hope.
Rihan
RSTrading
Sep 23 2014 at 13:44
385 posts
@theHand Surely it will give you a rough idea if you are wasting your time or not..
theHand
Sep 23 2014 at 13:49
365 posts
Probabaly already made you throw some very good systems in the dustbin and made you try losing ones.

Look do the test, take your EA run it for a week, then back test the same week. Compare the results. If you can run it on a second broker.

You'll end up with three sets of results.

You just can't build a future on that. And you're wasting your time trying.

My advice to you. Test live, you see very quickly if you like the system or not.
Rihan
RSTrading
Sep 23 2014 at 18:29
385 posts
Thanks, will try that, and will take your advice..
theHand
Sep 23 2014 at 20:21
365 posts
Look even on live tests, I've got one on O running two accounts same code, just different trade sizes.

One has 11 trades open the other 20. The difference ? The spread. I have code watching what's going on spread wise and it will sit on it's hands if it doesn't like the spread. We're talking milliseconds here between quires.

You're not going to get an accurate results from a free piece of software that makes up data is it goes along. Next back test you run look at the bottom right corner. See the data coming through. Then run it again, it will pull data again. So what it pull through on the previous test that it doesn't have now ?

This is before spread problems, server problems and so forth that just doesn't feature in the backtests. The differences between running live and back testing will be anywhere from 20%, 50% up...
Please login to comment .