Reading an EA Backtest Report: Why the Best Numbers Lie
Almost every guide to backtesting is written for the person who built the strategy and ran the test themselves.
The standard advice is familiar: use real ticks, demand high modeling quality, include realistic spreads, forward-test the system, and do not over-optimize. Good advice, and thoroughly covered elsewhere.
This guide is about the more dangerous situation: you are handed a backtest by someone else.
It may come from an EA vendor, a developer showing their work, or a seller on a marketplace. You did not run it, you cannot see how it was made, and all you have is the report.
The uncomfortable truth is that the report, by itself, tells you very little. Worse, the numbers traders tend to trust most are often the easiest to manufacture. Here is how to read a backtest report without being fooled.
“99% modeling quality” describes the data, not the strategy
This is the figure sellers point to first, and it is the most misunderstood number in the whole report.
Modeling quality measures how completely the tester simulated price movement.
Ninety-nine percent means the test used detailed tick data rather than crude bar approximations. That is genuinely better, and its absence is a red flag.
But its presence proves nothing about whether the strategy works. A 99% modeling-quality test can still assume a fixed, unrealistically tight spread, zero slippage, and instant fills.
It tells you the price path was simulated in detail. It says nothing about whether the trading costs were realistic.
On many strategies, the costs decide everything. A high modeling-quality figure sitting on top of fantasy execution costs is a precise, well-rendered lie.
What actually matters is the spread, commission, and slippage the test assumed. The report does not always make that obvious.
If a seller shows you 99% quality but will not disclose the cost assumptions, they have shown you the reassuring number and hidden the deciding one.
A smooth equity curve can be a warning
Everyone wants the clean line climbing from left to right with no ugly drops. It feels like proof of a reliable system. Sometimes it is. Often it is the single most suspicious thing on the page.
An equity curve with almost no drawdown and a very high win rate can be the fingerprint of a system that hides losses rather than avoids them.
Grid and martingale logic can produce exactly this shape by holding losing trades unrealized until they turn green. That is why unusually smooth results should make you look harder, not relax.
The prettier the curve, the more you should want to know what happens to a losing trade.
A strategy that appears never to lose is usually deferring its losses, not escaping them.
The honest version of a good strategy has visible losing trades and real drawdown. It looks less impressive, but it is far more informative.
A high win rate is close to meaningless on its own
Win rate is the number sellers quote because it sounds like skill. Eighty percent winners feel like an 80% chance of success. It is nothing of the sort.
Win rate means nothing without the size of wins compared with the size of losses.
A system that wins 30% of the time with a three-to-one payoff can make money. A system that wins 80% of the time while its rare losses are five times larger than its wins can lose money steadily.
Quoting win rate alone, with no mention of average win versus average loss, is one of the oldest presentational tricks in the catalogue.
When someone leads with win rate, ask one simple question: What does the average loss look like next to the average win? If they do not want to answer, you have learned what you needed to.
A long track record proves survival, not durability
“Three years live” or “tested over fifteen years” sounds like robustness. It is worth less than it appears.
A long test proves only that the strategy survived the conditions inside that window. It does not prove it will survive the condition that ends it.
A system carrying hidden, uncapped risk can run for years while the market happens not to make the one move that breaks it.
Every additional year of survival makes the eventual break look less likely, right up until it happens.
Duration is not the same as durability. The useful question is not simply how long the strategy ran, but what its defined worst case is and whether the test period ever actually challenged it.
The report cannot show you overfitting
Here is the deepest problem with reading a backtest from the outside: it shows what a strategy did on data that already exists. It cannot show whether the strategy was shaped to fit that specific data.
This is overfitting, and it is a common reason a strategy that backtests beautifully dies in live trading.
A strategy with a dozen finely tuned parameters, each optimized across a wide range, may have been sculpted to match the exact wiggles of the historical data, like a key filed to fit one lock.
It can score brilliantly on the data it was fitted to and fall apart on anything new.
You cannot reliably spot overfitting in the final report because, inside the optimized window, the overfitted strategy can look perfect.
The best defense is out-of-sample evidence: results on data the strategy was never tuned against.
Ideally, that evidence is followed by a live or demo forward test after the logic and parameters were finalized.
If a seller can show only a backtest on the same period they optimized, you are looking at the inside of the lock, not proof that the key opens anything else.
Repainting can defeat the entire report
One more problem can undo even a careful review.
If the strategy relies on a repainting indicator, meaning one that quietly rewrites past values as new bars form, the backtest can see signals as they look after repainting, not as they appeared in real time.
The result inherits information that was never available at the moment of the trade.
Accuracy is overstated in a way live trading cannot reproduce, and nothing in the headline statistics reveals it.
This is why signals read from the current forming bar deserve extra scrutiny. Non-repainting logic evaluated on a closed bar is the safer foundation for a credible test.
A backtest is evidence about one strategy, on one dataset, under one set of assumptions. It is not a certificate of future performance.
How to evaluate someone else’s backtest
Reading someone else’s backtest comes down to interrogating what the report does not volunteer. Before you trust the equity curve, get clear answers to these five questions:
- Were the costs realistic? Confirm the spread, commission, swap, and slippage assumptions.
- What is the payoff ratio? Compare the average win with the average loss instead of relying on win rate.
- What is the defined worst case? Identify hard limits on exposure, positions, drawdown, and total loss.
- Is there out-of-sample proof? Ask for untouched data or a forward test conducted after optimization ended.
- Do any signals repaint? Verify that entries use information that was genuinely available at the time.
A seller who answers these questions plainly may be showing you something real. One who keeps redirecting you to modeling quality and win rate is emphasizing the numbers chosen to reassure you while withholding the ones that decide.
What an honest backtest looks like
This is why, when we build for a client, the backtest is where we are most careful and least flattering.
It is easy to hand someone an impressive report. It is more useful to hand them one that tells the truth: tested with realistic costs, shown with its real drawdowns and validated on data it was never fitted to.
If you have a strategy you want built and tested in a way whose results actually mean something, let us know what you trade and how the rules work. We will test it honestly before you rely on it.
You Might Also Like:
