Map.TradeMap.Trade
Client LoginGet Access →
Advanced

Out-of-sample

Pronunciation: out-of-SAM-pul

Data a strategy was NOT built or tuned on — used to check whether its edge is real.

Definition

Out-of-sample refers to market data that was not used to develop or optimise a strategy, as opposed to in-sample data (the history the rules were fitted to). Splitting history into in-sample and out-of-sample — or validating on later, unseen data — is the standard defence against overfitting: a strategy that performs on data it was never tuned to is far more likely to hold an edge live. It is a validation concept, not a guarantee.

In plain English — Out-of-sample data is the part of history you hold back when designing a strategy, so you can test it on data it has never seen. If the rules only look good on the data they were built on (in-sample), you may have just memorised the past. Out-of-sample testing is how you catch that.

Example

You design rules on 2018–2021 data (in-sample), then test them untouched on 2022–2023 (out-of-sample). A strategy that shines in-sample but collapses out-of-sample was probably curve-fitted.

Related terms

Where you see this in the app

Educational content only. Map.Trade does not provide financial advice or trading signals.

Why it matters

Testing only on the data you built on flatters almost any strategy. Out-of-sample data is the closest honest check of whether an edge is real before you risk capital.

Frequently asked questions

What is the difference between in-sample and out-of-sample?

In-sample is the data you built and tuned the rules on; out-of-sample is data you held back and never optimised against. Strong out-of-sample results are the meaningful ones.

How does out-of-sample relate to forward testing?

Forward testing is out-of-sample by nature — the data arrives after the rules were fixed, so it could not have been fitted. A held-back historical slice is out-of-sample too.

Does passing out-of-sample mean a strategy will be profitable?

No. It reduces the chance you overfitted, but markets change and past results never guarantee future ones. This is educational validation, not financial advice.

Out-of-sample — Trading Glossary · Map.Trade