Hypothetical worked example and primary educational references; not observed market data.
A simulation depends on its rules and information
A backtest applies a strategy to historical or constructed data. It can reveal how specified rules behave within that dataset, but its credibility depends on whether the rules and information were realistically available. Investor.gov's warning about past performance applies even before considering simulation-specific weaknesses. A strategy built after seeing the results has an additional selection problem: its success may partly reflect knowledge of the very path used to evaluate it. Distinguish a transparent exercise for understanding mechanics from evidence that a decision process can work on new data under actual trading conditions.
Supporting references: 1. Investor.gov: Mutual Funds, Past Performance
Searching many rules creates a selection effect
Suppose an analyst tries many combinations of entry thresholds, holding periods, and asset lists, then publishes only the best. The final performance number omits the unsuccessful search. Even without fabricated data, the selected strategy may have fit accidental patterns. This is an original reasoning point about repeated selection rather than an empirical claim about how often strategies fail. Report how the rule was chosen and what alternatives were tested. A strong result means less when it emerged from extensive undisclosed experimentation than when it followed a predeclared process evaluated on information excluded from rule selection.
Hypothetical worked example
Turnover sensitivity in a constructed simulation
Model setup
Read these assumptions before comparing the scenarios.
- All monetary amounts in this example are hypothetical U.S. dollars (USD), not current prices, quoted account terms or observed market data. Percentages, counts, time periods and index levels retain their stated units.
- Starting static base is 20,000; invented gross return is 8%.
- Each round trip costs 0.15% of the static base; no compounding of costs.
Net return (%)
- 1. 20
- 5.00
- 2. 5
- 7.25
Shared zero-based value scale. Range: 0.00 to 7.25, in the units above. Case numbers match the labels; no probability or time trend is implied.
Hypothetical model, not observed market data or a forecast. Assumptions above; original values and calculations below.
| Round trips | Modeled cost (%) | Cost amount (USD) | Net return (%) |
|---|---|---|---|
| 20 | 3.00 | 600 | 5.00 |
| 5 | 0.75 | 150 | 7.25 |
Calculation details
- High-turnover cost
- 3.00 %
(20 * 0.14999999999999999) - Low-turnover cost
- 0.75 %
(5 * 0.14999999999999999) - High cost amount
- 600.00 USD
(20000 * 0.029999999999999999) - Low cost amount
- 150.00 USD
(20000 * 0.0074999999999999997) - High net
- 5.00 %
(8 - 3) - Low net
- 7.25 %
(8 - 0.75)
Make omitted costs visible with an invented example
Assume a hypothetical simulation reports an 8% gross one-year return on USD 20,000. It also assumes 20 round trips, each costing 0.15% of the same static balance. Under this intentionally simplified convention, total trading cost is 3%, or 600, and net return is 5%. A second version with five round trips has costs of 0.75%, or 150, and net return of 7.25%. The returns and charges are invented. This exercise shows how turnover assumptions alter the result; it does not claim that real trading costs are constant or that netting them always works by simple subtraction.
A tradeable signal needs a tradeable time
A simulation must distinguish when information is known from when an order can be executed. Using a closing price both to calculate a signal and to assume a same-price trade can be unrealistic without a valid execution mechanism. Revised financial data can create a similar issue if the test assumes the final revision was available earlier. Record publication times, signal timing, and execution assumptions. A strategy's arithmetic can be internally consistent while using information the investor could not possess. That is why an audit of data timing is separate from verification of equations and code.
Stress implementation rather than only fit
Try reasonable changes in costs, delays, liquidity, and parameters to see whether the conclusion depends on a narrow setup. A rule that appears attractive only under one precise threshold may be fragile, though robustness itself does not establish future profitability. Index methods also involve explicit construction rules, as Investor.gov explains, which makes methodology a useful reference point for reviewing any rule-based strategy. Document what the simulation ignores, such as taxes, market impact, borrowing availability, or rejected orders. Each omission narrows the claim the result can support rather than being a minor footnote to a promised return.
Supporting references: 2. Investor.gov: Index Funds
Keep the conclusion proportional to the test
A backtest can teach exposures, turnover, sensitivity, and historical path dependence. It cannot establish a legal guarantee, a current product recommendation, or a future return promise. Independent evaluation periods help reduce some hindsight problems, but changing the strategy after seeing those periods can reintroduce selection. Preserve the original rules and disclose subsequent changes. The hypothetical cost example should therefore be read as a mechanism lesson, not evidence of an investment opportunity. Reliable arithmetic is necessary for a sound simulation; reliable information timing and restrained interpretation are equally necessary for its result to remain useful.
Test another situationPrice the delay between a signal and an executable trade
A separate hypothetical case. Its inputs differ from the main worked example above.
Price the delay between a signal and an executable trade
Assume a hypothetical simulation buys 100 shares at a USD 20 signal price and sells at USD 22 one month later. An executable version instead buys at USD 21 after the signal becomes available, with the same endpoint and no other differences. The delay reduces modeled dollar profit by exactly USD 100. These prices are teaching inputs, not market evidence or a likely slippage estimate. A robust rule should be examined using a feasible information timeline before debating its apparent attractiveness. Accepting later entry can preserve realistic execution while losing an advantage that existed only because the model traded before its information was available.
Freeze both the rule and its evaluation protocol
Investor.gov warns that past performance does not predict future results and explains that implementation costs matter. Apply those narrow principles to simulation governance by recording data versions, signal timestamps, permissible order timing and cost assumptions before evaluating a held-out period. If the rule is changed after inspecting that period, the period has participated in selection and should not be presented as untouched evidence. Retain failed variants in the research log where possible. This does not make future returns knowable; it makes the evidence behind the claimed process more reviewable and helps distinguish a tested decision rule from a fitted historical narrative.
Supporting references: 1. Investor.gov: Mutual Funds, Past Performance · 3. Investor.gov: How Fees and Expenses Affect Your Investment Portfolio
Check this case’s calculations
- Profit reduction from delayed entry
- 100.00 USD
(100 * (21 - 20))
Limits of this additional case
- The fixed delay-price difference ignores partial fills, changing exit rules, capacity and the cost of unsuccessful orders.
Limits of this analysis
- Static cost subtraction omits changing trade sizes and compounding.
- Independent evaluation reduces but does not eliminate selection issues.
- References support historical-performance and methodology concepts, not empirical backtest reliability rates.
Sources and scope
- Investor.gov: Mutual Funds, Past Performance
Past fund performance does not necessarily predict future results.
Scope: U.S. investor education; supports the stated mechanism, not the hypothetical scenario or a forecast.. Reference accessed 2026-10-06.
- Investor.gov: Index Funds
Index funds seek index returns and can experience tracking error and costs.
Scope: U.S. investor education; supports the stated mechanism, not the hypothetical scenario or a forecast.. Reference accessed 2026-10-06.
- Investor.gov: How Fees and Expenses Affect Your Investment Portfolio
Investment costs depend on charging terms and reduce the resources retained by investors.
Scope: Primary educational reference supports only the attributed mechanism; the USD scenario and decision analysis are independent illustrations, not personalized advice.. Reference accessed 2026-10-26.
Illustrative calculations are not forecasts or personal recommendations. Editorial standards
