FAILURE DATASET
Historical strategy measurements. Every cell published.
These 13 preset records show their own measurement details and settings. The registry sweep is a separate historical run; compare its evaluation windows and inputs before comparing results.
The registry-wide historical sweep contains 31 out-of-sample cells; 3 recorded GO* under that run’s criteria. GO* is a cell outcome in the dated sweep, not a deployment approval. The run date and evaluation windows are listed below.
Why the historical sweep and preset-card measurements differ
This historical registry-wide SL/TP sweep uses the run date and evaluation windows listed below. Each simulator card shows its own measurement date, scope and settings; it is a separate record.
The CSV retains the criteria outcome recorded for each cell in that sweep. A preset-card measurement can differ because its dates, coin population or settings differ. Compare those inputs before comparing the results.
Data source: Binance and OKX historical candles, with current updates from OKX USDT-SWAP; historical source boundaries vary by symbol and timestamp — 1-hour candles. That window spans exchange switches, and the switch point differs by symbol and time, so a cell can mix both sources.
You can pull the raw candles yourself from our public API (no key, no account: /api) and run them through your own engine. Our engine code is not open source, so this is two layers stated plainly: open data plus a re-runnable engine — not a fully independent reimplementation.
Reading −100%: where a return reads exactly −100.0%, that is the account-ruin floor, not a sum. The engine stops the equity curve when capital reaches zero and reports the trade number where that happened — trades after it could not have been taken. Individual coins inside such a run can show losses far larger than −100%.
OOS sweep run: 2026-07-19 · Window: 2023-12-30 → 2026-07-12 (1h bars, top-40 coins) · Smallest cell OOS n = 664
Historical sweep summary
Every strategy in our backend registry × every supported direction = 31 cells. In-sample = first 60% of the window (to 2025-07-07, a bull regime), out-of-sample = last 40% (a bear regime). Costs here are equal or lighter than production — so a failure in this sweep is the conservative case.
How the costs compare, in numbers
Costs included: fee 0.08%/leg, slippage 0.02%/leg, funding 0.01%/8h, net PnL. That is 0.20% per round trip.
That is the same as production for Top-50 coins, and cheaper than production below that (0.30% for Top-200, 0.50% for the rest), because production charges liquidity-tiered slippage while this sweep used a flat 0.02%. A strategy that loses on cheap costs loses harder on real ones.
The live-measured table below uses the production default instead, so the two tables are not directly comparable.
21
NO-GO (loses outright)
7
NO-GO — bear beta, not alpha
3
GO* — then killed by walk-forward
Why the survivors died too
- All 16 of 16 LONG cells recorded NO-GO in this run (run date and windows above).
- 7 SHORT cells win the OOS window but lose in-sample. A naive always-short baseline printed in the same bear window — so those wins are regime beta, not strategy alpha. A verdict requires winning both windows.
- The 3 cells that pass the annual regime-robust filter (bb-squeeze-short SHORT, atr-breakout SHORT, ichimoku SHORT) were each killed by half-year walk-forward: every one has 2–3 structural loss halves, with max drawdowns of 69.6–99.4% (scope: full-window adversarial re-run, half-year buckets, n≥30 per material bucket).
All 31 cells — nothing cherry-picked
Registry-default SL/TP as-is, no per-cell parameter fishing. IS = in-sample (2023-12-30 → 2025-07-07), OOS = out-of-sample (2025-07-07 → 2026-07-12). n = trade count in that window. The CSV download carries every column shown here plus TP/SL/timeout exit counts and per-coin profitability.
Scroll for the full grid →
| Cell | Verdict | strategy_id | Direction | SL | TP | IS n | IS Sharpe | IS PF | IS WR | IS ret | IS MDD | OOS n | OOS Sharpe | OOS PF | OOS WR | OOS ret | OOS MDD | oos_tp | oos_sl | oos_to | coins + | coins n |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| bb-squeeze-short SHORT | GO* | bb-squeeze-short | short | 10 | 8 | 1364 | 4.08 | 1.29 | 53.6% | +972.9% | 67.1% | 912 | 0.9 | 1.08 | 52.6% | +146.7% | 86.3% | 165 | 91 | 656 | 30 | 40 |
| bb-squeeze-long LONG | NO-GO | bb-squeeze-long | long | 7 | 6 | 1076 | -4.12 | 0.76 | 46.8% | -723.0% | 100.0% | 664 | -1.03 | 0.91 | 48.0% | -128.4% | 91.8% | 191 | 131 | 342 | 10 | 40 |
| momentum-long LONG | NO-GO | momentum-long | long | 5 | 10 | 1843 | -1.59 | 0.92 | 39.7% | -376.3% | 99.9% | 1138 | -0.87 | 0.94 | 39.1% | -151.6% | 97.4% | 150 | 382 | 606 | 11 | 40 |
| atr-breakout SHORT | GO* | atr-breakout | short | 3 | 7 | 1818 | 6.58 | 1.42 | 40.1% | +1237.5% | 42.1% | 1169 | 1.72 | 1.12 | 36.4% | +240.5% | 69.0% | 268 | 576 | 325 | 35 | 40 |
| atr-breakout-long LONG | NO-GO | atr-breakout-long | long | 3 | 7 | 1520 | -0.44 | 0.97 | 33.1% | -68.9% | 96.7% | 1076 | -2.54 | 0.83 | 31.3% | -317.6% | 98.4% | 195 | 571 | 310 | 16 | 40 |
| hv-squeeze SHORT | NO-GO(beta) | hv-squeeze | short | 10 | 6 | 6733 | -0.13 | 1.0 | 52.9% | -59.5% | 100.0% | 4009 | 7.13 | 1.31 | 56.1% | +2243.6% | 62.3% | 1283 | 312 | 2414 | 32 | 40 |
| rsi-divergence LONG | NO-GO | rsi-divergence | long | 7 | 5 | 1990 | -7.35 | 0.7 | 48.7% | -1724.1% | 100.0% | 1153 | -5.04 | 0.71 | 47.7% | -793.7% | 100.0% | 335 | 291 | 527 | 1 | 40 |
| rsi-divergence SHORT | NO-GO | rsi-divergence | short | 7 | 5 | 1872 | -1.49 | 0.93 | 53.8% | -326.9% | 100.0% | 1069 | 0.09 | 1.01 | 55.9% | +14.6% | 87.2% | 393 | 253 | 423 | 17 | 40 |
| macd-cross LONG | NO-GO | macd-cross | long | 8 | 6 | 7775 | -7.16 | 0.83 | 48.8% | -3464.3% | 100.0% | 4936 | -9.77 | 0.72 | 44.8% | -3361.8% | 100.0% | 1114 | 912 | 2910 | 0 | 40 |
| macd-cross SHORT | NO-GO(beta) | macd-cross | short | 8 | 6 | 7420 | -0.84 | 0.98 | 51.8% | -388.9% | 100.0% | 4475 | 4.1 | 1.16 | 54.1% | +1285.7% | 88.1% | 1182 | 613 | 2680 | 22 | 40 |
| donchian-breakout LONG | NO-GO | donchian-breakout | long | 8 | 10 | 7813 | -4.12 | 0.89 | 45.3% | -2254.1% | 100.0% | 4763 | -6.31 | 0.79 | 42.6% | -2352.5% | 100.0% | 525 | 814 | 3424 | 6 | 40 |
| donchian-breakout SHORT | NO-GO(beta) | donchian-breakout | short | 8 | 10 | 7885 | -1.18 | 0.97 | 46.6% | -677.8% | 100.0% | 4860 | 5.97 | 1.24 | 52.6% | +2271.5% | 75.2% | 593 | 723 | 3544 | 25 | 40 |
| mean-reversion LONG | NO-GO | mean-reversion | long | 5 | 4 | 5045 | -12.31 | 0.69 | 47.5% | -3676.5% | 100.0% | 3114 | -4.93 | 0.83 | 50.0% | -1100.5% | 100.0% | 1283 | 1080 | 751 | 0 | 40 |
| mean-reversion SHORT | NO-GO | mean-reversion | short | 5 | 4 | 4584 | -4.81 | 0.86 | 51.1% | -1340.1% | 100.0% | 2931 | -1.4 | 0.95 | 53.0% | -301.8% | 99.8% | 1273 | 966 | 692 | 9 | 40 |
| supertrend LONG | NO-GO | supertrend | long | 8 | 8 | 5536 | -3.1 | 0.91 | 46.8% | -1311.6% | 100.0% | 3578 | -6.38 | 0.77 | 43.9% | -1941.7% | 100.0% | 505 | 622 | 2451 | 4 | 40 |
| supertrend SHORT | NO-GO(beta) | supertrend | short | 8 | 8 | 5559 | -3.42 | 0.9 | 47.5% | -1493.1% | 100.0% | 3534 | 4.51 | 1.21 | 52.7% | +1349.7% | 78.1% | 561 | 496 | 2477 | 20 | 40 |
| keltner-squeeze LONG | NO-GO | keltner-squeeze | long | 7 | 6 | 1918 | -2.28 | 0.89 | 50.2% | -520.8% | 100.0% | 1330 | -3.01 | 0.83 | 45.7% | -517.3% | 99.9% | 335 | 247 | 748 | 11 | 40 |
| keltner-squeeze SHORT | NO-GO(beta) | keltner-squeeze | short | 7 | 6 | 2093 | 0.48 | 1.02 | 50.7% | +113.0% | 97.0% | 1495 | 3.19 | 1.21 | 55.3% | +592.6% | 66.1% | 464 | 284 | 747 | 25 | 40 |
| keltner-squeeze-long LONG | NO-GO | keltner-squeeze-long | long | 15 | 30 | 1844 | -0.92 | 0.94 | 48.0% | -312.8% | 100.0% | 1295 | -3.09 | 0.78 | 42.2% | -682.2% | 100.0% | 16 | 22 | 1257 | 12 | 40 |
| stochastic-rsi LONG | NO-GO | stochastic-rsi | long | 15 | 15 | 7938 | -4.21 | 0.88 | 46.2% | -2688.7% | 100.0% | 5145 | -10.95 | 0.66 | 40.1% | -4607.1% | 100.0% | 193 | 174 | 4778 | 0 | 40 |
| stochastic-rsi SHORT | NO-GO | stochastic-rsi | short | 15 | 15 | 7947 | -2.28 | 0.93 | 47.3% | -1444.1% | 100.0% | 5207 | 0.83 | 1.03 | 49.6% | +344.3% | 99.8% | 154 | 185 | 4868 | 16 | 40 |
| ma-cross LONG | NO-GO | ma-cross | long | 5 | 10 | 1588 | -0.31 | 0.98 | 42.9% | -62.8% | 97.5% | 1089 | -5.14 | 0.69 | 37.2% | -825.4% | 100.0% | 108 | 427 | 554 | 10 | 40 |
| ma-cross SHORT | NO-GO | ma-cross | short | 5 | 10 | 1584 | 4.86 | 1.35 | 48.7% | +1008.4% | 55.7% | 1112 | -0.87 | 0.94 | 45.5% | -131.5% | 96.4% | 87 | 326 | 699 | 29 | 40 |
| adx-trend LONG | NO-GO | adx-trend | long | 15 | 5 | 3573 | -4.77 | 0.82 | 50.7% | -1568.3% | 100.0% | 2297 | -4.05 | 0.81 | 48.1% | -930.7% | 100.0% | 665 | 49 | 1583 | 7 | 40 |
| adx-trend SHORT | NO-GO(beta) | adx-trend | short | 15 | 5 | 3323 | -0.21 | 0.99 | 55.3% | -68.9% | 99.8% | 2131 | 2.51 | 1.15 | 55.0% | +561.2% | 86.4% | 751 | 71 | 1309 | 18 | 40 |
| ichimoku LONG | NO-GO | ichimoku | long | 3 | 15 | 2802 | 2.25 | 1.12 | 35.0% | +605.6% | 83.2% | 1678 | -1.87 | 0.89 | 32.7% | -353.6% | 99.8% | 79 | 938 | 661 | 21 | 40 |
| ichimoku SHORT | GO* | ichimoku | short | 3 | 15 | 2687 | 1.59 | 1.08 | 33.4% | +423.2% | 98.2% | 2074 | 4.3 | 1.28 | 39.5% | +965.9% | 81.8% | 102 | 1032 | 940 | 30 | 40 |
| heikin-ashi LONG | NO-GO | heikin-ashi | long | 7 | 8 | 12565 | -6.2 | 0.88 | 45.5% | -4033.1% | 100.0% | 7448 | -10.32 | 0.75 | 41.8% | -4599.7% | 100.0% | 1215 | 1769 | 4464 | 1 | 40 |
| heikin-ashi SHORT | NO-GO(beta) | heikin-ashi | short | 7 | 8 | 12597 | 0.24 | 1.0 | 48.0% | +156.7% | 100.0% | 7443 | 5.33 | 1.16 | 51.4% | +2354.5% | 72.8% | 1350 | 1443 | 4650 | 29 | 40 |
| volume-profile LONG | NO-GO | volume-profile | long | 2 | 5 | 23180 | -15.11 | 0.81 | 27.9% | -7014.5% | 100.0% | 12231 | -12.85 | 0.78 | 28.1% | -4225.0% | 100.0% | 2844 | 8607 | 780 | 1 | 39 |
| volume-profile SHORT | NO-GO | volume-profile | short | 2 | 5 | 24072 | -11.61 | 0.85 | 28.8% | -5549.8% | 100.0% | 10552 | -0.44 | 0.99 | 32.8% | -141.8% | 99.9% | 2908 | 6975 | 669 | 0 | 39 |
GO* = passes a naive annual regime-robust filter but is killed by the half-year walk-forward (details in the summary above). Returns are the engine’s non-compounded sums across coins for that window — a backtest artifact, not an account trajectory, and not a forecast of any future window.
13 preset measurement records
Each card below shows its own dated measurement, scope and defaults. The simulator link opens those defaults; later data or a different coin population can change the result.
ATR Breakout ↓
When a quiet market suddenly breaks downward, shorts the move — EMA filter keeps it with the trend.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 3 / TP 7 · PF 1.10 · 730 trades · evaluation window not recorded
Reproduce this result — in the simulator →All 30 SL/TP combinations →Keltner Squeeze ↓
After a squeeze releases, shorts the first break below the lower Keltner band — barely above breakeven at these settings and below our 1.05 curated bar; the re-test read the short edge as bear-beta, with deep drawdowns.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 7 / TP 5 · PF 1.02 · 978 trades · evaluation window not recorded
Reproduce this result — in the simulator →All 30 SL/TP combinations →MACD Cross ↓
The textbook MACD sell signal — gets chopped to pieces by crypto's noise: negative expectancy at real fees.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 12 / TP 10 · PF 0.82 · 2,939 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →SuperTrend ↑
Follows the popular Supertrend line upward — enters late, exits late, fees eat the rest.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 5 / TP 12 · PF 0.92 · 2,446 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →Donchian Breakout ↓
Shorts a break below the channel’s lower bound. Open the card’s dated record for the measured inputs and results.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 5 / TP 8 · PF 0.95 · 3,383 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →Stochastic RSI ↓
Shorts every overbought reading — trades so often that fees bleed it out. A fresh run reversed the sign: the original edge was curve-fit.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 10 / TP 5 · PF 0.86 · 4,035 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →Momentum ↑
Buys strength expecting more — near breakeven here. Widen the take-profit and it looks profitable, but that gain fails out-of-sample: it's curve-fit, not real.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 12 / TP 8 · PF 1.04 · 978 trades · evaluation window not recorded
Reproduce this result — in the simulator →All 30 SL/TP combinations →Mean Reversion ↑
Buys sharp dips expecting a snap back — crypto dips keep dipping: negative expectancy at real fees.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 10 / TP 8 · PF 0.74 · 1,622 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →HV Squeeze ↓
Shorts volatility squeezes with a candle-color filter. Measurements are listed in this card’s dated record.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 10 / TP 6 · PF 0.98 · 2,780 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →RSI Divergence ↕
The chart-school favorite — price makes a new extreme, RSI disagrees. Lowest profit factor on this grid — negative expectancy at real fees.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 7 / TP 5 · PF 0.69 · 1,635 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →ADX Trend ↕
Only trades when ADX confirms a strong trend — the confirmation arrives too late, every time. The 2026-06 re-test read its short edge as bear-beta.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 15 / TP 5 · PF 0.82 · 1,445 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →Heikin Ashi ↕
Follows smoothed Heikin Ashi candles — the smoothing hides the noise until it becomes your loss: negative expectancy at real fees.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 7 / TP 8 · PF 0.91 · 9,855 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →Volume Profile ↕
Fades moves away from the volume point-of-control — fires constantly and loses far more than it wins. The original 10-coin sample is below our n≥30 bar.
Measured 2026-11-20 · top 10 coins · 1H · 5x · SL 2 / TP 5 · PF 0.82 · 13,779 trades · evaluation window not recorded
Reproduce this loss — in the simulator →All 30 SL/TP combinations →Archived Binance-era backtest run: LONG parameter variations across all indicators — none was kept at the time (BB Squeeze LONG and Momentum Breakout LONG were below the bar in the 2026-02-05 test).
Run the same test yourself — full history, free
Everything behind this dataset is the same engine you can use right now: backtests over our up to 3.0 years of data on 290+ coins, with fees, slippage and funding modeled — no subscription, no credit card, no account. Hosted backtesters typically put full-history testing behind a paid tier; we publish our platform comparison separately.
Dataset updates are announced on Telegram and RSS — no email required.
Everything on this page is free — PRUVIQ runs on exchange referral fees (how that works).
Cite this dataset
PRUVIQ, “Failed Strategies Dataset — full-registry OOS sweep” (run 2026-07-19), https://pruviq.com/failed-strategies/ · CSV: https://pruviq.com/data/failed-strategies-oos.csv
- Generated 2026-07-19 by
backend/research/oos_full_registry.py+oos_full_registry_adversarial.pyagainst the production simulation engine (engine_fast.py::run_fast— the same code path as /simulate). These scripts are in our private repository, so the sweep cannot be re-run from outside; the CSV is the published output. - Data: 1h futures bars, top-40 coins fixed at run start (survivorship caveat: delisted coins absent — affects absolute returns, not the directional verdicts).
- No look-ahead: entries at signal index + 1, indicators past-only, trades bucketed by entry time. Verdicts are for the stated windows only — past failure or survival in these windows implies nothing about future windows.
All figures are historical backtest measurements for the stated windows, settings and coin universes. They are published for verification and education, are not investment advice, and do not predict future performance.