Open Market Rank Everything that has a price and a size, ranked

Out-of-sample validation

Pattern Lab · Walk-forward

Does geometric similarity predict anything after the model is forced to live only in the past?

Generated 2026-08-12T19:51:40.654135+00:00. Primary test: Brier-score improvement over a same-market momentum/volatility matched control.

Global result

Hypothesis cells tested117 / 153
Excluded for insufficient OOS depth36
Shape better on Brier score15 / 117
Weighted mean Brier skill-0.01268
Raw p < 0.051
Benjamini–Hochberg FDR 10%0
Holm family-wise 5%0
Positive net cells at base cost55
Positive net cells at 2× cost51
Shape net beats matched-control net45

Interpretation rule: raw p-values are exploratory. A pattern cell is treated as a discovery only after all tested markets/windows/horizons are corrected together. Holm is the strict family-wise control; BH is the less conservative false-discovery-rate view.

Best corrected cells

MarketPatternForwardNBrier skillRaw pBH qHolm pShape netMatched net
WTI crude futures
CL=F
60d5d640.034310.02331.00001.0000+0.79%-0.09%
DAX
^GDAXI
120d5d230.034710.09631.00001.0000+0.56%-0.37%
WTI crude futures
CL=F
60d20d640.012770.15461.00001.0000+1.52%+1.96%
USD/CAD
CAD=X
20d1d790.011280.16751.00001.0000+0.07%+0.00%
USD/CAD
CAD=X
60d20d580.008420.25421.00001.0000+0.00%-0.19%
Gold futures
GC=F
20d20d880.005660.26111.00001.0000+0.88%+1.35%
USD/CAD
CAD=X
20d20d790.005710.27531.00001.0000+0.11%-0.08%
WTI crude futures
CL=F
20d20d880.005060.31661.00001.0000+0.81%+1.28%
SPDR S&P 500 ETF
SPY
20d20d1180.002590.34661.00001.0000+0.95%+0.88%
Bitcoin
BTC-USD
60d1d320.007300.37401.00001.0000-0.00%+0.15%
Invesco QQQ ETF
QQQ
20d5d940.002700.38281.00001.0000+0.19%+0.00%
Bitcoin
BTC-USD
20d1d530.004030.39181.00001.0000+0.56%+0.01%

Protocol

Expanding walk-forward starts only after 1000 observations. Evaluation anchors are fixed every 63 bars, so the longest 20-day outcomes do not overlap. At every anchor, STUMPY/DTW sees only history whose full continuation was already known before the query pattern began. No future analogue is eligible.

Forecast probabilities use a Jeffreys-smoothed empirical up-frequency from historical analogues. The baseline uses historical windows from the same instrument matched on momentum and realized volatility, but not on shape. The paired loss difference is tested with a one-sided Newey–West/HAC mean test; lag length grows with pattern-window overlap.

The trading diagnostic uses a pre-declared threshold: long at P(up) ≥ 0.55, short at P(up) ≤ 0.45, otherwise flat. Round-trip costs are fixed research assumptions: FX 2 bp, index/ETF proxy 4 bp, commodities 6 bp, crypto 20 bp. A 2×-cost stress result is reported alongside the base case.

Important: these are model-validation diagnostics, not executable price quotes. Index rows use proxy execution assumptions; borrow, financing, taxes, market impact and broker-specific slippage are not fully modelled. Surviving corrected significance would justify deeper replication, not automatic live trading.

Current analogue snapshot · Backtest JSON

All cells

S&P 500 · ^GSPC · 377 walk-forward anchors · 1927-12-30…2026-08-12
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d377-0.0035752.8%47.7%0.76361.00001.0000199-0.03%-0.05%
20d5d377-0.0071751.7%56.0%0.93101.00001.0000213-0.04%-0.07%
20d20d377-0.0025456.5%58.6%0.72301.00001.0000249+0.07%+0.04%
60d1d352-0.0208749.4%48.9%0.99581.00001.0000259-0.01%-0.04%
60d5d352-0.0151453.1%56.5%0.98991.00001.0000236-0.08%-0.11%
60d20d352-0.0141553.7%59.7%0.99601.00001.0000254+0.22%+0.19%
120d1d170-0.0207351.2%47.6%0.95181.00001.0000133-0.11%-0.14%
120d5d170-0.0359950.0%59.4%0.99921.00001.0000136-0.19%-0.22%
120d20d170-0.0168257.6%63.5%0.95971.00001.0000138+0.43%+0.40%
NASDAQ Composite · ^IXIC · 206 walk-forward anchors · 1971-02-05…2026-08-12
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d206-0.0132757.3%58.7%0.98411.00001.0000120+0.03%+0.01%
20d5d206-0.0054857.8%54.4%0.81431.00001.0000117-0.02%-0.04%
20d20d2060.0009763.1%55.8%0.43681.00001.0000134+0.63%+0.60%
60d1d178-0.0277552.2%60.7%0.99911.00001.0000125-0.08%-0.11%
60d5d178-0.0337550.6%59.6%1.00001.00001.0000130-0.13%-0.16%
60d20d178-0.0191451.7%60.7%0.99131.00001.0000133+0.36%+0.33%
120d1d53-0.0704241.5%66.0%0.99991.00001.000045-0.03%-0.06%
120d5d53-0.0412550.9%64.2%0.97221.00001.000041+0.35%+0.32%
120d20d53-0.0329154.7%67.9%0.97921.00001.000044+0.77%+0.73%
Dow Jones Industrial Average · ^DJI · 123 walk-forward anchors · 1992-01-02…2026-08-12
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d123-0.0071850.4%43.1%0.75891.00001.000083-0.11%-0.13%
20d5d123-0.0092747.2%44.7%0.83871.00001.000080-0.17%-0.20%
20d20d123-0.0063961.8%61.8%0.82451.00001.0000103+0.71%+0.67%
60d1d105-0.0254645.7%41.9%0.96281.00001.000081-0.09%-0.12%
60d5d105-0.0067552.4%43.8%0.68231.00001.000086-0.05%-0.09%
60d20d105-0.0218961.0%61.9%0.97791.00001.000086+0.56%+0.53%
120d1d1457.1%42.9%10-0.26%-0.29%
120d5d1428.6%42.9%10-0.79%-0.81%
120d20d1450.0%50.0%13+0.24%+0.20%
DAX · ^GDAXI · 139 walk-forward anchors · 1987-12-29…2026-08-11
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d139-0.0226242.4%51.8%0.98821.00001.000085-0.10%-0.13%
20d5d139-0.0242446.8%59.0%0.99941.00001.000081-0.02%-0.04%
20d20d139-0.0104055.4%59.7%0.94871.00001.0000103+0.31%+0.28%
60d1d116-0.0161551.7%56.9%0.84911.00001.000088+0.10%+0.06%
60d5d116-0.0139950.0%56.9%0.88761.00001.000084-0.14%-0.17%
60d20d116-0.0141650.0%56.9%0.94621.00001.000095-0.52%-0.55%
120d1d23-0.0318939.1%39.1%0.87701.00001.000019-0.17%-0.20%
120d5d230.0347160.9%43.5%0.09631.00001.000018+0.56%+0.53%
120d20d23-0.0183152.2%56.5%0.76731.00001.000018+0.60%+0.56%
FTSE 100 · ^FTSE · 155 walk-forward anchors · 1984-01-03…2026-08-11
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d155-0.0169249.7%54.2%0.96681.00001.000089+0.03%+0.00%
20d5d155-0.0022047.7%43.9%0.63511.00001.000099-0.08%-0.10%
20d20d155-0.0099249.7%50.3%0.92971.00001.0000108-0.07%-0.09%
60d1d132-0.0219551.5%51.5%0.94461.00001.0000102-0.00%-0.03%
60d5d132-0.0110547.7%43.2%0.87011.00001.000094-0.04%-0.07%
60d20d132-0.0175750.8%47.0%0.96421.00001.000094-0.41%-0.44%
120d1d34-0.0055850.0%55.9%0.57201.00001.000028+0.08%+0.05%
120d5d34-0.0004247.1%38.2%0.50601.00001.000022-0.14%-0.17%
120d20d34-0.0144941.2%44.1%0.80401.00001.000026-0.78%-0.81%
Nikkei 225 · ^N225 · 225 walk-forward anchors · 1965-01-04…2026-08-09
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d225-0.0065053.8%53.8%0.82851.00001.0000128+0.02%-0.01%
20d5d225-0.0056152.0%53.8%0.82681.00001.0000124+0.09%+0.07%
20d20d225-0.0007456.0%57.8%0.55281.00001.0000152+0.76%+0.73%
60d1d200-0.0251648.5%51.5%0.98781.00001.0000152-0.04%-0.07%
60d5d200-0.0030654.5%51.0%0.63471.00001.0000143+0.19%+0.16%
60d20d200-0.0133952.0%56.0%0.94561.00001.0000147+0.51%+0.48%
120d1d60-0.0495650.0%65.0%0.97821.00001.000047+0.03%+0.00%
120d5d60-0.0235353.3%56.7%0.87001.00001.000045+0.51%+0.48%
120d20d60-0.0297045.0%56.7%0.95591.00001.000048+0.34%+0.31%
Hang Seng · ^HSI · 139 walk-forward anchors · 1986-12-30…2026-08-10
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d139-0.0080954.0%56.1%0.79341.00001.000089-0.00%-0.03%
20d5d139-0.0108353.2%58.3%0.92571.00001.000091+0.22%+0.19%
20d20d139-0.0031153.2%53.2%0.66271.00001.000094+0.39%+0.36%
60d1d118-0.0226247.5%43.2%0.93491.00001.000087-0.08%-0.11%
60d5d1180.0024657.6%55.1%0.40511.00001.000080+0.45%+0.43%
60d20d118-0.0193648.3%51.7%0.97031.00001.000084-0.33%-0.36%
120d1d1741.2%17.6%14-0.23%-0.27%
120d5d1735.3%58.8%13-0.84%-0.87%
120d20d1752.9%47.1%13+0.61%+0.58%
EUR/USD · EURUSD=X · 78 walk-forward anchors · 2003-12-01…2026-08-11
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d78-0.0060455.1%52.6%0.63921.00001.000055+0.03%+0.02%
20d5d78-0.0123841.0%50.0%0.84191.00001.000043-0.15%-0.16%
20d20d78-0.0150343.6%53.8%0.96611.00001.000036-0.30%-0.31%
60d1d55-0.0085745.5%54.5%0.64751.00001.000035-0.01%-0.02%
60d5d55-0.0324545.5%65.5%0.91711.00001.000041-0.05%-0.06%
60d20d55-0.0049356.4%61.8%0.60411.00001.000040+0.14%+0.13%
120d1d10.0%100.0%1-0.27%-0.29%
120d5d1100.0%0.0%1+0.14%+0.12%
120d20d10.0%0.0%0+0.00%+0.00%
GBP/USD · GBPUSD=X · 78 walk-forward anchors · 2003-12-01…2026-08-11
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d780.0021751.3%50.0%0.43711.00001.000049+0.04%+0.03%
20d5d78-0.0239643.6%51.3%0.98601.00001.000047-0.12%-0.13%
20d20d78-0.0259642.3%56.4%0.99511.00001.000037-0.17%-0.18%
60d1d56-0.0128251.8%46.4%0.71721.00001.000044+0.02%+0.01%
60d5d56-0.0329044.6%51.8%0.94511.00001.000044+0.01%-0.00%
60d20d56-0.0123344.6%44.6%0.79921.00001.000040-0.07%-0.09%
120d1d1100.0%100.0%1+0.86%+0.84%
120d5d1100.0%0.0%1+0.32%+0.30%
120d20d10.0%100.0%1-0.98%-1.00%
USD/JPY · JPY=X · 107 walk-forward anchors · 1996-10-30…2026-08-11
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d107-0.0184947.7%46.7%0.94631.00001.000072-0.06%-0.08%
20d5d107-0.0033950.5%54.2%0.64341.00001.000062-0.03%-0.04%
20d20d107-0.0013651.4%48.6%0.56691.00001.000058-0.09%-0.10%
60d1d76-0.0119151.3%51.3%0.76641.00001.000060+0.09%+0.07%
60d5d76-0.0251248.7%60.5%0.94861.00001.000057+0.09%+0.07%
60d20d76-0.0116150.0%51.3%0.82081.00001.000051-0.03%-0.04%
120d1d1030.0%30.0%7-0.13%-0.15%
120d5d1060.0%70.0%9+0.09%+0.07%
120d20d1050.0%40.0%7-0.38%-0.39%
AUD/USD · AUDUSD=X · 68 walk-forward anchors · 2006-05-15…2026-08-11
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d68-0.0109051.5%52.9%0.76471.00001.000052+0.01%-0.01%
20d5d68-0.0226447.1%51.5%0.98811.00001.000034-0.14%-0.15%
20d20d68-0.0041150.0%50.0%0.65901.00001.000033+0.05%+0.04%
60d1d49-0.0487044.9%42.9%0.97491.00001.000037-0.00%-0.02%
60d5d49-0.0220046.9%51.0%0.87151.00001.000034-0.01%-0.02%
60d20d49-0.0047049.0%57.1%0.60701.00001.000038-0.00%-0.02%
120d1d10.0%0.0%0+0.00%+0.00%
120d5d10.0%100.0%0+0.00%+0.00%
120d20d1100.0%100.0%1+0.39%+0.37%
USD/CAD · CAD=X · 79 walk-forward anchors · 2003-09-16…2026-08-11
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d790.0112860.8%49.4%0.16751.00001.000045+0.07%+0.06%
20d5d79-0.0116846.8%46.8%0.90381.00001.000038-0.24%-0.25%
20d20d790.0057153.2%48.1%0.27531.00001.000044+0.11%+0.10%
60d1d58-0.0181256.9%50.0%0.76471.00001.000050-0.04%-0.06%
60d5d58-0.0153356.9%39.7%0.78461.00001.000042+0.09%+0.08%
60d20d580.0084251.7%51.7%0.25421.00001.000033+0.00%-0.01%
120d1d4100.0%75.0%4+0.07%+0.05%
120d5d450.0%50.0%3-0.18%-0.20%
120d20d475.0%75.0%2+0.03%+0.02%
Gold futures · GC=F · 88 walk-forward anchors · 2000-08-30…2026-08-12
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d88-0.0185751.1%51.1%0.92681.00001.000064-0.22%-0.26%
20d5d88-0.0079252.3%52.3%0.78631.00001.000051-0.27%-0.31%
20d20d880.0056655.7%63.6%0.26111.00001.000057+0.88%+0.84%
60d1d70-0.0062451.4%47.1%0.63201.00001.000052-0.15%-0.19%
60d5d70-0.0406345.7%55.7%0.99491.00001.000055-0.34%-0.38%
60d20d70-0.0075564.3%67.1%0.67491.00001.000054+0.43%+0.39%
120d1d785.7%71.4%7+0.44%+0.38%
120d5d785.7%57.1%5+1.48%+1.43%
120d20d771.4%71.4%4+0.06%+0.03%
WTI crude futures · CL=F · 88 walk-forward anchors · 2000-08-23…2026-08-12
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d88-0.0262240.9%52.3%0.99341.00001.000049-0.23%-0.26%
20d5d88-0.0019944.3%42.0%0.57391.00001.000054+0.14%+0.10%
20d20d880.0050664.8%62.5%0.31661.00001.000057+0.81%+0.78%
60d1d64-0.0489446.9%57.8%0.98721.00001.000048-0.31%-0.35%
60d5d640.0343164.1%56.2%0.02331.00001.000047+0.79%+0.75%
60d20d640.0127767.2%67.2%0.15461.00001.000045+1.52%+1.48%
120d1d475.0%50.0%4+0.33%+0.27%
120d5d450.0%75.0%3+0.52%+0.47%
120d20d450.0%75.0%2-5.21%-5.24%
Bitcoin · BTC-USD · 53 walk-forward anchors · 2014-09-17…2026-08-12
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d530.0040369.8%66.0%0.39181.00001.000035+0.56%+0.43%
20d5d53-0.0022656.6%50.9%0.57201.00001.000036-0.11%-0.24%
20d20d53-0.0135152.8%50.9%0.88511.00001.000030-0.97%-1.09%
60d1d320.0073059.4%65.6%0.37401.00001.000021-0.00%-0.13%
60d5d32-0.0338753.1%65.6%0.88191.00001.000021-0.87%-1.00%
60d20d32-0.0112556.2%59.4%0.71581.00001.000024+1.70%+1.55%
SPDR S&P 500 ETF · SPY · 118 walk-forward anchors · 1993-01-29…2026-08-12
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d118-0.0061753.4%52.5%0.70881.00001.000071-0.01%-0.03%
20d5d118-0.0134349.2%53.4%0.90951.00001.000084-0.10%-0.13%
20d20d1180.0025966.1%66.1%0.34661.00001.0000102+0.95%+0.92%
60d1d98-0.0109552.0%52.0%0.72641.00001.000065-0.02%-0.04%
60d5d98-0.0120349.0%52.0%0.81991.00001.000073-0.07%-0.10%
60d20d98-0.0215260.2%63.3%0.97681.00001.000080+0.45%+0.42%
120d1d1844.4%66.7%15-0.08%-0.12%
120d5d1850.0%50.0%13+0.01%-0.01%
120d20d1861.1%61.1%16+0.19%+0.15%
Invesco QQQ ETF · QQQ · 94 walk-forward anchors · 1999-03-10…2026-08-12
PatternForwardN OOSBrier skillAcc shapeAcc matchedRaw pBH qHolm pPassTradesNet/anchorNet 2× cost
20d1d94-0.0014958.5%54.3%0.55341.00001.000058+0.05%+0.03%
20d5d940.0027056.4%46.8%0.38281.00001.000059+0.19%+0.17%
20d20d94-0.0024555.3%57.4%0.60591.00001.000060+0.45%+0.43%
60d1d73-0.0014057.5%60.3%0.53431.00001.000053+0.24%+0.21%
60d5d73-0.0416847.9%54.8%0.98991.00001.000057-0.28%-0.32%
60d20d73-0.0311754.8%63.0%0.98901.00001.000061+0.64%+0.61%
120d1d850.0%37.5%6+0.52%+0.49%
120d5d862.5%50.0%8-0.00%-0.04%
120d20d875.0%75.0%7+2.89%+2.86%