Strong trend
Persistent directional move with high trend strength. Chaos amplifies conviction and sizes up within the vol budget.
- Policy
- Amplify momentum (gain ×1.4)
- Share of days
- 21.4%
- Avg exposure
- 0.54
- Chaos Sharpe
- 2.60
P1-Chaos is a specialised machine learning engine for classification on structured tabular data. It combines iterative feedback architecture, spectral feature extraction, and calibrated ensemble methods to produce probabilistic predictions at the precision that operational decisions require.
Best Uno IPCW-C on scikit-survival’s canonical set
BTC-USD walk-forward 2015–2025, net of 10 bps — 0.28 max drawdown vs 0.89 buy-and-hold.
vs 0.82 buy-and-hold on the same asset and window — ~22% annualised vol vs ~67%.
Best Uno C-index on GBSG2 (0.681) — canonical scikit-survival set; published DeepHit: 0.675.
A sharper prediction is not a better decision if the band that carries it lies — promising 80% and delivering 46%. The problem is not beating every leaderboard. It is shipping uncertainty you can size a position, a schedule, or a commitment against.
Most models end at a point prediction and treat every regime, every asset, and every confidence level as if the error structure were stable. It is not. Chaos rebuilds the decision on three layers — conformal guarantees that mean what they say, a causal regime engine that sets the risk budget to match conditions, and calibrated duration intervals that stay honest as markets drift. Where a raw forecast leaves you guessing, Chaos begins
Split-conformal and adaptive (ACI) layers. Worst native under-coverage across 28 cells: −34%; wrapped: −3.6%. Cross-checked against MAPIE on UCI.
Four causal regimes set conviction and risk budget. BTC walk-forward drawdown 0.27 vs 0.89 buy & hold comes from here.
Persistence as a calibrated survival problem. 80% nominal intervals near 80% empirical coverage — planning, not a silent position gate.
Bitcoin’s calendar-year lows, aged from the 2009-01-03 genesis and fit as P ≈ C · t^β. Same valuation anchor the Chaos-Crypto power-law overlay uses — a floor that has risen with network age, not a price oracle. Overlay remains OFF by default; see the robustness report.
Chaos labels every bar into one of four causal market regimes and sets conviction and vol budget to match. On BTC the edge is regime-conditioned risk control — not duration timing and not a direction oracle.
Persistent directional move with high trend strength. Chaos amplifies conviction and sizes up within the vol budget.
Constructive, orderly tape. Standard momentum conviction with a measured, vol-targeted position.
Choppy, range-bound conditions where momentum fails. Exposure stays small; production policy fades short-term moves.
Stress and elevated volatility. Conviction pulls toward flat — capital protection first.
Pre-registered variants on the same causal walk-forward — production, naked control, return-oriented regime tweaks, and the frozen trend-gated power-law overlay. No parameter sweep.
| Variant | Net Sharpe | Total return | Ann. return | Max DD | Avg |pos| | Δ vs prod. |
|---|---|---|---|---|---|---|
Production book Vol-targeted regime-conditioned position — the committed marketing harness. | 1.306 | 15.0× | 30% | 0.266 | 0.212 | — |
Same alpha, no regime layer Fixed risk_on label, vol target off, trend filter off — Panel B naked control. | 0.982 | 9.0× | 23% | 0.281 | 0.255 | -0.324 |
Strong-trend vol budget 70% Pre-registered: 50% ann. vol budget everywhere except 70% in strong_trend. | 1.251 | 21.4× | 34% | 0.324 | 0.242 | -0.055 |
Mean-revert flat (no fade) Pre-registered: mean_revert gain 0 instead of −0.6 — stop fighting chop. | 1.366 | 16.9× | 31% | 0.242 | 0.201 | +0.060 |
Risk-off floor in uptrend Pre-registered: min 10% long exposure in risk_off when 200d trend_filter > 0.3 — participate in bulls mis-labeled as stress. | 1.278 | 14.2× | 29% | 0.262 | 0.217 | -0.028 |
Production + trend-gated power-law (full history) Frozen BTC overlay: λ=0.3, scale=1.5, trend gate <0.3. Full 2015–2025 window — not comparable to crypto_powerlaw.md Sharpe (that harness starts at 40% burn-in). Full 2015–2025 window; overlay hurts early-era return vs production — see powerlaw_gated_oos for the committed powerlaw harness window. (2015-07-20 → 2025-12-29) | 1.150 | 5.7× | 18% | 0.222 | 0.174 | -0.156 |
Power-law overlay (powerlaw OOS window) Same frozen overlay; walk-forward from max(40% history, 260 bars) — matches synthetic_paths / crypto_powerlaw.md protocol. OOS window matches crypto_powerlaw.md (40% burn-in, min 260 bars). (2019-05-26 → 2025-12-29) | 0.947 | 2.3× | 14% | 0.167 | 0.180 | -0.359 |
The BTC walk-forward book is sized by regime only. Regime-duration forecasts are a separate calibrated-interval product (see Duration); they do not gate crypto positions.
A separate survival layer for interval honesty on multi-asset panels — not used to size the BTC trading book.
Duration beats a memoryless null on several series and keeps ACI intervals near 80% nominal — but gating BTC positions on duration does not beat a shuffled control (see regime_duration_crypto_value.md). Stated plainly: calibration for planning, not crypto Sharpe.
~8 more days in regime
Primary crypto series — planning interval only, not a position gate.
~15 more days in regime
~7 more days in regime
~10 more days in regime
~11 more days in regime
The production regime engine — causal, 252-day lookback, no look-ahead — labels every week of real price history into one of four regimes. The bands below are what it saw at the time, not a fit after the fact: the 2018 and 2022 crypto winters, the 2008 financial crisis and the 2020 COVID crash all read risk-off; the late-2024 melt-up reads strong-trend.
Detection generalizes to any series — shown here on crypto, an equity index, and gold. The trading edge is validated on crypto-class assets only; labeling SPY is a detection demonstration, not a claim the signal trades equities profitably.
get_regime_labels (Mason + ADX + Hurst/Kalman/HMM fusion), weekly-dominant regime; display spans under 3 weeks absorbed for legibility. — Source: p1-chaos benchmarks/regime_timeline.py → reports/regime_timeline.json
Most models end at a point prediction and treat every regime, every asset, and every confidence level as if the error structure were stable. It is not. Chaos rebuilds the decision on three layers — conformal guarantees that mean what they say, a causal regime engine that sets the risk budget to match conditions, and calibrated duration intervals that stay honest as markets drift. Where a raw forecast leaves you guessing, Chaos begins
Chaos is optimised for calibrated probabilities and risk-adjusted control. On recognized public benchmarks its genuine, externally-verified edges are (1) survival / time-to-event on canonical medical datasets and (2) crypto risk-adjusted economics. On general tabular classification and univariate forecasting it is competitive but does not beat tuned standard baselines (CatBoost, seasonal methods) — stated plainly.
Uno IPCW C-index, ≥ the published deep-survival SOTA on the standard GBSG2 dataset
lower integrated Brier than the published reference range (0.170–0.184)
Friedman rank 1.8 of 6; ~3× lower drawdown at 1/3 the volatility
split-conformal + ACI 80% intervals on the real financial panel
| Arena | Chaos | Best competitor | Verdict |
|---|---|---|---|
Survival (canonical public datasets) Uno IPCW C-index ↑ / integrated Brier ↓ | Chaos-Survival GBSG2 C-index 0.681 · IBS 0.165 | CoxPH / RSF / GBSA / DeepHit Cox 0.660 · RSF 0.680 · DeepHit (pub) 0.675 | leads |
On scikit-survival's canonical GBSG2 (the standard survival benchmark), Chaos-Survival has the best Uno C-index and a lower integrated Brier than the published deep-survival reference range — a genuine external win. Competitive (close 2nd) on WHAS500 (0.773) and Veterans (0.680). This is the real calibration story. | |||
Crypto Net Sharpe after 10bps costs (higher = better) | Chaos-Crypto 0.65 | Buy & Hold 0.36 | leads |
Best risk-adjusted return and ~3–4× lower drawdown. Beats EWMA-Momentum, HAR-RV and a flat book (Holm p<0.05). Honest: nobody has a daily-direction edge (AUC ≈ 0.51) — the edge is risk control, not calling price. | |||
Forecasting (M4, official OWA) OWA (lower = better) | Chaos-RegimeBlend / Chaos-Global M4-Hourly OWA 0.46 (blend); M4-Daily 0.91 (global, best) | Seasonal methods / AutoTheta varies by frequency | competitive |
Beats the statistical baselines on several M4 frequencies and the global model wins M4-Daily, but no uniform win — a seasonal-naive baseline is best on Hourly. Differentiator is calibrated intervals, not point accuracy. | |||
Tabular classification (OpenML-CC18) ROC-AUC ↑ / log-loss / Brier / ECE ↓ | Chaos-Stacked AUC 0.846 · Brier 0.116 · ECE 0.056 | CatBoost AUC 0.856 · Brier 0.111 · ECE 0.052 | trails |
On the canonical OpenML-CC18 suite, CatBoost leads on every metric including calibration (ECE/Brier). Chaos's calibration edge on our internal arena did NOT generalize here — shown honestly. A follow-up landscape run that adds the open foundation model TabPFN v2 found TabPFN now tops both CatBoost and Chaos on accuracy AND calibration (see chaos-landscape.json). Recommended use: wrap the best base model — CatBoost or TabPFN — with the Chaos conformal + regime layer rather than replace it. | |||
Numbers are reproduced from clean runs on canonical open-source datasets. Where Chaos trails a standard baseline, it is shown as 'competitive' or 'trails', never inflated. Source: p1-chaos benchmarks + canonical open-source evals (scikit-survival datasets, OpenML-CC18, M4).
Each promise on this page is measured as a delta over the unwrapped practice a practitioner would actually use — at the same 80% nominal the copy quotes. Every number regenerates from a committed harness (p1-chaos benchmarks/wrapper_value.py); wins and losses land as they fall.
28 model × dataset cells (CatBoost, LightGBM, RandomForest, linear × 7 public datasets). A practitioner's ±1.28σ band on a flexible regressor promises 80% and delivers as little as 46%; the wrapper holds every model on every dataset within ~4 points of the promise. Over-coverage — common for accurate classifiers — is merely conservative; under-coverage is the failure a decision pays for.
→ #prediction-vs-realityThe identical momentum signal, naked vs wrapped in the regime risk layer, on its validated domain (BTC, ETH, SOL, oil), net of costs. ETH max drawdown 0.31 → 0.23; oil 0.35 → 0.27. Honest cell: SOL's Sharpe was lower wrapped (0.66 → 0.55) — printed, not dropped. Crypto-class assets only; not evidence for calm tradfi markets.
→ #regimesRegime-duration intervals, walk-forward on six real financial series. A static conformal radius quietly breaks as market character drifts; the online adaptive intervals keep the stated coverage honest at ~20-bar widths. This is why duration ships as an interval that means what it says — never a point guess about when regimes end.
→ #regime-durationThe wrapper's calibration cost (20% of training data) is charged in every Panel A cell, not hidden. Panel B is an ablation of our own signal, not an external comparison. Full tables, including the cells we lose, live in the committed report.
Source: p1-chaos benchmarks/wrapper_value.py → reports/wrapper_value.md