📊 Full opportunity report: Week Three — Foundation model vs Brownian motion. Kronos on five-minute BTC. on ThorstenMeyerAI.com — validation score, market gap, and execution plan.

TL;DR

A recent test comparing Kronos, a foundation model, against the traditional Brownian motion baseline for 5-minute Bitcoin predictions found no statistically significant advantage. The results question the efficacy of modern AI models in short-term trading signals.

Recent testing shows that Kronos, an open-source foundation model trained on global crypto market data, does not outperform the traditional Brownian motion model in predicting 5-minute BTC price movements. This challenges assumptions about AI’s immediate advantage in short-term trading predictions and impacts ongoing debates about AI-driven trading strategies.

The test was conducted by Thorsten Meyer, who compared Kronos-small, a 24.7 million parameter model, against a geometric Brownian motion baseline across 497 BTC trades recorded over two weeks. The evaluation focused on predictive accuracy, measured through Brier scores, log-loss, and hypothetical profit and loss (P&L). Results showed that Kronos’s predictive performance was statistically indistinguishable from Brownian motion, with a negligible difference of 0.0011 in Brier score on out-of-sample data. This indicates that, at the 5-minute horizon, the advanced foundation model does not provide a meaningful edge over the traditional model.

Thorsten Meyer emphasized that while Kronos is a credible research model trained on extensive market data, it is not designed as a trading system. The tests involved reconstructing market conditions from historical candle data, running the model on these contexts, and simulating trades based on the model’s predicted probabilities. The results suggest that, at least in this specific short-term horizon, AI-based models like Kronos do not outperform simpler statistical models.

Polybot Week 3 — Kronos vs Brownian — Thorsten Meyer AI
KRONOS
● RESEARCH SERIES / MAY 2026
THORSTEN MEYER AI · POLYBOT · WEEK 3
POLYBOT · WEEK 3
KRONOS vs BROWNIAN
Research Series · Foundation Model vs Classical Baseline · 2026-05-17

Foundation model
vs Brownian motion.
Kronos on five-minute BTC.

A modern learned model just lost to math from 1900. On 497 paired trades. Stage 2 is not happening.
Polybot’s fair-value strategy uses a 1900s geometric Brownian model to price 5-minute BTC outcomes. The natural follow-up after two weeks of negative parametric results: would a modern learned model trained on millions of real candles do better? The credible candidate: Kronos — open-source MIT-licensed foundation model, 25,000+ GitHub stars, AAAI 2026, four sizes from 4M to 499M parameters, trained on candles from 45 global exchanges. Test design: 497 paired (FILL→SETTLE) trades, Brownian baseline reconstructed line-for-line, Kronos-small (24.7M params) sampled with 16 forecast paths, scored on Brier + log-loss + hypothetical P&L, chronologically split for out-of-sample discipline. On 249 out-of-sample trades: Brownian 0.188 Brier vs Kronos 0.189 Brier. Gap 0.0011. Statistically indistinguishable. Stage 2 is not happening. But the paradox is more interesting than the verdict: when used as a directional signal Kronos fires 28% less often and wins 60.7% vs Brownian’s 49.1% — slightly better trader on hypothetical P&L, even while systematically over-confident in the tails (predicts 2.4% chance → actual 20.4% win; predicts 84% → actual 69.6%). The negative result is the answer. The methodology is what gets published.
This is not financial advice. Nothing in this article should be used to inform real trading decisions. The bot trades simulated money. If you build something like it and run it with real funds, the most likely outcome — by a wide margin — is that you lose those funds. That holds whether you use a Brownian model, a 100-million-parameter foundation model, or any other forecaster.
497
Paired (FILL→SETTLE) trades
all BTC · 5-min Up/Down markets
0.0011
Out-of-sample Brier-score gap
249 trades · statistically indistinguishable
Kronos log-loss vs Brownian
signature of confident wrong predictions
+$538 / +$465
Hypothetical Kronos vs Brownian P&L
the paradox · 60.7% vs 49.1% win rates
POLYBOT WEEK 3· KRONOS-SMALL · 24.7M PARAMS· BROWNIAN BASELINE· 497 PAIRED TRADES · BTC· POLYMARKET 5-MIN UP/DOWN· BRIER 0.193 / 0.211 / 0.213· LOG-LOSS 0.567 / 0.604 / 1.080· OUT-OF-SAMPLE 0.188 vs 0.189· GAP 0.0011 · INDISTINGUISHABLE· STAGE 2 NOT HAPPENING· KRONOS BETTER TRADER · WORSE FORECASTER· 60.7% vs 49.1% WIN RATE· TAILS: 2.4% → 20.4% · 84% → 69.6%· POLYBOT MIT· KRONOS MIT· AAAI 2026 PAPER · 25K+ STARS· 11 MIN MAC M-SERIES · MPS BACKEND· 1,300 LINES OF PYTHON· RESEARCH_PIPELINE.MD PUBLIC· SAME GAUNTLET · DIFFERENT MODEL· POLYBOT WEEK 3· KRONOS-SMALL · 24.7M PARAMS· BROWNIAN BASELINE· 497 PAIRED TRADES · BTC· POLYMARKET 5-MIN UP/DOWN· BRIER 0.193 / 0.211 / 0.213· LOG-LOSS 0.567 / 0.604 / 1.080· OUT-OF-SAMPLE 0.188 vs 0.189· GAP 0.0011 · INDISTINGUISHABLE· STAGE 2 NOT HAPPENING· KRONOS BETTER TRADER · WORSE FORECASTER· 60.7% vs 49.1% WIN RATE· TAILS: 2.4% → 20.4% · 84% → 69.6%· POLYBOT MIT· KRONOS MIT· AAAI 2026 PAPER · 25K+ STARS· 11 MIN MAC M-SERIES · MPS BACKEND· 1,300 LINES OF PYTHON· RESEARCH_PIPELINE.MD PUBLIC· SAME GAUNTLET · DIFFERENT MODEL·
FIG. 01 — THE TEST PIPELINE
Five steps · for every paired (FILL → SETTLE) trade in the running session
~1,300 lines of Python · 11 minutes on Mac M-series with PyTorch MPS · methodology public, specific numbers local
1
Reconstruct OHLCV context of the 60 minutes leading up to fire-time. Pull from the bot’s local Binance recording where available; fall back to Binance’s public klines API otherwise. Cache to parquet so re-runs cost nothing.
2
Recompute the Brownian baseline in Python — a line-for-line port of the bot’s own fairValuePUp(spot, openPrice, secondsLeftFrac, windowVol) formula. Matches scipy.stats.norm.cdf to three decimal places.
3
Read off the market-implied probability from the FILL price — what Polymarket’s order book thought the side was worth at the moment of fire. The market’s view as a reference point.
4
Run Kronos-small (24.7M parameters) on the OHLCV context · sample 16 forecast paths to the window’s end · count the fraction in which the underlying closes above the open price. That fraction is Kronos’s predicted p(Up).
5
Record (p_brownian, p_market, p_kronos, actual_outcome, P&L). Score on Brier + log-loss + hypothetical P&L. Sort chronologically · split into first/second half · report on both halves separately.
The discipline that matters: if a model wins on the first half but ties or loses on the second, that’s the curve-fit-in-slow-motion pattern the previous two articles named, and it doesn’t count as edge. The whole pipeline is reproducible from docs/RESEARCH_PIPELINE.md. Any future candidate model gets a sibling directory in research//, reuses the same Brownian baseline, the same trade-log loader, the same OHLCV fetcher, the same metrics, the same out-of-sample split. Same gauntlet, different model, same discipline.
FIG. 02 — FULL-SAMPLE SCORING · 497 PAIRED TRADES
Three models · two probability-scoring metrics
Brier score and log-loss · the standard scoring rules for probability forecasts · lower is better
Model
Brier ↓
Log-loss ↓
BrownianGeometric Brownian motion · the 1900s baseline
0.193
0.567
Market-impliedPolymarket order book at FILL · reference
0.211
0.604
Kronos24.7M-param foundation model · 16 sampled forecast paths
0.213
1.080
Kronos’s log-loss is roughly twice Brownian’s — the signature of a model that makes confident, wrong predictions in the tails. Polymarket’s order book sits between the two, reasonably calibrated, slightly worse than the bot’s Brownian and slightly better than the foundation model. The 100-year-old math beat the 24.7M-parameter foundation model on both probability-scoring metrics.
FIG. 03 — OUT-OF-SAMPLE VERDICT · 249-TRADE TEST HALF
Chronologically-separated · never seen by tuning
The verdict the test was designed to deliver · noise band of repeated runs with different sampling seeds
Brownian · 249-trade test half
0.188
Brier score (out-of-sample)
lower is better
Kronos · 249-trade test half
0.189
Brier score (out-of-sample)
lower is better
The gap
0.0011
Statistically indistinguishable
inside the noise band
Kronos does not beat Brownian on a held-out chronologically-separated sample. So Stage 2 is not happening.
“Stage 2” was the planned next step: wiring Kronos into Polybot as a live strategy if Stage 1 produced a clear signal. The case is not earned by this data. For 5-minute BTC at the horizons the bot trades, the open Kronos-small checkpoint does not. Stop. The next candidate model — Chronos · TimesFM · Lag-Llama · a Kronos finetune on 5-min crypto · something else — goes through the same gauntlet. Most will fail it. That is the gauntlet doing its job.
FIG. 04 — THE PARADOX · BETTER TRADER vs WORSE FORECASTER
By operational standards Kronos wins · by probabilistic standards Kronos loses
The hypothetical-P&L counterfactual replays the same data through “what if Polybot fired on each model’s probability”
Operational view · Kronos as the better trader
Kronos fires less · wins more · nets slightly more.
Hypothetical fires
201
Brownian fires (reference)
279
Win rate (Kronos)
60.7%
Win rate (Brownian)
49.1%
Hypothetical net P&L (Kronos)
+$538
Hypothetical net P&L (Brownian)
+$465
Fires ~28% less often and wins more reliably when it does. If you use Kronos as a directional signal in a broader system that does its own sizing — closer to how TradingAgents uses analyst outputs — the directional accuracy might still be useful.
Probabilistic view · Kronos as the worse forecaster
Systematically over-confident in the tails.
Kronos predicts
2.4%
Trades actually win
20.4%
Kronos predicts
84%
Trades actually win
69.6%
Log-loss vs Brownian
~2× worse
Brier (full sample)
0.213 vs 0.193
If you are building a fully-probabilistic system where the probability feeds an expected-value calculation against the market’s implied price — which is what Polybot does — calibration is everything, and Kronos’s calibration is bad enough to disqualify it. It thinks it knows more than it does at both ends.
Both interpretations are honest. Neither earns the model a place in Polybot. One of them might earn it a place, later, in TradingAgents — as a 5th analyst voice that votes on direction without being trusted for calibrated odds. That experiment is not what this week tested; it is a separate hypothesis for a separate week.
FIG. 05 — WEEK FOUR · THREE POSSIBLE THREADS
Each is a separate article · the pattern across them is the same
Honest measurement · out-of-sample discipline · no rescue narratives when something doesn’t work
1
A second-tier candidate model · Amazon’s Chronos
Same general shape as Kronos · different training corpus · also open-source. Running it through the exact same gauntlet would say whether the negative result is specific to Kronos or generalises to learned models in this regime.
Generalisation test
2
Kronos with a finetune on 5-min crypto data
The Kronos repo ships a finetuning pipeline. Taking the open Kronos-base checkpoint, finetuning on the bot’s own recorded BTC tick history, re-testing. Isolates “is the pretrained distribution wrong for crypto?” from “is the architecture wrong for this horizon?”
Architecture vs distribution
3
A live-trading update on Polybot
The fleet has been running paper trades continuously across these three weeks. A fresh aggregate-P&L view, with the same calibration-style analysis applied to live performance rather than historical replay, is overdue.
Status reset
The contract is “same gauntlet, different model, same discipline.” Specific numbers stay local. Methodology is public on the repo’s docs/RESEARCH_PIPELINE.md. Publishing reproducible parameter recipes for strategies that might be marginally profitable encourages people to copy them with real money, and the prior on real-money outcomes when copying retail strategies is “they lose.” Publishing the methodology lets the next person test their own model honestly without inheriting any of mine.
By probabilistic standards · Kronos is a worse forecaster. By operational standards · Kronos is the better trader. Both interpretations are honest. Neither earns the model a place in Polybot. One of them might earn it a place, later, in TradingAgents.
Thorsten Meyer AI · Week 3 · Foundation Model vs Brownian Motion

Implications for AI in Short-Term Crypto Trading

This finding questions the assumption that modern foundation models can reliably generate trading edges in highly short-term, high-frequency contexts. Despite the sophistication and extensive training data, Kronos did not demonstrate a statistically significant advantage over the classical Brownian motion baseline in predicting Bitcoin’s 5-minute price movements. For traders and developers, this suggests that deploying large AI models in real-time trading algorithms may not yield expected improvements at these horizons. It also underscores the importance of rigorous testing and validation before integrating AI models into trading strategies, especially in volatile markets like cryptocurrencies.

Amazon

Bitcoin 5-minute trading prediction tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background on Model Testing and Market Assumptions

Over the past two weeks, Thorsten Meyer has been running Polybot, an open-source trading simulation, testing various predictive models against Polymarket’s 5-minute Up/Down markets. The initial finding was that most models, including those based on geometric Brownian motion, failed to demonstrate consistent edges, with only one out of 21 variants showing marginal promise before collapsing under further testing. This prompted the investigation into whether a modern, learned model like Kronos could outperform traditional assumptions.

Kronos is a foundation model trained on over 45 global exchanges, with sizes ranging from 4 million to nearly 500 million parameters, and is designed for financial time series analysis. While the model is explicitly research-oriented and not a trading system, it represents a significant step toward applying deep learning to market prediction. Prior to this, the market’s behavior was often modeled using geometric Brownian motion, a 1900s mathematical assumption that treats price changes as independent, normally-distributed log-returns, which many argue is a poor fit for real markets.

“Despite the sophistication of Kronos, it did not demonstrate a meaningful edge over the traditional Brownian model in short-term BTC predictions.”

— Thorsten Meyer

Zero to Hero in Cryptocurrency Trading: Learn to trade on a centralized exchange, understand trading psychology, and implement a trading algorithm

Zero to Hero in Cryptocurrency Trading: Learn to trade on a centralized exchange, understand trading psychology, and implement a trading algorithm

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Unclear Impact of Larger or Different Models

It remains uncertain whether larger or differently trained versions of Kronos, or other advanced models, might outperform Brownian motion in similar tests or in different market conditions. The current results are specific to the small, open-source version and the 5-minute horizon tested. Additionally, real trading involves factors like latency, transaction costs, and market impact that are not captured in these simulations.

Amazon

BTC short-term trading indicators

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Future Testing and Model Development Directions

Further research will be needed to evaluate whether larger or more specialized models can deliver an edge in short-term trading. Testing in live trading environments, with real funds and accounting for transaction costs, will be essential to determine practical usefulness. Researchers may also explore longer horizons or different asset classes to assess if AI models can outperform traditional assumptions in other contexts.

The No-BS Guide to AI for Trading & Market Research: How to Use ChatGPT, Claude & AI Tools for Market Analysis, Stock Research & Data-Driven Trading ... ... Required (The No-BS AI Playbooks Book 3)

The No-BS Guide to AI for Trading & Market Research: How to Use ChatGPT, Claude & AI Tools for Market Analysis, Stock Research & Data-Driven Trading … … Required (The No-BS AI Playbooks Book 3)

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

Does this mean AI models are useless for trading?

No. This specific test shows that, at the 5-minute horizon for BTC, Kronos does not outperform a simple Brownian motion baseline. AI models may still have advantages in other contexts or longer timeframes, but their effectiveness must be validated through rigorous testing.

Why did Kronos not outperform the Brownian model?

The test results suggest that, at least in this short-term prediction task, the complex patterns learned by Kronos do not translate into better predictive accuracy than the traditional, mathematically simple Brownian motion model.

Could larger models or different training improve results?

This remains an open question. The current study used the smallest publicly available version of Kronos. Larger or differently trained models might yield different outcomes, but further testing is necessary.

What are the practical implications for traders?

Traders should be cautious about assuming that AI models automatically provide an edge in short-term trading. Rigorous validation is essential before deploying such models in live environments.

Source: ThorstenMeyerAI.com

You May Also Like

Forge or Self-Host? The Real Cost of Sovereign AI

Analyzing the financial and strategic implications of building or buying sovereign AI, highlighting recent developments and ongoing uncertainties.

Micro-agency Proposal Scope Checker

A new AI-powered scope checker for small web agencies is being tested to identify scope risks in fixed-scope proposals, aiming to improve margins.

Quantum computing CEOs hope “validating” government backing proves their technology is no longer speculative

CEOs of Infleqtion and D-Wave view recent government grants as validation of their quantum tech, signaling industry progress and increased support.

China chides US after Trump says he will talk to Taiwan’s Lai

Beijing condemns Washington following Trump’s indication of a potential call with Taiwan’s Lai, escalating tensions amid recent US-China diplomatic exchanges.