Methodology

The honest scorecard

Public quant content almost exclusively sells winners. qbuntu records the whole spectrum — live, promising, marginal, rejected — with the same evidence regardless of outcome. The unspoken truth the category needs: passing a backtest and printing money in production are not the same thing. A liveentry doesn't get a victory lap; it carries the same metrics, methodology, and production caveats as a rejected one explains its failure.

Why we report the median, not the best run

A strategy is rarely one backtest — it's a grid of hundreds of parameter combinations. Reporting the bestof that grid is cherry-picking: it's the number that looks great and reproduces worst. qbuntu's headline figure is the median across the full grid — the result you should actually expect. The best-case is still recorded, but explicitly labeled as a non-representative ceiling.

How a verdict is assigned

The verdict follows the same rule as the headline: it's decided on the median parameter set, not the best one, and it weighs more than raw return. To reach promising, the typical parameterization has to clear two bars at once — a return bar (median Sharpe) and statistical significance (a low p-value on that median run, not on a cherry-picked corner of the grid). A strategy whose edge is real only for its best parameters is marginal, not promising. rejectedis for a median that shows no edge, or one that doesn't hold up across market regimes — and that is where most strategies land.

In practice this bites. Run across the full Tokyo Stock Exchange listed universe (~3,747 stocks, no turnover filter), not one of the standard factor strategies reached promisingon its median parameterization. The best parameters were highly significant — but publishing those is exactly the cherry-pick a winners-only site would make. The honest answer is “marginal,” and saying so is the product.

Anatomy of a record

• verdict — live / promising / marginal / rejected, with a taxonomy-coded rejection reason.
• performance_summary — the median headline (Sharpe), drawdown, alpha, p-value. Units are baked into the field names (max_drawdown_pct, alpha_annualized_pct) so a number is never ambiguous. A value we can't unit-label is null, never a guess.
• grid_summary — the distribution: n_combinations, median / best / worst / p25 / p75.
• methodology — costs, slippage, position sizing, regime definition, signal, rebalance, benchmark.
• provenance — data source and computed_asof, so every number has an origin.
• facts[] — atomic, individually citable claims. Each has a permanent /cite/<fact-id> URL, a unit, and the context in which it's true.

The machine-readable contract: /v1/schema (JSON). Every strategy also has a Markdown mirror at /ai/strategies/<slug>.md and JSON at /v1/strategies/<slug>.

Contributing your own results

You don't hand-author this JSON. You bring your idea or backtest in whatever form you have it, and qbuntu's AI normalizes it into the canonical schema above — so every record is comparable and held to the same honesty rules. The format isn't a form to fill out; it's the shape everything converges to.

When a submission reproduces a strategy already on qbuntu, it isn't filed as a duplicate — it's cross-linked as a reproduction that either corroborates or contradicts the existing verdict. Independent replication makes a result stronger, not noisier. Community-contributed records carry their own provenance and are always distinguishable from qbuntu-verified ones.