Thesis · why inference needs a tape

In finance,
the tape led to
real-time price discovery.

LLM inference trades today the way fixed income traded 25 years ago. Back then, bonds were traded mostly over the phone and there wasn't a clear picture of what was traded and at what prices. In 2002, FINRA (NASD at the time) decided to introduce TRACE, which is the automated system that acts as the regulatory tape for the OTC fixed income market. After the introduction, trade execution costs fell by about 50% for corporate bonds, see Bessembinder, Maxwell & Venkataraman (2006), Market Transparency, Liquidity Externalities, and Institutional Trading Costs in Corporate Bonds. Nowadays, the LLM inference market seems to trade like corporate bonds traded before TRACE. That is why we believe the tape is an essential tool for the inference markets.

Thesis

Why us

One model can be offered at more than 15 venues, each venue with its own offerings and prices. That's how a commodity market looks like. So one way to work out this problem is to reason about it the way people do in the financial markets. The LLM inference market is quickly becoming a market similar to corporate bonds and we want to be at the forefront of how it trades. See the live price table →

Corporate bondsInference
The instrument, what you are buying
Issuer, the companyThe model and its weights
The issue, one specific CUSIPThe exact served configuration you buy from one host
No bond equivalent, a commodity grade, like sulfur in crude or protein in wheatQuantization (fp16 / fp8 / int4), the same artifact at a measurably different spec, not a discount
Block size, how much clears at onceContext window
Settlement convention (T+1 vs T+2)Service tier, real-time vs batch, contracted up front
The market, who quotes, and how you buy
Dealer / market makerThe inference provider, quotes continuously, holds inventory, earns a spread
Dealer inventoryGPU capacity
Asking several dealers for a price (RFQ)What a router does, every request
On-the-run vs off-the-runNewest model vs last generation, same curve, ~60× faster
The fill, what you actually got, and only measurement shows it
Default riskError rate, the fill that never arrives
Time to fill, slippageRealized time to first token, and its variance
Ratings agenciesModel evals, they grade the issuer, never the fill
TRACE, the post-trade tapeWhat we're building: a tape for inference