Probably raises $9M to build a more reliable kind of AI | TechCrunch
Probably raised $9 million to build an AI system that catches hallucinations and factual errors before they reach users. Their data-science tool wraps LLM outputs in a deterministic validator “mech suit,” letting it run smaller models locally while ensuring each answer matches the source data.
- Probably raised $9M from a16z to build a validator system that blocks LLM outputs unless they match source data exactly, aiming for 99.99% accuracy.
- This validation approach lets them use models "four classes weaker" than frontier LLMs, cheap enough to run on a desktop instead of a GPU farm.
- Elias argues big AI labs won't build this themselves because their revenue model benefits from users paying per interaction, including ones spent correcting errors.
Probably just pulled in $9 million from Andreessen Horowitz to tackle one of AI’s hardest problems: hallucinations and factual slip-ups in large language models. Founder Peter Elias aims for that 99.99% accuracy you see in rule-based systems, but with the flexibility of AI. To hit that mark, Probably built what Elias calls a “data science mech suit”—an elaborate harness where every model output gets compared against a deterministic validator tied directly to the source data. If the answer doesn’t perfectly match, it never reaches the user.
Their first product sits on top of complex datasets, delivering quick summaries complete with citations and a full audit trail. Behind the scenes, the LLM generates an initial answer, then the validator either approves it or sends it back. Over time, the model learns from those checks, cutting down on ambiguity. That engineering trade-off means they can run on a much smaller model—Elias says it’s “four classes weaker than the frontier models.” You could spin it up on your desktop instead of a GPU farm, slashing token bills.
Probably isn’t stopping at data science. Elias thinks the same setup will work for any task where precision matters: accounting, medical records, compliance. He points out that big AI labs haven’t bothered, since their business model depends on users correcting errors—and paying for each interaction. With token costs climbing and AI budgets under pressure, a system that avoids mistakes and shrinks your compute bill could land well.