Mistral's new agent proofs your code on the cheap • The Register

Mistral, the French AI company, has launched Leanstral, a new coding agent that promises to revolutionize how developers verify and test their code. The agent leverages formal verification techniques using the open-source Lean programming language to catch errors that traditional AI code generation might miss.

The Problem with AI Code Generation

As AI coding assistants become increasingly popular, developers are discovering a fundamental limitation: while these tools can generate code quickly, they often produce subtle bugs or logical errors that humans might miss. This is where formal verification comes in - a mathematical approach to proving that code behaves exactly as intended.

Mistral argues that this verification process can significantly reduce the need for human code review, which traditionally represents a substantial portion of software development costs and timelines.

How Leanstral Works

Leanstral operates as an agent mode within Mistral's Vibe platform and is available via a free API endpoint. The system uses Lean, a functional programming language and theorem prover, to construct mathematical proofs about code correctness.

What makes this approach particularly powerful is that it combines traditional testing with formal proofs. While tests check specific scenarios, formal proofs attempt to verify that code works correctly for all possible inputs - a much stronger guarantee.

Performance That Outpaces the Competition

According to Mistral's internal benchmarks using a new evaluation framework called FLTEval, Leanstral-120B-A6B outperforms larger open-source rivals. The agent scored higher than models like GLM5-744B-A40B, Kimi-K2.5-1T-32B, and Qwen3.5-397B-A17B despite having fewer parameters.

But the real story isn't just about performance - it's about cost-effectiveness. Here's where Leanstral truly shines:

• At pass@2 (two verification passes), Leanstral scores 26.3, beating Claude Sonnet by 2.6 points
• Cost: $36 for Leanstral vs $549 for Claude Sonnet
• At pass@16, Leanstral reaches 31.9, comfortably beating Sonnet by 8 points
• Cost: $290 for Leanstral vs $549 for Claude Sonnet

Even when compared to Anthropic's premium Claude Opus 4.6, which scores higher at 39.6, Leanstral offers dramatic savings. Opus costs $1,650 for 16 passes compared to Leanstral's $290.

Real-World Validation

To demonstrate Leanstral's capabilities, Mistral tested it on an actual question from the Proof Assistant Stack Exchange about a bug in Lean 4 code. The agent successfully built test code to reproduce the failure, identified the flaw, and provided a correct fix - showcasing its practical utility beyond theoretical benchmarks.

The All-in-One Alternative

Alongside Leanstral, Mistral also released Mistral Small 4, designed as a versatile model that can handle reasoning, coding, and chat tasks without requiring developers to switch between specialized models. This unified approach could further streamline development workflows.

The Future of AI-Assisted Development

Leanstral represents a significant step toward more reliable AI-generated code. By incorporating formal verification directly into the development process, it addresses one of the biggest concerns about AI coding assistants: their tendency to produce code that looks correct but contains subtle logical errors.

For development teams, this could mean faster iteration cycles, reduced debugging time, and ultimately more robust software. The dramatic cost savings also make advanced verification accessible to smaller teams and individual developers who might have previously found such tools prohibitively expensive.

The release of Leanstral suggests that the future of AI-assisted development isn't just about generating more code faster - it's about generating better code more reliably. As these tools mature, we may see a shift from AI as a code generator to AI as a code guardian, actively working to ensure the correctness and reliability of software systems.

For developers interested in trying Leanstral, it's available as an agent mode within Mistral Vibe and through a free API endpoint, making it accessible for experimentation and integration into existing workflows.