Claude Haiku 4.5
No content available for this output.
Claude Haiku 4.5 vs Mistral Devstral Medium
Compare Claude Haiku 4.5 by Anthropic against Mistral Devstral Medium by Mistral AI, tested across 45 shared challenges. Updated February 2026.
FAQ
Loading share button...
Claude Haiku 4.5vsMistral Devstral Medium
40 challenges
Why Claude Haiku 4.5?
Leads 1 of 1 benchmarks
Stronger on SWE-bench Verified73.3% vs 61.6%
3 months newerOct 2025
Why Mistral Devstral Medium?
2.5x cheaper overall$0.40/M in · $2.00/M out
Favorites
Claude Haiku 4.5Mistral Devstral Medium
12 / 40
Estimate Complexityreasoning
Tests an AI's ability to make educated estimates based on technical knowledge
Mistral Devstral Medium
No content available for this output.
Vote
2 / 40
Logic Puzzlereasoning
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
Claude Haiku 4.5
No content available for this output.
Mistral Devstral Medium
No content available for this output.
Vote
3 / 40
Math Misconception Testreasoning
Tests an AI's understanding of number representation
Claude Haiku 4.5
No content available for this output.
Mistral Devstral Medium
No content available for this output.
Vote
4 / 40
Stochastic Consistency Testanalysis
Tests an AI's randomness and creativity
Claude Haiku 4.5
No content available for this output.
Mistral Devstral Medium
No content available for this output.
Vote
5 / 40
SVG Layout Challengeimage generation
Tests an AI's ability to generate vector graphics
Claude Haiku 4.5
No content available for this output.
Mistral Devstral Medium
No content available for this output.
Vote
6 / 40
Xbox Controller SVG Artimage generation
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Claude Haiku 4.5
No content available for this output.
Mistral Devstral Medium
No content available for this output.
Vote
7 / 40
Realistic AI Interviewconversation
Tests an AI's ability to simulate personalities and predict future trends
Claude Haiku 4.5
No content available for this output.
Mistral Devstral Medium
No content available for this output.
Vote
8 / 40
Satirical Fake News Headlineconversation
Tests an AI's humor and understanding of current events
Claude Haiku 4.5
No content available for this output.
Mistral Devstral Medium
No content available for this output.
Vote
9 / 40
Character Voice Testconversation
Tests an AI's ability to write in distinct character voices
Claude Haiku 4.5
No content available for this output.
Mistral Devstral Medium
No content available for this output.
Vote
10 / 40
Minimalist Landing Pageweb design
Tests an AI's ability to generate a complete, working landing page
Claude Haiku 4.5
Mistral Devstral Medium
Vote
11 / 40
Pokémon Battle UI Recreationweb design
Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.
Claude Haiku 4.5
No content available for this output.
Mistral Devstral Medium
No content available for this output.
Vote
12 / 40
Mario Level UI Recreationweb design
Recreate an interactive, classic Mario level in a single HTML file.
Claude Haiku 4.5
Mistral Devstral Medium
Vote
12 of 40