Updated Jul 11, 2025

Our Verdict

Claude Sonnet 4Winner

Mistral Devstral MediumRunner-up

Pick Claude Sonnet 4. In 16 blind votes, Claude Sonnet 4 wins 73% of the time. That's not luck.

Claude Sonnet 4 particularly excels in Image Generation, Web Design. Mistral Devstral Medium is 7.5x cheaper per token — worth considering if cost matters.

Clear winner

Writing DNA

Style Comparison

Similarity

92%

Claude Sonnet 4 uses 87.9x more emoji

Mistral Devstral Medium

Claude Sonnet 4

50%Vocabulary62%

17wSentence Length111w

0.56Hedging0.40

4.5Bold5.0

5.3Lists9.3

0.00Emoji0.88

0.19Headings2.16

0.32Transitions0.33

Based on 21 + 17 text responses

vs

Ask them anything yourself

Mistral Devstral Medium

Claude Sonnet 4

279 AI models invented the same fake scientist.

We read every word. 250 models. 2.14 million words. This is what we found.

AI Hallucination Index 2026

Free preview13 of 58 slides

Download the free preview or get all 58 slides for $49

FAQ

Common questions

Keep going

Mistral Devstral Medium vs MiniMax M2.5New provider

Mistral Devstral Medium vs Aurora AlphaNew provider

Mistral Devstral Medium vs GPT-5New provider

Mistral Devstral MediumvsClaude Sonnet 4

34 fights queued

Why Mistral Devstral Medium?

7.5x cheaper overall$0.40/M in · $2.00/M out

2 months newerJul 2025

Why Claude Sonnet 4?

Leads 1 of 1 benchmarks

Stronger on SWE-bench Verified72.7% vs 61.6%

Mistral Devstral MediumClaude Sonnet 4

Input price

$0.40/M

$3.00/M

Output price

$2.00/M

$15.00/M

Context

—

200K

Released

Jul 2025

May 2025

Benchmarks1 common

SWE-bench Verified

61.6%

72.7%+15.3%

Favorites

Mistral Devstral MediumClaude Sonnet 4

Movie

The Shawshank Redemption

The Shawshank Redemption

2001: A Space Odyssey

2001: A Space Odyssey

Album

Kind of Blue

Kind of Blue

Book

The Name of the Wind

The Name of the Wind

Patrick Rothfuss

Gödel, Escher, Bach

Gödel, Escher, Bach

Douglas R. Hofstadter

City

Tokyo

Istanbul

Game

The Legend of Zelda: Breath of the Wild

The Legend of Zelda: Breath of the Wild

Adventure, Action4.5

Portal 2

Portal 2

Shooter, Puzzle4.6

12 / 34

01

Logic Puzzlereasoning

Tests an AI's ability to solve a simple but potentially confusing logic puzzle

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

2 / 34

02

Math Misconception Testreasoning

Tests an AI's understanding of number representation

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

3 / 34

03

Stochastic Consistency Testanalysis

Tests an AI's randomness and creativity

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

4 / 34

04

SVG Layout Challengeimage generation

Tests an AI's ability to generate vector graphics

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

5 / 34

05

Xbox Controller SVG Artimage generation

Tests an AI's ability to create detailed SVG illustrations of gaming hardware

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

6 / 34

06

Generate a Stand-Up Routineconversation

Tests an AI's humor and creative writing ability

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Ladies and Gentlemen, I'm thrilled to be here tonight. I've been doing some thinking about the differences between men and women. Now, I know what you're thinking, "Oh great, another comedian talking about how men and women are different." But hear me out, because I've got a fresh perspective on this.

You know, men and women, we're like two different species. We're like cats and dogs, but with less fur and more clothes. And I'm not talking about the obvious differences, like how men can't find anything in the fridge, and women can't find anything in the garage. I'm talking about the subtle differences, the ones that really make us unique.

Take communication, for example. Men, we're simple creatures. We communicate in grunts and nods. We're like cavemen, but with better grooming habits. Women, on the other hand, they're like a symphony orchestra. They've got a whole range of notes and tones and rhythms. They can say more with a single raised eyebrow than a man can say with a whole paragraph.

And then there's the way we handle stress. Men, we're like a pressure cooker. We bottle it all up, and then one day, we just explode. We're like a volcano, but with less lava and more swearing. Women, they're like a slow drip. They let it out a little at a time, until eventually, they're just a puddle of stress on the floor.

And let's not forget about the way we handle emotions. Men, we're like a light switch. We're either on or off. We're either happy or sad, angry or calm. Women, they're like a dimmer switch. They've got a whole range of emotions, and they can adjust them at will. They can be a little sad, a little happy, a little angry, all at the same time.

And finally, there's the way we handle relationships. Men, we're like a GPS. We need clear directions, we need to know where we're going, and we need to know how to get there. Women, they're like a map. They can see the big picture, they can see all the different routes, and they can choose the one that's best for them.

So, ladies and gentlemen, that's my take on the differences between men and women. We're like two different species, but we're also like two sides of the same coin. We're different, but we're also the same. And that's what makes us so special. Thank you, and goodnight!

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

Sponsored

7 / 34

07

Pokémon Battle UI Recreationweb design

Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

8 / 34

08

Three.js 3D Gameweb design

Create a 3D building and driving game in a single self-contained HTML file using Three.js. Tests an AI's ability to combine 3D graphics, game logic, and UI interactions on the web.

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025html

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025html

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

9 / 34

09

Mario Level UI Recreationweb design

Recreate an interactive, classic Mario level in a single HTML file.

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025website

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025website

Try this prompt

Vote

10 / 34

10

Linear App Cloneweb design

Tests an AI's ability to replicate an existing UI with Tailwind CSS

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

11 / 34

11

Interactive Catan Boardweb design

Tests an AI's ability to create interactive web elements

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

12 / 34

12

World Map SVGimage generation

Tests an AI's ability to create a detailed world map in SVG format

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Claude Sonnet 4

Claude Sonnet 4

Anthropic · May 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

This matchup has more rounds

22+ more head-to-head results. Free. Not a trick.

Free account. No card required. By continuing, you agree to Rival's Terms and Privacy Policy