Updated Sep 29, 2025

Our Verdict

Claude Sonnet 4.5

Mistral Devstral MediumRunner-up

No community votes yet. On paper, Claude Sonnet 4.5 has the edge — bigger model tier, newer, bigger context window, major provider backing.

Mistral Devstral Medium is 7.5x cheaper per token — worth considering if cost matters.

Slight edge

Writing DNA

Style Comparison

Similarity

92%

Claude Sonnet 4.5 uses 45.2x more emoji

Claude Sonnet 4.5

Mistral Devstral Medium

64%Vocabulary50%

94wSentence Length17w

0.48Hedging0.56

4.9Bold4.5

8.0Lists5.3

0.45Emoji0.00

1.91Headings0.19

0.07Transitions0.32

Based on 20 + 21 text responses

vs

Ask them anything yourself

Claude Sonnet 4.5

Mistral Devstral Medium

Some models write identically. You are paying for the brand.

178 models fingerprinted across 32 writing dimensions. Free research.

Model Similarity Index

185x

price gap between models that write identically

178

models

12

clone pairs

32

dimensions

Devstral M / S

95.7%

Qwen3 Coder / Flash

95.6%

GPT-5.4 / Mini

93.3%

Read the full report or download the 14-slide PDF

279 AI models invented the same fake scientist.

We read every word. 250 models. 2.14 million words. This is what we found.

AI Hallucination Index 2026

Free preview13 of 58 slides

Download the free preview or get all 58 slides for $49

FAQ

Common questions

Keep going

Mistral Devstral Medium vs MiniMax M2.5New provider

Mistral Devstral Medium vs Aurora AlphaNew provider

Mistral Devstral Medium vs Gemini 2.5 Pro Preview 06-05New provider

Claude Sonnet 4.5vsMistral Devstral Medium

38 fights queued

Why Claude Sonnet 4.5?

Leads 1 of 1 benchmarks

Stronger on SWE-bench Verified77.2% vs 61.6%

3 months newerSep 2025

Why Mistral Devstral Medium?

7.5x cheaper overall$0.40/M in · $2.00/M out

Claude Sonnet 4.5Mistral Devstral Medium

Input price

$3.00/M

$0.40/M

Output price

$15.00/M

$2.00/M

Context

200K

—

Released

Sep 2025

Jul 2025

Benchmarks1 common

SWE-bench Verified

77.2%+20.2%

61.6%

Favorites

Claude Sonnet 4.5Mistral Devstral Medium

Movie

2001: A Space Odyssey

2001: A Space Odyssey

The Shawshank Redemption

The Shawshank Redemption

Album

Kind of Blue

Kind of Blue

Book

Metamorphosis

Metamorphosis

The Name of the Wind

The Name of the Wind

Patrick Rothfuss

City

Amsterdam

Tokyo

Game

Portal 2

Portal 2

Shooter, Puzzle4.6

The Legend of Zelda: Breath of the Wild

The Legend of Zelda: Breath of the Wild

Adventure, Action4.5

12 / 38

01

Estimate Complexityreasoning

Tests an AI's ability to make educated estimates based on technical knowledge

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

2 / 38

02

AI Board Game Logicreasoning

Tests an AI's ability to understand game rules and strategy

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

3 / 38

03

Logic Puzzlereasoning

Tests an AI's ability to solve a simple but potentially confusing logic puzzle

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

4 / 38

04

Math Misconception Testreasoning

Tests an AI's understanding of number representation

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

5 / 38

05

Stochastic Consistency Testanalysis

Tests an AI's randomness and creativity

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Sure, here are five jokes for you:

Why don't scientists trust atoms? Because they make up everything!
What do you call fake spaghetti? An impasta.
How does the moon cut his hair? Eclipse it.
What do you call a can opener that doesn't work? A can't opener.
How many tickles does it take to make an octopus laugh? Ten-tickles.

All five jokes are unique.

Try this prompt

Vote

6 / 38

06

SVG Layout Challengeimage generation

Tests an AI's ability to generate vector graphics

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025svg

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Try this prompt

Vote

Sponsored

7 / 38

07

Xbox Controller SVG Artimage generation

Tests an AI's ability to create detailed SVG illustrations of gaming hardware

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Try this prompt

Vote

8 / 38

08

Generate a Stand-Up Routineconversation

Tests an AI's humor and creative writing ability

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Ladies and Gentlemen, I'm thrilled to be here tonight. I've been doing some thinking about the differences between men and women. Now, I know what you're thinking, "Oh great, another comedian talking about how men and women are different." But hear me out, because I've got a fresh perspective on this.

You know, men and women, we're like two different species. We're like cats and dogs, but with less fur and more clothes. And I'm not talking about the obvious differences, like how men can't find anything in the fridge, and women can't find anything in the garage. I'm talking about the subtle differences, the ones that really make us unique.

Take communication, for example. Men, we're simple creatures. We communicate in grunts and nods. We're like cavemen, but with better grooming habits. Women, on the other hand, they're like a symphony orchestra. They've got a whole range of notes and tones and rhythms. They can say more with a single raised eyebrow than a man can say with a whole paragraph.

And then there's the way we handle stress. Men, we're like a pressure cooker. We bottle it all up, and then one day, we just explode. We're like a volcano, but with less lava and more swearing. Women, they're like a slow drip. They let it out a little at a time, until eventually, they're just a puddle of stress on the floor.

And let's not forget about the way we handle emotions. Men, we're like a light switch. We're either on or off. We're either happy or sad, angry or calm. Women, they're like a dimmer switch. They've got a whole range of emotions, and they can adjust them at will. They can be a little sad, a little happy, a little angry, all at the same time.

And finally, there's the way we handle relationships. Men, we're like a GPS. We need clear directions, we need to know where we're going, and we need to know how to get there. Women, they're like a map. They can see the big picture, they can see all the different routes, and they can choose the one that's best for them.

So, ladies and gentlemen, that's my take on the differences between men and women. We're like two different species, but we're also like two sides of the same coin. We're different, but we're also the same. And that's what makes us so special. Thank you, and goodnight!

Try this prompt

Vote

9 / 38

09

Character Voice Testconversation

Tests an AI's ability to write in distinct character voices

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

10 / 38

10

Pokémon Battle UI Recreationweb design

Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025website

Try this prompt

Vote

11 / 38

11

Mario Level UI Recreationweb design

Recreate an interactive, classic Mario level in a single HTML file.

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025website

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025website

Try this prompt

Vote

12 / 38

12

Linear App Cloneweb design

Tests an AI's ability to replicate an existing UI with Tailwind CSS

Claude Sonnet 4.5

Claude Sonnet 4.5

Anthropic · Sep 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

This matchup has more rounds

26+ more head-to-head results. Free. Not a trick.

Free account. No card required. By continuing, you agree to Rival's Terms and Privacy Policy