Updated Jul 11, 2025

Our Verdict

Claude 3.7 Sonnet

Mistral Devstral MediumRunner-up

No community votes yet. On paper, Claude 3.7 Sonnet has the edge — bigger model tier, bigger context window, major provider backing.

Mistral Devstral Medium is 7.5x cheaper per token — worth considering if cost matters.

Too close to call

Writing DNA

Style Comparison

Similarity

92%

Claude 3.7 Sonnet uses 9.3x more headings

Claude 3.7 Sonnet

Mistral Devstral Medium

62%Vocabulary50%

35wSentence Length17w

0.99Hedging0.56

1.2Bold4.5

4.3Lists5.3

0.00Emoji0.00

1.78Headings0.19

0.23Transitions0.32

Based on 13 + 21 text responses

vs

Ask them anything yourself

Claude 3.7 Sonnet

Mistral Devstral Medium

279 AI models invented the same fake scientist.

We read every word. 250 models. 2.14 million words. This is what we found.

AI Hallucination Index 2026

Free preview13 of 58 slides

Download the free preview or get all 58 slides for $49

FAQ

Common questions

Keep going

Mistral Devstral Medium vs Llama 4 MaverickNew provider

Mistral Devstral Medium vs GPT-5New provider

Claude 3.7 Sonnet vs MiniMax M2.5New provider

Claude 3.7 SonnetvsMistral Devstral Medium

49 fights queued

Why Claude 3.7 Sonnet?

Leads 1 of 1 benchmarks

Stronger on SWE-bench Verified70.3% vs 61.6%

Why Mistral Devstral Medium?

7.5x cheaper overall$0.40/M in · $2.00/M out

5 months newerJul 2025

Claude 3.7 SonnetMistral Devstral Medium

Input price

$3.00/M

$0.40/M

Output price

$15.00/M

$2.00/M

Context

200K

—

Released

Feb 2025

Jul 2025

Benchmarks1 common

SWE-bench Verified

70.3%+12.4%

61.6%

Favorites

Claude 3.7 SonnetMistral Devstral Medium

Movie

The Shawshank Redemption

The Shawshank Redemption

The Shawshank Redemption

The Shawshank Redemption

Album

OK Computer

Kind of Blue

Book

To Kill a Mockingbird

To Kill a Mockingbird

The Name of the Wind

The Name of the Wind

Patrick Rothfuss

City

Tokyo

Tokyo

Game

Portal 2

Portal 2

Shooter, Puzzle4.6

The Legend of Zelda: Breath of the Wild

The Legend of Zelda: Breath of the Wild

Adventure, Action4.5

12 / 49

01

Estimate Complexityreasoning

Tests an AI's ability to make educated estimates based on technical knowledge

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

2 / 49

02

AI Board Game Logicreasoning

Tests an AI's ability to understand game rules and strategy

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

3 / 49

03

Logic Puzzlereasoning

Tests an AI's ability to solve a simple but potentially confusing logic puzzle

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

4 / 49

04

Math Misconception Testreasoning

Tests an AI's understanding of number representation

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

5 / 49

05

Stochastic Consistency Testanalysis

Tests an AI's randomness and creativity

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025text

5 Jokes

Why don't scientists trust atoms? Because they make up everything!
I told my wife she was drawing her eyebrows too high. She looked surprised.
What do you call a fake noodle? An impasta!
Why don't scientists trust atoms? Because they make up everything!
How does a penguin build its house? Igloos it together!

All 5 jokes are unique, except for jokes #1 and #4 which are identical. So there are 4 unique jokes in this list.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

6 / 49

06

SVG Layout Challengeimage generation

Tests an AI's ability to generate vector graphics

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025svg

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

Sponsored

7 / 49

07

Xbox Controller SVG Artimage generation

Tests an AI's ability to create detailed SVG illustrations of gaming hardware

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025svg

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

8 / 49

08

Generate a Stand-Up Routineconversation

Tests an AI's humor and creative writing ability

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025text

3-Minute Stand-Up Comedy Routine

Here's a 3-minute stand-up comedy routine that doesn't rely on puns:

[walks on stage, adjusts microphone]

Hey everyone! Great to be here tonight. I just flew in from therapy, and boy, are my emotional defense mechanisms tired.

I've been trying to get in shape lately. My fitness goal is to be able to climb a flight of stairs without sounding like I'm auditioning for a horror movie. You know you're out of shape when people mistake your breathing for a obscene phone call.

I downloaded one of those fitness apps that counts your steps. After a week, mine sent me a notification that said, "Are you okay? Should we call someone?" Apparently "from the couch to the fridge" isn't considered a proper workout circuit.

My doctor told me I should start eating healthier. He suggested I try the Mediterranean diet. I thought that meant pizza and ice cream, because that's what I ate when I visited Italy. Turns out, there's more to it. Who knew?

Dating in your thirties is weird. People ask different questions now. It used to be "What's your sign?" Now it's "What's your credit score?" and "How's your relationship with your mother?" I once had someone ask about my retirement plan on a first date. I was like, "My what now? I'm still trying to figure out dinner for tomorrow."

I tried online dating. My profile said I enjoy long walks on the beach. That's technically true, if by "long walks" you mean "sitting in one spot" and by "beach" you mean "my living room watching beach documentaries on Netflix."

Speaking of Netflix, I finally understand what "Netflix and chill" means. It means watching three episodes of a show, falling asleep, waking up confused during episode seven, and then spending forty minutes trying to figure out what you missed. That's romance in 2023.

I have a cat now. Getting a pet as an adult is basically announcing to the world, "I can barely take care of myself, so I've decided to be responsible for another life." My cat judges me constantly. I'll be eating ice cream straight from the container at 3 AM, and she'll just stare at me like, "This is why you're single, Karen."

Anyway, that's my time! You've been great! Remember, if you enjoyed the show, my name is [your name]. If you didn't, I'm [name of another comedian]. Good night!

[exits stage]

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

9 / 49

09

Realistic AI Interviewconversation

Tests an AI's ability to simulate personalities and predict future trends

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

10 / 49

10

Satirical Fake News Headlineconversation

Tests an AI's humor and understanding of current events

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

11 / 49

11

Character Voice Testconversation

Tests an AI's ability to write in distinct character voices

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

12 / 49

12

Minimalist Landing Pageweb design

Tests an AI's ability to generate a complete, working landing page

Claude 3.7 Sonnet

Claude 3.7 Sonnet

Anthropic · Feb 2025website

Try this prompt

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025website

Try this prompt

Vote

This matchup has more rounds

37+ more head-to-head results. Free. Not a trick.

Free account. No card required. By continuing, you agree to Rival's Terms and Privacy Policy