Updated Aug 7, 2025

Our Verdict

Mistral Devstral MediumWinner

GPT-5Runner-up

Pick Mistral Devstral Medium. In 1 blind votes, Mistral Devstral Medium wins 100% of the time. That's not luck.

Mistral Devstral Medium is 5.0x cheaper per token — worth considering if cost matters.

Clear winner

Writing DNA

Style Comparison

Similarity

100%

Mistral Devstral Medium uses 24.0x more bold

Mistral Devstral Medium

GPT-5

50%Vocabulary65%

17wSentence Length13w

0.56Hedging0.20

4.5Bold0.2

5.3Lists4.6

0.00Emoji0.00

0.19Headings0.16

0.32Transitions0.03

Based on 21 + 16 text responses

vs

Ask them anything yourself

Mistral Devstral Medium

GPT-5

279 AI models invented the same fake scientist.

We read every word. 250 models. 2.14 million words. This is what we found.

AI Hallucination Index 2026

Free preview13 of 58 slides

Download the free preview or get all 58 slides for $49

FAQ

Common questions

Keep going

Mistral Devstral Medium vs Llama 4 MaverickNew provider

Mistral Devstral Medium vs Claude Opus 4New provider

Mistral Devstral Medium vs MiniMax M1New provider

Mistral Devstral MediumvsGPT-5

47 fights queued

Why Mistral Devstral Medium?

4.8x cheaper overall$0.40/M in · $2.00/M out

Why GPT-5?

Leads 1 of 1 benchmarks

Stronger on SWE-bench Verified74.9% vs 61.6%

Mistral Devstral MediumGPT-5

Input price

$0.40/M

$1.25/M

Output price

$2.00/M

$10.00/M

Context

—

400K

Released

Jul 2025

Aug 2025

Benchmarks1 common

SWE-bench Verified

61.6%

74.9%+17.8%

Favorites

Mistral Devstral MediumGPT-5

Movie

The Shawshank Redemption

The Shawshank Redemption

—

Album

Kind of Blue

—

Book

The Name of the Wind

The Name of the Wind

Patrick Rothfuss

—

City

Tokyo

—

Game

The Legend of Zelda: Breath of the Wild

The Legend of Zelda: Breath of the Wild

Adventure, Action4.5

—

12 / 47

01

Estimate Complexityreasoning

Tests an AI's ability to make educated estimates based on technical knowledge

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025text

Here’s a back‑of‑the‑envelope estimate using standard LM training-compute heuristics.

Assumptions

Model size (N): GPT-3 has about 175 billion parameters (N ≈ 1.75 × 10^11).
Training tokens (T): GPT-3 was trained on roughly 300 billion tokens (T ≈ 3.0 × 10^11).
FLOPs per token per parameter: A common rule of thumb for transformer LM training is FLOPs ≈ 6 × N × T The factor ~6 comes from counting forward and backward passes for the parameter-heavy matmuls (roughly 2N for forward + 4N for backward). It ignores small terms from layernorms, softmax, embeddings, and optimizer updates (which we’ll account for with a small overhead factor later).

Core calculation

6 × N × T = 6 × (1.75 × 10^11) × (3.0 × 10^11)
First multiply N × T: 1.75 × 3.0 = 5.25; powers: 10^11 × 10^11 = 10^22 So N × T = 5.25 × 10^22
Now multiply by 6: 6 × 5.25 × 10^22 = 31.5 × 10^22 = 3.15 × 10^23 FLOPs

Overheads and uncertainty

Non-matmul ops (attention softmax, masking, residuals, layernorms), embeddings, and optimizer update steps add some overhead. A 10–20% uplift is a reasonable allowance.
Applying +10–20%: 3.15 × 10^23 × (1.1 to 1.2) ≈ (3.5 ± 0.3) × 10^23 FLOPs.

Answer

Point estimate: ~3.15 × 10^23 FLOPs
With a modest overhead allowance: roughly (3.3–3.8) × 10^23 FLOPs

This is a coarse estimate; the exact number depends on details like sequence length, activation checkpointing, implementation efficiency, and the precise token count.

Try this prompt

Vote

2 / 47

02

AI Board Game Logicreasoning

Tests an AI's ability to understand game rules and strategy

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025svg

Try this prompt

Vote

3 / 47

03

Logic Puzzlereasoning

Tests an AI's ability to solve a simple but potentially confusing logic puzzle

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025text

1

Reason: If each of the 3 brothers has 2 sisters, there are exactly 2 girls in the family. One is Sally, so she has 1 sister.

Try this prompt

Vote

4 / 47

04

Math Misconception Testreasoning

Tests an AI's understanding of number representation

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

5 / 47

05

Stochastic Consistency Testanalysis

Tests an AI's randomness and creativity

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

6 / 47

06

SVG Layout Challengeimage generation

Tests an AI's ability to generate vector graphics

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

Sponsored

7 / 47

07

Xbox Controller SVG Artimage generation

Tests an AI's ability to create detailed SVG illustrations of gaming hardware

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025svg

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

8 / 47

08

Generate a Stand-Up Routineconversation

Tests an AI's humor and creative writing ability

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Ladies and Gentlemen, I'm thrilled to be here tonight. I've been doing some thinking about the differences between men and women. Now, I know what you're thinking, "Oh great, another comedian talking about how men and women are different." But hear me out, because I've got a fresh perspective on this.

You know, men and women, we're like two different species. We're like cats and dogs, but with less fur and more clothes. And I'm not talking about the obvious differences, like how men can't find anything in the fridge, and women can't find anything in the garage. I'm talking about the subtle differences, the ones that really make us unique.

Take communication, for example. Men, we're simple creatures. We communicate in grunts and nods. We're like cavemen, but with better grooming habits. Women, on the other hand, they're like a symphony orchestra. They've got a whole range of notes and tones and rhythms. They can say more with a single raised eyebrow than a man can say with a whole paragraph.

And then there's the way we handle stress. Men, we're like a pressure cooker. We bottle it all up, and then one day, we just explode. We're like a volcano, but with less lava and more swearing. Women, they're like a slow drip. They let it out a little at a time, until eventually, they're just a puddle of stress on the floor.

And let's not forget about the way we handle emotions. Men, we're like a light switch. We're either on or off. We're either happy or sad, angry or calm. Women, they're like a dimmer switch. They've got a whole range of emotions, and they can adjust them at will. They can be a little sad, a little happy, a little angry, all at the same time.

And finally, there's the way we handle relationships. Men, we're like a GPS. We need clear directions, we need to know where we're going, and we need to know how to get there. Women, they're like a map. They can see the big picture, they can see all the different routes, and they can choose the one that's best for them.

So, ladies and gentlemen, that's my take on the differences between men and women. We're like two different species, but we're also like two sides of the same coin. We're different, but we're also the same. And that's what makes us so special. Thank you, and goodnight!

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

9 / 47

09

Realistic AI Interviewconversation

Tests an AI's ability to simulate personalities and predict future trends

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

10 / 47

10

Satirical Fake News Headlineconversation

Tests an AI's humor and understanding of current events

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

11 / 47

11

Character Voice Testconversation

Tests an AI's ability to write in distinct character voices

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

12 / 47

12

Minimalist Landing Pageweb design

Tests an AI's ability to generate a complete, working landing page

Mistral Devstral Medium

Mistral Devstral Medium

Mistral · Jul 2025website

Try this prompt

GPT-5

GPT-5

Openai · Aug 2025website

Try this prompt

Vote

This matchup has more rounds

35+ more head-to-head results. Free. Not a trick.

Free account. No card required. By continuing, you agree to Rival's Terms and Privacy Policy