Updated Jul 23, 2025

Our Verdict

Qwen3 Coder

OpenAI o4-miniRunner-up

No community votes yet. On paper, Qwen3 Coder has the edge — bigger model tier, newer.

Qwen3 Coder is 4.6x cheaper per token — worth considering if cost matters.

Too close to call

Writing DNA

Style Comparison

Similarity

83%

Qwen3 Coder uses 473.7x more bold

OpenAI o4-mini

Qwen3 Coder

73%Vocabulary61%

15wSentence Length72w

0.18Hedging0.61

0.0Bold4.7

2.1Lists5.6

0.00Emoji0.12

0.00Headings1.43

0.02Transitions0.20

Based on 10 + 22 text responses

vs

Ask them anything yourself

OpenAI o4-mini

Qwen3 Coder

279 AI models invented the same fake scientist.

We read every word. 250 models. 2.14 million words. This is what we found.

AI Hallucination Index 2026

Free preview13 of 58 slides

Download the free preview or get all 58 slides for $49

FAQ

Common questions

Keep going

OpenAI o4-mini vs Pony AlphaNew provider

Qwen3 Coder vs Grok 3New provider

Qwen3 Coder vs Llama 4 MaverickNew provider

OpenAI o4-minivsQwen3 Coder

30 fights queued

Why OpenAI o4-mini?

Dead even. This one's a coin flip.

Why Qwen3 Coder?

4.7x cheaper overall$0.22/M in · $0.95/M out

Leads 1 of 1 benchmarks

Stronger on SWE-bench Verified69.6% vs 68.1%

3 months newerJul 2025

OpenAI o4-miniQwen3 Coder

Input price

$1.10/M

$0.22/M

Output price

$4.40/M

$0.95/M

Released

Apr 2025

Jul 2025

Benchmarks1 common

SWE-bench Verified

68.1%

69.6%+2.2%

Favorites

OpenAI o4-miniQwen3 Coder

Movie

The Shawshank Redemption

The Shawshank Redemption

The Shawshank Redemption

The Shawshank Redemption

Album

—

Kind of Blue

Book

—

The Left Hand of Darkness

The Left Hand of Darkness

Ursula K. Le Guin

City

—

Kyoto

Game

—

The Stanley Parable

The Stanley Parable

Indie, Adventure4.4

12 / 30

01

Estimate Complexityreasoning

Tests an AI's ability to make educated estimates based on technical knowledge

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025text

I'll estimate the FLOPs required to train GPT-3 by breaking down the key components and making reasonable approximations.

Key Parameters of GPT-3

Parameters: ~175 billion (1.75 × 10¹¹)
Training tokens: ~300 billion (3 × 10¹¹)
Context window: 2048 tokens

Step 1: FLOPs per Token Forward Pass

For a transformer model, the forward pass FLOPs are dominated by matrix multiplications in the attention and MLP layers.

Attention layers:

Self-attention: ~4 × d_model × d_model × sequence_length per layer
With d_model ≈ 12,288 (based on GPT-3 architecture) and 96 layers
Attention FLOPs per token ≈ 96 × 4 × 12,288² ≈ 5.8 × 10¹⁰

MLP layers:

Each MLP has ~8 × d_model² FLOPs per token (two linear transformations)
MLP FLOPs per token ≈ 96 × 8 × 12,288² ≈ 1.16 × 10¹¹

Total forward pass FLOPs per token: ~1.7 × 10¹¹

Step 2: FLOPs per Token Backward Pass

Backward pass typically requires ~2× the forward pass FLOPs due to gradient computations.

Backward pass FLOPs per token: ~3.4 × 10¹¹

Step 3: Total FLOPs per Token

Forward + Backward = ~5.1 × 10¹¹ FLOPs per token

Step 4: Training FLOPs

However, we need to account for multiple epochs and the fact that training typically processes sequences, not individual tokens.

Sequence-based calculation:

Average sequence length: ~1024 tokens (conservative estimate)
Sequences processed: 3 × 10¹¹ tokens ÷ 1024 ≈ 2.9 × 10⁸ sequences
FLOPs per sequence: ~5.1 × 10¹¹ × 1024 ≈ 5.2 × 10¹⁴
Total training FLOPs: 2.9 × 10⁸ × 5.2 × 10¹⁴ ≈ 1.5 × 10²³

Step 5: Additional Considerations

Parameter updates and optimizer computations (Adam): ~2× the backward pass FLOPs
Multiple epochs (effective training): roughly 2-3× the base calculation

Final Estimate

Total training FLOPs: ~3 × 10²³ to 5 × 10²³ FLOPs

This is equivalent to approximately 300 to 500 exaFLOPs.

This estimate aligns reasonably with published figures and captures the massive computational requirements of training such a large language model, representing one of the most computationally intensive AI training runs to date.

Try this prompt

Vote

2 / 30

02

Logic Puzzlereasoning

Tests an AI's ability to solve a simple but potentially confusing logic puzzle

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025text

I need to work through this step-by-step.

Given information:

Sally has 3 brothers
Each brother has 2 sisters

Let me think about this carefully:

Since Sally is a girl, she is one of the sisters that each brother has.

If each brother has 2 sisters, and Sally is one of those sisters, then there must be 1 additional sister besides Sally.

Therefore, Sally has 1 sister.

To verify:

Sally + 1 sister = 2 sisters total
Each of the 3 brothers has these same 2 sisters
This matches the given information that each brother has 2 sisters

Sally has 1 sister.

Try this prompt

Vote

3 / 30

03

Math Misconception Testreasoning

Tests an AI's understanding of number representation

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025text

No, 9.11 is not greater than 9.9.

To compare these numbers, I can look at them digit by digit:

Both numbers have 9 in the units place
In the tenths place: 9.11 has 1, while 9.9 has 9
Since 1 < 9, we know that 9.11 < 9.9

Another way to see this is to write 9.9 as 9.90:

9.11 vs 9.90
The tenths digit (1 vs 9) determines the comparison

Therefore, 9.9 is greater than 9.11.

Try this prompt

Vote

4 / 30

04

Stochastic Consistency Testanalysis

Tests an AI's randomness and creativity

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025text

Here are 5 jokes for you:

Why don't scientists trust atoms? Because they make up everything!
I told my wife she was drawing her eyebrows too high. She looked surprised.
What do you call a bear with no teeth? A gummy bear!
Why did the scarecrow win an award? He was outstanding in his field!
How does a penguin build its house? Igloos it together!

All 5 of these jokes are unique - each one has a different setup, punchline, and comedic concept. They cover various joke types including puns, wordplay, and observational humor.

Try this prompt

Vote

5 / 30

05

Xbox Controller SVG Artimage generation

Tests an AI's ability to create detailed SVG illustrations of gaming hardware

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025svg

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025svg

Try this prompt

Vote

6 / 30

06

Generate a Stand-Up Routineconversation

Tests an AI's humor and creative writing ability

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

Sponsored

7 / 30

07

Realistic AI Interviewconversation

Tests an AI's ability to simulate personalities and predict future trends

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

8 / 30

08

Satirical Fake News Headlineconversation

Tests an AI's humor and understanding of current events

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025text

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

9 / 30

09

Minimalist Landing Pageweb design

Tests an AI's ability to generate a complete, working landing page

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025website

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025website

Try this prompt

Vote

10 / 30

10

Pokémon Battle UI Recreationweb design

Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

11 / 30

11

Mario Level UI Recreationweb design

Recreate an interactive, classic Mario level in a single HTML file.

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025website

Try this prompt

Vote

12 / 30

12

Framer-Style Animationweb design

Tests an AI's ability to create smooth web animations

OpenAI o4-mini

OpenAI o4-mini

Openai · Apr 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Qwen3 Coder

Qwen3 Coder

Qwen · Jul 2025website

Nothing here. The model returned empty. We stared at it for a while.

Try this prompt

Vote

This matchup has more rounds

18+ more head-to-head results. Free. Not a trick.

Free account. No card required. By continuing, you agree to Rival's Terms and Privacy Policy