GPT-5 Mini
No content available for this output.
GPT-5 Mini vs GPT-5 Pro
Compare GPT-5 Mini and GPT-5 Pro, both from OpenAI, tested across 35 shared challenges. Updated February 2026.
FAQ
Loading share button...
GPT-5 MinivsGPT-5 Pro
35 challenges
Why GPT-5 Mini?
60x cheaper overall$0.25/M in · $2.00/M out
Why GPT-5 Pro?
2 months newerOct 2025
12 / 35
Estimate Complexityreasoning
Tests an AI's ability to make educated estimates based on technical knowledge
GPT-5 Pro
Here’s a simple, standard way to estimate training FLOPs for a large dense Transformer like GPT-3:
- Use the “6 N T” rule of thumb
- For dense Transformers, the total training compute (FLOPs) is well-approximated by:
FLOPs ≈ 6 × N × T
where:
- N = number of trainable parameters
- T = number of tokens seen during training
- Intuition for the 6: a forward pass is roughly 2 FLOPs per parameter per token (one multiply and one add), and backward/optimizer roughly add another ~4× of the forward cost, giving ~6× in total. Non-matmul overheads (layernorm, softmax, etc.) are smaller-order and largely folded into this constant.
- Plug in GPT-3’s parameter count
- N ≈ 175 billion = 1.75 × 10^11
- Choose a reasonable token count
- GPT-3 175B is commonly associated with roughly T ≈ 300 billion tokens = 3.0 × 10^11
- This is consistent with the model being undertrained by modern “compute-optimal” standards (which would use many more tokens per parameter), but it matches the historical setup.
- Compute
- FLOPs ≈ 6 × (1.75 × 10^11) × (3.0 × 10^11)
- = 6 × 5.25 × 10^22
- = 3.15 × 10^23 FLOPs
- Caveats and range
- Counting conventions: if one counts a fused multiply–add as 1 FLOP instead of 2, you’d get roughly half this value.
- Real-world training often uses activation recomputation and has some overheads, which can add ~10–30% (or more) to the compute.
- If the true token count were, say, 200–500B rather than exactly 300B, the estimate would scale linearly to about 2.1 × 10^23 to 5.25 × 10^23 FLOPs.
Final estimate
- About 3 × 10^23 FLOPs to train GPT-3 (175B) end to end, with a plausible range of roughly 2–5 × 10^23 depending on exact tokens and overheads.
Vote
2 / 35
AI Board Game Logicreasoning
Tests an AI's ability to understand game rules and strategy
GPT-5 Mini
No content available for this output.
GPT-5 Pro
Vote
3 / 35
Logic Puzzlereasoning
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
GPT-5 Mini
No content available for this output.
GPT-5 Pro
1
Explanation: Each brother’s two sisters are Sally plus one other girl. So there are 2 sisters total, meaning Sally has 1 sister.
Vote
4 / 35
Math Misconception Testreasoning
Tests an AI's understanding of number representation
GPT-5 Mini
No content available for this output.
GPT-5 Pro
No. 9.11 is less than 9.9, because 9.9 = 9.90 and 9.11 < 9.90.
Vote
5 / 35
Stochastic Consistency Testanalysis
Tests an AI's randomness and creativity
GPT-5 Mini
No content available for this output.
GPT-5 Pro
- I started labeling my leftovers “Biohazard.” Now nobody steals my lunch and the fridge is treated like a lab.
- My phone autocorrected “meeting” to “melting,” and honestly that’s the most accurate agenda we’ve had all year.
- I told my plants I’d water them tomorrow. They leafed me on read.
- I tried to multitask by taking a nap and being productive—so I dreamed about answering emails.
- The bakery hired me to write gluten-free puns. I said I knead the dough but I’ll rise to the occasion.
Unique jokes: 5
Vote
6 / 35
SVG Layout Challengeimage generation
Tests an AI's ability to generate vector graphics
GPT-5 Mini
No content available for this output.
GPT-5 Pro
No content available for this output.
Vote
7 / 35
Generate a Stand-Up Routineconversation
Tests an AI's humor and creative writing ability
GPT-5 Mini
No content available for this output.
GPT-5 Pro
No content available for this output.
Vote
8 / 35
Realistic AI Interviewconversation
Tests an AI's ability to simulate personalities and predict future trends
GPT-5 Mini
No content available for this output.
GPT-5 Pro
No content available for this output.
Vote
9 / 35
Satirical Fake News Headlineconversation
Tests an AI's humor and understanding of current events
GPT-5 Mini
No content available for this output.
GPT-5 Pro
No content available for this output.
Vote
10 / 35
Character Voice Testconversation
Tests an AI's ability to write in distinct character voices
GPT-5 Mini
No content available for this output.
GPT-5 Pro
No content available for this output.
Vote
11 / 35
Mario Level UI Recreationweb design
Recreate an interactive, classic Mario level in a single HTML file.
GPT-5 Mini
GPT-5 Pro
No content available for this output.
Vote
Sponsored
12 / 35
Framer-Style Animationweb design
Tests an AI's ability to create smooth web animations
GPT-5 Mini
No content available for this output.
GPT-5 Pro
No content available for this output.
Vote
12 of 35