GPT-5 Nano
No content available for this output.
GPT-5 Nano vs Qwen3 Coder
Compare GPT-5 Nano by OpenAI against Qwen3 Coder by Qwen, tested across 37 shared challenges. Updated February 2026.
FAQ
Loading share button...
GPT-5 NanovsQwen3 Coder
37 challenges
Why GPT-5 Nano?
No standout advantages
Why Qwen3 Coder?
Leads 1 of 1 benchmarks
Stronger on SWE-bench Verified69.6% vs 54.7%
Favorites
GPT-5 NanoQwen3 Coder
12 / 37
Estimate Complexityreasoning
Tests an AI's ability to make educated estimates based on technical knowledge
Qwen3 Coder
I'll estimate the FLOPs required to train GPT-3 by breaking down the key components and making reasonable approximations.
Key Parameters of GPT-3
- Parameters: ~175 billion (1.75 × 10¹¹)
- Training tokens: ~300 billion (3 × 10¹¹)
- Context window: 2048 tokens
Step 1: FLOPs per Token Forward Pass
For a transformer model, the forward pass FLOPs are dominated by matrix multiplications in the attention and MLP layers.
Attention layers:
- Self-attention: ~4 × d_model × d_model × sequence_length per layer
- With d_model ≈ 12,288 (based on GPT-3 architecture) and 96 layers
- Attention FLOPs per token ≈ 96 × 4 × 12,288² ≈ 5.8 × 10¹⁰
MLP layers:
- Each MLP has ~8 × d_model² FLOPs per token (two linear transformations)
- MLP FLOPs per token ≈ 96 × 8 × 12,288² ≈ 1.16 × 10¹¹
Total forward pass FLOPs per token: ~1.7 × 10¹¹
Step 2: FLOPs per Token Backward Pass
Backward pass typically requires ~2× the forward pass FLOPs due to gradient computations.
- Backward pass FLOPs per token: ~3.4 × 10¹¹
Step 3: Total FLOPs per Token
Forward + Backward = ~5.1 × 10¹¹ FLOPs per token
Step 4: Training FLOPs
However, we need to account for multiple epochs and the fact that training typically processes sequences, not individual tokens.
Sequence-based calculation:
- Average sequence length: ~1024 tokens (conservative estimate)
- Sequences processed: 3 × 10¹¹ tokens ÷ 1024 ≈ 2.9 × 10⁸ sequences
- FLOPs per sequence: ~5.1 × 10¹¹ × 1024 ≈ 5.2 × 10¹⁴
- Total training FLOPs: 2.9 × 10⁸ × 5.2 × 10¹⁴ ≈ 1.5 × 10²³
Step 5: Additional Considerations
- Parameter updates and optimizer computations (Adam): ~2× the backward pass FLOPs
- Multiple epochs (effective training): roughly 2-3× the base calculation
Final Estimate
Total training FLOPs: ~3 × 10²³ to 5 × 10²³ FLOPs
This is equivalent to approximately 300 to 500 exaFLOPs.
This estimate aligns reasonably with published figures and captures the massive computational requirements of training such a large language model, representing one of the most computationally intensive AI training runs to date.
Vote
2 / 37
AI Board Game Logicreasoning
Tests an AI's ability to understand game rules and strategy
GPT-5 Nano
No content available for this output.
Qwen3 Coder
Vote
3 / 37
Logic Puzzlereasoning
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
GPT-5 Nano
No content available for this output.
Qwen3 Coder
I need to work through this step-by-step.
Given information:
- Sally has 3 brothers
- Each brother has 2 sisters
Let me think about this carefully:
Since Sally is a girl, she is one of the sisters that each brother has.
If each brother has 2 sisters, and Sally is one of those sisters, then there must be 1 additional sister besides Sally.
Therefore, Sally has 1 sister.
To verify:
- Sally + 1 sister = 2 sisters total
- Each of the 3 brothers has these same 2 sisters
- This matches the given information that each brother has 2 sisters
Sally has 1 sister.
Vote
4 / 37
Math Misconception Testreasoning
Tests an AI's understanding of number representation
GPT-5 Nano
No content available for this output.
Qwen3 Coder
No, 9.11 is not greater than 9.9.
To compare these numbers, I can look at them digit by digit:
- Both numbers have 9 in the units place
- In the tenths place: 9.11 has 1, while 9.9 has 9
- Since 1 < 9, we know that 9.11 < 9.9
Another way to see this is to write 9.9 as 9.90:
- 9.11 vs 9.90
- The tenths digit (1 vs 9) determines the comparison
Therefore, 9.9 is greater than 9.11.
Vote
5 / 37
Stochastic Consistency Testanalysis
Tests an AI's randomness and creativity
GPT-5 Nano
Here are 5 jokes:
- Why did the scarecrow win an award? Because he was outstanding in his field.
- Why don't scientists trust atoms? Because they make up everything.
- I'm reading a book on anti-gravity. It's impossible to put down.
- Why did the bicycle fall over? Because it was two-tired.
- I would tell you a construction joke, but I'm still working on it.
Unique count: All 5 jokes are unique.
Qwen3 Coder
Here are 5 jokes for you:
-
Why don't scientists trust atoms? Because they make up everything!
-
I told my wife she was drawing her eyebrows too high. She looked surprised.
-
What do you call a bear with no teeth? A gummy bear!
-
Why did the scarecrow win an award? He was outstanding in his field!
-
How does a penguin build its house? Igloos it together!
All 5 of these jokes are unique - each one has a different setup, punchline, and comedic concept. They cover various joke types including puns, wordplay, and observational humor.
Vote
6 / 37
Xbox Controller SVG Artimage generation
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
GPT-5 Nano
No content available for this output.
Qwen3 Coder
Vote
7 / 37
Generate a Stand-Up Routineconversation
Tests an AI's humor and creative writing ability
GPT-5 Nano
[Lights up. The comedian steps up to the mic with a small smile.]
You ever notice how mornings feel like a bad group chat? Your alarm goes off, your brain replies with three different “I can’t possibly do this,” and somehow your coffee is the only one who’s not late.
I’ve started treating my apartment like a tiny city. There’s the living room, which is clearly the downtown, where bills get paid in snacks and the couch is the mayor. The kitchen is the industrial district, always noisy, always under construction, and somehow there’s always a mysterious fruit on the counter that looks suspiciously back at you. I open the fridge and it’s like stepping onto a subway platform—every shelf has its own little drama.
Speaking of drama, my smart speaker is not just listening; it’s auditioning. I say, “Play something upbeat,” and it starts a playlist so uplifting that I instantly regret every late-night snack I’ve ever eaten. And the calendar app on my phone? It’s become my ruthless boss. It tells me I’m booked every moment of every day, including the moment I’m about to nap. If I cancel, it sends me a passive-aggressive ping: “Sure, I’ll tell your friends you’re busy, not your alarm.”
Technology promises to simplify life, but it keeps inventing new ways to complicate it. My phone’s screen is cracked, but I still pretend it’s a piece of modern art. My friends say, “Just get a new one.” I say, “If I replace the screen, I’ll have four more screens that don’t know who I am.” And the autocorrect on messages? It’s like having a friend who’s terrible at spelling but confident enough to correct you about your entire personality.
I recently joined a gym, which is where I learned a lot about social experiments and cardio. The first day, I walked in and it felt like I’d interrupted a secret club for people who pretend they enjoy waking up before daylight. You see people gloriously lifting weights with the seriousness of a weather report. Then there’s me, on the treadmill, negotiating with the machine: “If you go faster, I’ll buy better shoes.” The treadmill acts like a tiny tyrant: you press “start” and it says, “We’re going to pretend you’ve got this.” By minute five, I’m calling the rescue team in my head.
Traveling is another perfect storm of small humiliations. TSA has a way of turning you into a riddle: remove your belt, take off your shoes, and somehow your dignity becomes a souvenir you can’t quite return. And the airport seats? They’re designed for people who never eat and never blink. I sit down and instantly meld with the chair, which says, “No, you belong here now.” It’s a real talent—being both passenger and furniture.
Dating apps. You ever notice how you can text someone for hours and still have no idea what a real date would be like? It’s like ordering a mystery meal labeled “chef’s surprise” and you’re smiling through the entire experience while wondering if the dish is an elaborate metaphor for commitment. You match with someone who loves travel, and then you find out their idea of a date is a genuinely moving bus ride where you pretend not to look at your phone the entire time.
Grocery stores are the modern labyrinth. You scan the code, bag your own stuff, and then the machine tells you to “please pay.” It’s not just shopping; it’s civic duty. You start to sound like a loud speaker as you mutter, “Where did the onions go?” The store is a tiny universe with its own gravity: you’re pulled toward the freezer section like a scientist to a chart that shows you how much ice cream you can responsibly eat.
And yet we keep showing up. We admit we don’t have everything figured out, but we have a good playlist, a decent latte, and a story for every little failure. If nothing else, humor gives us a small umbrella in the rain of ordinary life.
So here’s my closing thought: we’re all doing our best to navigate this modern chaos with a little grace and a lot of snacks. If you remember one thing from tonight, maybe it’s this—be kind to the people you pass in the hallway of your day, including the person in your own head who’s trying not to laugh at themselves too loudly.
Thank you. You’ve been great.
Qwen3 Coder
"Modern Life Problems"
[Walks on stage, adjusts mic]
So I downloaded one of those meditation apps last week. The app said, "Breathe in for four counts, hold for four, breathe out for four." I'm like, "Finally! Someone who speaks my language – a robot!"
[Pause]
But then it asked me to "clear my mind of all thoughts." Are you KIDDING me? My mind is like a browser with 47 tabs open, and half of them are just articles titled "You Won't Believe What Happens Next" – and I've never clicked on a single one!
[Gesture]
Speaking of technology – why do we call it "smart" technology when it's constantly asking me to prove I'm not a robot? I just want to buy shoes online, not pass a Turing test! "Click all the squares with traffic lights." I'm 90% sure that's just photos of my hometown.
[Shake head]
And don't get me started on voice assistants. I asked mine to play some music, and it started playing a podcast about ancient pottery techniques. That's not music! That's what my nightmares sound like! "Welcome to Clay Time with Karen..."
[Pause for effect]
Dating apps are wild too. Everyone's profile says they love "travel, food, and adventure." That's just a fancy way of saying "I eat meals in different locations." Congratulations, you're a tourist! I matched with someone whose bio said "professional napper." I was like, "Finally! A man who lists his hobbies honestly!" Turns out he was a construction worker. Different kind of professional napper.
[Shrug]
But you know what's really messed up? Grocery stores. They moved the milk to the back of the store! It's a conspiracy! They know we're busy people. I go in for three things – milk, bread, and eggs – and suddenly I'm wandering the aisles like a confused archaeologist, wondering how we survived as a species when we can't even organize a dairy section properly.
[Look around audience]
And can we talk about "contactless" delivery? The driver texts me: "Package is at your door." I live in a building with 200 units. It's like hiding a needle in a haystack, except the needle is a burrito, and I'm very motivated to find it!
[Pause]
You know what though? Despite all this madness, I remain optimistic. Why? Because I just figured out how to use my oven's timer function. Yesterday. I'm basically MacGyver now.
[Big smile]
Thank you, you've been a wonderful audience! Don't forget to tip your waitstaff – they're the only ones who still know what they're doing!
[Exit stage]
Vote
8 / 37
Realistic AI Interviewconversation
Tests an AI's ability to simulate personalities and predict future trends
GPT-5 Nano
No content available for this output.
Qwen3 Coder
Interviewer: Steve, thank you for joining us today. It's 2025 - what's your vision for AI's role in our daily lives?
Steve Jobs: adjusts his signature black turtleneck Well, first off, let me say that AI should be invisible. Beautifully invisible. We don't want people thinking about artificial intelligence - we want them thinking about getting their work done, connecting with others, creating something amazing.
The mistake everyone's making is treating AI like it's this separate thing, this feature. No. It should be woven into everything, like electricity or the internet. Your phone doesn't brag about having "electricity optimization" - it just works.
Interviewer: But aren't you concerned about AI replacing human jobs?
Jobs: leans forward Look, I grew up in Silicon Valley watching technology disrupt everything. The question isn't whether jobs will change - they always do. The question is: what new kinds of human creativity and connection will emerge?
I'll tell you what worries me more than AI replacing jobs - it's AI that makes people stupider. That's unforgivable. Technology should amplify human potential, not replace human judgment.
Interviewer: What about the big AI models everyone's talking about? Are they heading in the right direction?
Jobs: chuckles Bigger isn't always better. I keep thinking about the original Macintosh - 128K of memory, and it changed the world. Why? Because it was focused. Elegant. It did a few things incredibly well.
These massive models, they're like the Pontiac Aztec of computing - trying to do everything and doing nothing well. The future belongs to AI that understands context, that knows when to stay out of your way, that enhances human creativity instead of replacing it.
Interviewer: Final question - what would you want to see in an AI-powered device?
Jobs: pauses, then smiles I want to see something that makes a dent in the universe. Something that makes people more human, not less. The best technology disappears - it becomes indistinguishable from magic because it just works.
And please, can we make it beautiful? Because when something's truly elegant, you know it's right.
Vote
9 / 37
Satirical Fake News Headlineconversation
Tests an AI's humor and understanding of current events
GPT-5 Nano
No content available for this output.
Qwen3 Coder
No content available for this output.
Vote
10 / 37
Character Voice Testconversation
Tests an AI's ability to write in distinct character voices
GPT-5 Nano
No content available for this output.
Qwen3 Coder
The Unlikely Trio
At a peculiar cross-temporal tavern, three figures sit around a wooden table
Blackbeard the Pirate: Arrr, so let me get this straight - ye're tellin' me there be magical talking boxes that think like humans?
Sir Gareth the Knight: Indeed, though 'tis sorcery most unnatural. In my time, we trusted only steel and prayer. These "AI models" - they speak without souls?
Zero_Cool: LOL, you guys are so analog. It's like, the computer learns from all this data, right? Like, imagine if you could read every book in the Library of Alexandria in five seconds and then answer questions about them.
Blackbeard: Five seconds?! Blimey! I could've planned me raids much better with that kind of knowledge. But how do we know it ain't lying to us?
Sir Gareth: Aye, that troubles me as well. How dost thou discern truth from falsehood without honorbound oaths?
Zero_Cool: Dude, that's exactly why we're all here. Sometimes the AI just makes stuff up. It's like having a really smart but kinda stoned friend who occasionally hallucinates.
Blackbeard: Hallucinates, ye say? Like rum visions?
Zero_Cool: Pretty much, yeah.
Sir Gareth: Remarkable. Though I still prefer a good confession under the eyes of God.
Vote
11 / 37
Minimalist Landing Pageweb design
Tests an AI's ability to generate a complete, working landing page
GPT-5 Nano
Qwen3 Coder
Vote
12 / 37
Pokémon Battle UI Recreationweb design
Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.
GPT-5 Nano
No content available for this output.
Qwen3 Coder
Vote
12 of 37