Compare DeepSeek V3.2 by DeepSeek against Qwen3 Coder Flash by Qwen, context windows of 131K vs 128K, tested across 51 shared challenges. Updated February 2026.
46 challenges
Tests an AI's ability to make educated estimates based on technical knowledge
I'll estimate the FLOPs required to train GPT-3 by breaking down the key components and making reasonable assumptions.
GPT-3 had 175 billion parameters (1.75 × 10¹¹)
The key insight is that training involves:
For a transformer with L layers, d model dimensions, and N parameters:
Let me think about this more simply:
Per token operations:
Total tokens processed:
Total FLOPs = 10^12 tokens × 10^12 FLOPs/token = 10^24 FLOPs
Wait, let me reconsider this more carefully...
Looking at the computational complexity of transformer training:
But this seems too low. Let me reconsider based on actual known values...
Based on industry understanding and rough reasoning:
Model Architecture: Transformer with ~175B parameters Training Duration: ~1 month of continuous training on massive compute Compute Resources: Tens of thousands of GPUs working in parallel
My Estimate: 10^25 FLOPs (100 quintillion FLOPs)
This is roughly equivalent to:
This estimate aligns with the general consensus that training large language models requires an order of magnitude more compute than inference.
Tests an AI's ability to understand game rules and strategy
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
Tests an AI's understanding of number representation
Tests an AI's randomness and creativity
Tests an AI's ability to generate vector graphics
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Tests an AI's humor and creative writing ability
Tests an AI's ability to simulate personalities and predict future trends
Tests an AI's humor and understanding of current events
Tests an AI's ability to write in distinct character voices
Tests an AI's ability to generate a complete, working landing page
Couldn't render this response
This model didn't return a displayable web page for this challenge.
```
