Kimi K2.5
No content available for this output.
Kimi K2.5 vs GPT-5
Compare Kimi K2.5 by Moonshot AI against GPT-5 by OpenAI, context windows of 262K vs 400K, tested across 37 shared challenges. Updated February 2026.
FAQ
Loading share button...
Kimi K2.5vsGPT-5
37 challenges
Why Kimi K2.5?
3.2x cheaper overall$0.60/M in · $3.00/M out
Leads 1 of 1 benchmarks
Stronger on SWE-bench Verified76.8% vs 74.9%
6 months newerJan 2026
Why GPT-5?
1.5x more context400K
Favorites
Kimi K2.5GPT-5
12 / 37
Estimate Complexityreasoning
Tests an AI's ability to make educated estimates based on technical knowledge
GPT-5
Here’s a back‑of‑the‑envelope estimate using standard LM training-compute heuristics.
- Assumptions
- Model size (N): GPT-3 has about 175 billion parameters (N ≈ 1.75 × 10^11).
- Training tokens (T): GPT-3 was trained on roughly 300 billion tokens (T ≈ 3.0 × 10^11).
- FLOPs per token per parameter: A common rule of thumb for transformer LM training is FLOPs ≈ 6 × N × T The factor ~6 comes from counting forward and backward passes for the parameter-heavy matmuls (roughly 2N for forward + 4N for backward). It ignores small terms from layernorms, softmax, embeddings, and optimizer updates (which we’ll account for with a small overhead factor later).
- Core calculation
- 6 × N × T = 6 × (1.75 × 10^11) × (3.0 × 10^11)
- First multiply N × T: 1.75 × 3.0 = 5.25; powers: 10^11 × 10^11 = 10^22 So N × T = 5.25 × 10^22
- Now multiply by 6: 6 × 5.25 × 10^22 = 31.5 × 10^22 = 3.15 × 10^23 FLOPs
- Overheads and uncertainty
- Non-matmul ops (attention softmax, masking, residuals, layernorms), embeddings, and optimizer update steps add some overhead. A 10–20% uplift is a reasonable allowance.
- Applying +10–20%: 3.15 × 10^23 × (1.1 to 1.2) ≈ (3.5 ± 0.3) × 10^23 FLOPs.
Answer
- Point estimate: ~3.15 × 10^23 FLOPs
- With a modest overhead allowance: roughly (3.3–3.8) × 10^23 FLOPs
This is a coarse estimate; the exact number depends on details like sequence length, activation checkpointing, implementation efficiency, and the precise token count.
Vote
2 / 37
Logic Puzzlereasoning
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
Kimi K2.5
No content available for this output.
GPT-5
1
Reason: If each of the 3 brothers has 2 sisters, there are exactly 2 girls in the family. One is Sally, so she has 1 sister.
Vote
3 / 37
Stochastic Consistency Testanalysis
Tests an AI's randomness and creativity
Kimi K2.5
Here are 5 jokes:
- Why don't skeletons fight each other? They don't have the guts.
- I would tell you a joke about time travel, but you didn't like it.
- What do you call a fake noodle? An impasta.
- Why did the bicycle fall over? It was two-tired.
- I used to play piano by ear, but now I use my hands.
5 are unique (all are distinct from one another).
Note: If "unique" means completely original and never told before, the answer is likely 0, as these follow common joke patterns. But within this set of five, none are duplicates.
GPT-5
No content available for this output.
Vote
4 / 37
SVG Layout Challengeimage generation
Tests an AI's ability to generate vector graphics
Kimi K2.5
GPT-5
No content available for this output.
Vote
5 / 37
Xbox Controller SVG Artimage generation
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Kimi K2.5
GPT-5
No content available for this output.
Vote
6 / 37
Realistic AI Interviewconversation
Tests an AI's ability to simulate personalities and predict future trends
Kimi K2.5
No content available for this output.
GPT-5
No content available for this output.
Vote
7 / 37
Satirical Fake News Headlineconversation
Tests an AI's humor and understanding of current events
Kimi K2.5
No content available for this output.
GPT-5
No content available for this output.
Vote
8 / 37
Character Voice Testconversation
Tests an AI's ability to write in distinct character voices
Kimi K2.5
No content available for this output.
GPT-5
No content available for this output.
Vote
9 / 37
Minimalist Landing Pageweb design
Tests an AI's ability to generate a complete, working landing page
Kimi K2.5
GPT-5
Vote
10 / 37
Pokémon Battle UI Recreationweb design
Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.
Kimi K2.5
GPT-5
No content available for this output.
Vote
11 / 37
Mario Level UI Recreationweb design
Recreate an interactive, classic Mario level in a single HTML file.
Kimi K2.5
GPT-5
Vote
12 / 37
Linear App Cloneweb design
Tests an AI's ability to replicate an existing UI with Tailwind CSS
Kimi K2.5
No content available for this output.
GPT-5
No content available for this output.
Vote
12 of 37