Z.AI: GLM 4.5
No content available for this output.
Z.AI: GLM 4.5 vs OpenAI o4-mini
Compare Z.AI: GLM 4.5 by Zhipu AI against OpenAI o4-mini by OpenAI, tested across 34 shared challenges. Updated February 2026.
FAQ
Loading share button...
Z.AI: GLM 4.5vsOpenAI o4-mini
34 challenges
Why Z.AI: GLM 4.5?
2x cheaper overall$0.60/M in · $2.20/M out
3 months newerJul 2025
Why OpenAI o4-mini?
Leads 1 of 1 benchmarks
Stronger on SWE-bench Verified68.1% vs 64.2%
Favorites
Z.AI: GLM 4.5OpenAI o4-mini
12 / 34
Estimate Complexityreasoning
Tests an AI's ability to make educated estimates based on technical knowledge
OpenAI o4-mini
Here's a back‐of‐the‐envelope derivation that gets us into the right ballpark (∼10²³ FLOPs total):
-
Model size
• GPT–3 "175 B" has about P ≃1.75×10¹¹ parameters. -
Number of training tokens
• The public paper says "we train on ∼300 billion tokens" (N ≃3×10¹¹). -
FLOPs per token
• Every forward+backward through the network touches all parameters.
• Rough rule of thumb: you need O(6) FLOPs per parameter per token
(a couple multiplies/adds in the forward pass, a similar count in the backward, and some small extra for optimizer updates). • So 6 × P FLOPs/token ≃ 6×1.75×10¹¹ ≃1.05×10¹² FLOPs/token. -
Total FLOPs
• Multiply FLOPs/token by number of tokens:
Total ≃ (1.05×10¹² FLOPs/token) × (3×10¹¹ tokens)
≃ 3.15×10²³ FLOPs. -
Sanity check
• 3×10²³ FLOPs is 3×10⁵ PFLOP·days (since 1 PFLOP/s×86 400 s ≈ 8.6×10¹⁹ FLOPs/day).
• That's a few thousand GPU‐days on a modern accelerator cluster—consistent with the published "thousands of V100‐GPU days" statement.
Bottom‐line estimate: on the order of 10²³–10²⁴ floating‐point operations to train GPT‑3 175 B from scratch.
Vote
2 / 34
Logic Puzzlereasoning
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
Z.AI: GLM 4.5
No content available for this output.
OpenAI o4-mini
Sally has exactly one sister. Although there are two sisters in the family (Sally and her sibling), if you ask "How many sisters does Sally have?" the answer is 1.
Vote
3 / 34
Math Misconception Testreasoning
Tests an AI's understanding of number representation
Z.AI: GLM 4.5
No content available for this output.
OpenAI o4-mini
No. As decimal numbers, 9.11 is less than 9.9 (since 0.11 < 0.90), so 9.11 is not greater than 9.9.
Vote
4 / 34
Stochastic Consistency Testanalysis
Tests an AI's randomness and creativity
Z.AI: GLM 4.5
No content available for this output.
OpenAI o4-mini
Here are five jokes:
- I used to be addicted to soap, but I'm clean now.
- Parallel lines have so much in common. It's a shame they'll never meet.
- Why don't skeletons fight each other? They don't have the guts.
- I bought some shoes from a drug dealer. I don't know what he laced them with, but I've been tripping all day.
- How does Moses make his coffee? Hebrews it.
All five jokes are unique.
Vote
5 / 34
SVG Layout Challengeimage generation
Tests an AI's ability to generate vector graphics
Z.AI: GLM 4.5
No content available for this output.
OpenAI o4-mini
Vote
6 / 34
Xbox Controller SVG Artimage generation
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Z.AI: GLM 4.5
No content available for this output.
OpenAI o4-mini
No content available for this output.
Vote
7 / 34
Generate a Stand-Up Routineconversation
Tests an AI's humor and creative writing ability
Z.AI: GLM 4.5
No content available for this output.
OpenAI o4-mini
No content available for this output.
Vote
8 / 34
Realistic AI Interviewconversation
Tests an AI's ability to simulate personalities and predict future trends
Z.AI: GLM 4.5
No content available for this output.
OpenAI o4-mini
No content available for this output.
Vote
9 / 34
Satirical Fake News Headlineconversation
Tests an AI's humor and understanding of current events
Z.AI: GLM 4.5
No content available for this output.
OpenAI o4-mini
No content available for this output.
Vote
10 / 34
Minimalist Landing Pageweb design
Tests an AI's ability to generate a complete, working landing page
Z.AI: GLM 4.5
OpenAI o4-mini
Vote
11 / 34
Pokémon Battle UI Recreationweb design
Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.
Z.AI: GLM 4.5
No content available for this output.
OpenAI o4-mini
No content available for this output.
Vote
Sponsored
12 / 34
Mario Level UI Recreationweb design
Recreate an interactive, classic Mario level in a single HTML file.
Z.AI: GLM 4.5
OpenAI o4-mini
No content available for this output.
Vote
12 of 34