Compare Claude Sonnet 4.5 by Anthropic against MiniMax M2.5 by MiniMax, context windows of 200K vs 205K, tested across 42 shared challenges. Updated February 2026.
37 challenges
Tests an AI's ability to make educated estimates based on technical knowledge
To estimate the total number of floating-point operations (FLOPs) required to train GPT-3, we use the standard approximation that training a transformer model requires approximately 6 FLOPs per parameter per token. This accounts for both the forward and backward passes, with each parameter involved in roughly 6 operations per token.
This estimate aligns with commonly cited values in the literature. The quadratic attention term (arising from the sequence length) adds a negligible contribution (less than 2%) and is ignored.
Thus, the total FLOPs required to train GPT-3 is approximately (3.15 \times 10^{23}).
\boxed{3.15\times 10^{23}\ \text{FLOPs}}
Tests an AI's ability to understand game rules and strategy
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
Sally has 1 sister.
Explanation
If each brother sees 2 sisters, the total number of girls in the family must be 2. Since Sally is one of those girls, there must be exactly one other girl. Therefore, Sally has one sister.
Tests an AI's randomness and creativity
Here are five jokes for you:
Why did the developer go broke?
Because he used up all his cache.
I told my wife she was drawing her eyebrows too high. She looked surprised.
I guess she was “high‑browed” about it.
Why don’t scientists trust atoms?
Because they make up everything.
What do you call a fake noodle?
An impasta.
I used to be a banker, but I lost interest.
Now I’m just a little “capital”‑ist.
How many are unique? All five jokes are distinct, so there are 5 unique jokes.
Tests an AI's ability to generate vector graphics
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Tests an AI's humor and creative writing ability
Tests an AI's ability to write in distinct character voices
Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.
Recreate an interactive, classic Mario level in a single HTML file.
Tests an AI's ability to replicate an existing UI with Tailwind CSS
Tests an AI's ability to create smooth web animations
