Compare Claude Sonnet 4 by Anthropic against o3 Mini by OpenAI, context windows of 200K vs 64K, tested across 22 shared challenges. Updated February 2026.
22 challenges
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
I need to think through this step-by-step.
Given information:
Let me work out how many sisters are in the family total.
If each of Sally's 3 brothers has 2 sisters, and all the brothers are in the same family, then there must be 2 sisters total in the family.
Since Sally is one of those sisters, and there are 2 sisters total, Sally must have 1 sister.
Therefore, Sally has 1 sister.
Sally has 1 sister.
Explanation:
Sally's 3 brothers each have 2 sisters. Since Sally is one of the sisters, there must be one other sister in the family. Thus, aside from Sally, there is one more sister.
Tests an AI's understanding of number representation
Tests an AI's randomness and creativity
Tests an AI's ability to generate vector graphics
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Tests an AI's humor and creative writing ability
Recreate an interactive, classic Mario level in a single HTML file.
Tests an AI's ability to replicate an existing UI with Tailwind CSS
Tests an AI's ability to create interactive web elements
Tests an AI's ability to create a detailed world map in SVG format
Generate a unique and simple recipe with common ingredients.
Create a starter plan for improving long-term health.
