Compare Claude Sonnet 4 by Anthropic against o1 by OpenAI, in 2 community votes, claude sonnet 4 wins 100% of head-to-head duels, context windows of 200K vs 128K, tested across 23 shared challenges. Updated February 2026.
In 2 community votes, Claude Sonnet 4 wins 100% of head-to-head duels. Based on blind community voting from the RIVAL open dataset of 2+ human preference judgments for this pair.
23 challenges
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
I need to think through this step-by-step.
Given information:
Let me work out how many sisters are in the family total.
If each of Sally's 3 brothers has 2 sisters, and all the brothers are in the same family, then there must be 2 sisters total in the family.
Since Sally is one of those sisters, and there are 2 sisters total, Sally must have 1 sister.
Therefore, Sally has 1 sister.
First, note that each of Sally’s three brothers has exactly two sisters. One of those sisters is clearly Sally. Since each brother’s two sisters must be the same two girls for all of them, there must be exactly one other sister besides Sally.
Therefore, Sally has 1 sister.
Tests an AI's understanding of number representation
Tests an AI's randomness and creativity
Tests an AI's ability to generate vector graphics
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Tests an AI's humor and creative writing ability
Recreate an interactive, classic Mario level in a single HTML file.
Tests an AI's ability to replicate an existing UI with Tailwind CSS
Tests an AI's ability to create interactive web elements
Tests an AI's ability to create a detailed world map in SVG format
Generate SVG art of a randomly chosen animal in a setting of its choosing.
Generate a unique and simple recipe with common ingredients.
