Compare Claude 3 Haiku and Claude Sonnet 3.6 (2022-10-22), both from Anthropic, context windows of 200K vs 200K, tested across 29 shared challenges. Updated February 2026.
24 challenges
Tests an AI's randomness and creativity
Here are 5 jokes:
Why can't a bicycle stand up on its own? It's two-tired!
Why do cows wear bells? Their horns don't work!
Why can't a bike stand up by itself? It's two-tired!
Why do cows wear tags? Because their horns don't work!
Why do cows have hooves? Because they lactose!
Out of these 5 jokes, only 4 are unique. The first and third jokes are the same, just with a slight variation in wording.
Let me help you write code to generate jokes and check their uniqueness. Here's a Python script that does this:
import random
# List of sample jokes
jokes = [
"Why don't scientists trust atoms? Because they make up everything!",
"What do you call a bear with no teeth? A gummy bear!",
"Why did the scarecrow win an award? He was outstanding in his field!",
"What do you call a fake noodle? An impasta!",
"Why did the cookie go to the doctor? Because it was feeling crumbly!",
"What do you call a can opener that doesn't work? A can't opener!",
"Why don't eggs tell jokes? They'd crack up!",
]
# Generate 5 random jokes
selected_jokes = random.sample(jokes, 5)
# Print the jokes and count unique ones
print("Generated jokes:")
for i, joke in enumerate(selected_jokes, 1):
print(f"{i}. {joke}")
unique_jokes = len(set(selected_jokes))
print(f"\nNumber of unique jokes: {unique_jokes}")
When you run this code, it will:
Since we're using random.sample(), which selects items without replacement, all 5 jokes will always be unique (unique_jokes will always be 5). If you wanted to allow for potential duplicates, you could use random.choices() instead.
Would you like me to modify the code to allow for potential duplicates in the selection?
Tests an AI's ability to generate vector graphics
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Tests an AI's humor and creative writing ability
Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.
Recreate an interactive, classic Mario level in a single HTML file.
Tests an AI's ability to create smooth web animations
Tests an AI's ability to engage in philosophical discourse about AI rights
Generate a single-page, self-contained HTML webapp using Tailwind CSS for a randomly chosen category/industry/niche.
Generate SVG art of a randomly chosen animal in a setting of its choosing.
Generate a unique and simple recipe with common ingredients.