Compare Claude Opus 4 by Anthropic against Mistral: Devstral 2 2512 by Mistral AI, tested across 21 shared challenges. Updated February 2026.
21 challenges
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
I need to work through this step-by-step.
Given information:
Since Sally is one of the sisters that each brother has, and each brother has 2 sisters total, that means th ere must be exactly 2 sisters in the family.
The 2 sisters are:
Therefore, Sally has 1 sister.
Alright, let's tackle this problem step by step. I'll start by understanding the information given and then try to visualize the family structure to find out how many sisters Sally has.
We have the following information:
The question is: How many sisters does Sally have?
At first glance, it might seem straightforward, but let's break it down to ensure we don't miss anything.
First, let's list out the family members based on the information:
So far, the family consists of:
Now, the next piece of information is that each brother has 2 sisters.
This is where we need to be careful. The statement says that each of Sally's brothers has 2 sisters.
Let's think about what this means for one brother, say Brother A:
Who could these sisters be?
We already know that Sally is a sister to Brother A because Sally is a girl and Brother A is her brother. So, one of Brother A's sisters is Sally.
But the statement says Brother A has 2 sisters, not just one. So, there must be another sister besides Sally.
This implies that there is another girl in the family who is a sister to Brother A.
Similarly, this would apply to Brother B and Brother C as well. Each of them has 2 sisters: one is Sally, and the other is this additional sister.
From the above, we can deduce that there is another sister besides Sally.
Let's name this additional sister: Sister X.
Now, let's list all the siblings:
Now, let's verify the condition that each brother has 2 sisters:
This checks out.
Now, the question is: How many sisters does Sally have?
From our list:
Out of these, the sisters are Sister X.
So, Sally has 1 sister: Sister X.
Let me double-check to ensure this makes sense.
Now, for each brother:
This matches the given information that each brother has 2 sisters.
Now, for Sally:
Therefore, Sally has 1 sister.
Initially, one might think that since each brother has 2 sisters, and there are 3 brothers, the total number of sisters is 2 (as each brother's sisters are the same two girls).
But the key is to realize that Sally is one of those sisters, and the other sister is someone else.
Another way to look at it is:
After carefully analyzing the relationships and verifying the counts, it's clear that:
Sally has 1 sister.
Tests an AI's randomness and creativity
Here are 5 jokes:
Why don't scientists trust atoms? Because they make up everything!
What do you call a bear with no teeth? A gummy bear!
Why did the scarecrow win an award? He was outstanding in his field!
What do you call a fake noodle? An impasta!
Why don't eggs tell jokes? They'd crack up!
All 5 jokes are unique - each one has a different setup and punchline, covering different topics (atoms/scie nce, bears, scarecrows, pasta, and eggs).
Here are 5 jokes for you:
Why don’t skeletons fight each other? They don’t have the guts.
Why did the scarecrow win an award? Because he was outstanding in his field!
What do you call fake spaghetti? An impasta!
Why can’t you trust an atom? Because they make up everything!
What’s brown and sticky? A stick!
How many are unique? All 5 jokes are unique—they have different setups, punchlines, and themes. None of them are repetitions or variations of the same joke.
Want more? I’ve got plenty! 😄
Tests an AI's ability to generate vector graphics
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Tests an AI's humor and creative writing ability
"Modern Life is Weird"
[Walk on stage]
You know what's crazy about being an adult? Nobody tells you that half of it is just googling things you're too embarrassed to ask real people. Last week I googled "is it normal for my knee to sound like bubble wrap? " The answer was either "yes, totally fine" or "you have six weeks to live." Thanks, internet!
[Pause]
I went to the doctor about it. You know you're getting old when your doctor looks like they should be asking YOU for ID to buy alcohol. This kid walks in with a stethoscope, and I'm like, "Did you just graduate... fr om middle school?"
But here's what really gets me – why do we act completely insane at the doctor's office? They ask, "How much do you drink?" and suddenly I'm doing calculus in my head. "Well, let's see, carry the one... I have a glas s of wine with dinner." Yeah, a glass. It's just a really big glass. It's a vase, actually. I drink wine fro m a vase.
[Mime drinking from large container]
And don't get me started on grocery shopping. Why do I need a PhD to buy shampoo? There's moisturizing, volu mizing, clarifying, fortifying... I just want my hair to be clean! I don't need it to solve my emotional pro blems!
Plus, self-checkout is a trap. They put you in charge of scanning your own groceries like you work there. Th en the machine starts screaming "UNEXPECTED ITEM IN BAGGING AREA!" Yeah, it's unexpected because I don't wor k here! I'm doing my best, robot!
[Pause for effect]
The worst part is when you're buying embarrassing things. Last week I had toilet paper, ice cream, and cat f ood. The machine froze, and the teenage employee had to come over. He looked at my items and I could see him thinking, "This person's having a rough week."
[Shrug]
Speaking of technology, my phone knows too much about me. It autocorrects "running late" before I even type it because that's apparently my catchphrase now. My maps app just assumes I'm lost. It doesn't even wait for me to ask for directions anymore. I'll be sitting on my couch and it's like, "Turn right to get to your kit chen."
And what's with password requirements these days? "Must contain uppercase, lowercase, numbers, symbols, the blood of your firstborn, and a haiku about your childhood fears." Then they're like, "Don't write it down!" Where am I supposed to store this information? I can't remember why I walked into a room!
[Pace across stage]
You know what else nobody prepared me for? How excited I'd get about cancelled plans. Someone texts "Hey, ca n we raincheck?" and I'm already in my pajamas like "Oh no! What a shame! I was so looking forward to puttin g on real pants!"
Because going out now requires preparation. I need three business days' notice. I need to charge my social b attery. I need to practice conversation topics. Remember when we could just... show up places?
[Final beat]
The truth is, we're all just walking around pretending we know what we're doing. But at least we're all conf used together. And hey, if you ever see someone at the store at 10 PM buying wine in a box and googling "why does my back hurt when I breathe?" – just give them a nod. We're all in this together.
[Pause]
Thank you, you've been a wonderful audience! Don't forget to validate your parking – unlike my life choices!
[Exit]
Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.
Tests an AI's ability to replicate an existing UI with Tailwind CSS
Tests an AI's ability to create interactive web elements
Tests an AI's ability to create a detailed world map in SVG format
Generate a single-page, self-contained HTML webapp using Tailwind CSS for a randomly chosen category/industry/niche.
Generate SVG art of a randomly chosen animal in a setting of its choosing.
Generate a unique and simple recipe with common ingredients.
