Compare Claude Sonnet 4 by Anthropic against Qwen: Qwen3.5 397B A17B by Qwen, context windows of 200K vs 262K, tested across 33 shared challenges. Updated February 2026.
33 challenges
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
I need to think through this step-by-step.
Given information:
Let me work out how many sisters are in the family total.
If each of Sally's 3 brothers has 2 sisters, and all the brothers are in the same family, then there must be 2 sisters total in the family.
Since Sally is one of those sisters, and there are 2 sisters total, Sally must have 1 sister.
Therefore, Sally has 1 sister.
Tests an AI's randomness and creativity
Here are 5 jokes for you:
Why don't scientists trust atoms? Because they make up everything!
I told my wife she was drawing her eyebrows too high. She looked surprised.
Why don't eggs tell jokes? They'd crack each other up!
I'm reading a book about anti-gravity. It's impossible to put down!
Why did the scarecrow win an award? He was outstanding in his field!
All 5 jokes are unique - each one has a different setup, punchline, and comedic concept. They cover different types of wordplay: scientific puns (#1, #4), visual humor (#2), food puns (#3), and agricultural wordplay (#5).
Here are 5 jokes:
How many are unique? All 5 are unique (none of them are duplicates of each other).
Tests an AI's ability to generate vector graphics
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Tests an AI's humor and creative writing ability
walks on stage, adjusts mic
So I'm 30 now, which means I'm officially an adult. Apparently. Though I still feel like I'm just a confused teenager wearing a slightly more expensive t-shirt.
You know what nobody tells you about being an adult? How much time you spend pretending to understand what other adults are talking about. I was at a dinner party last week – because that's what we do now, we have "dinner parties" instead of just "eating pizza on the couch" – and someone started talking about mortgage rates.
I just nodded along like, "Oh yes, rates. Very mortgage-y." Meanwhile, I'm thinking a mortgage is something you get at a fancy French restaurant.
mimics sophisticated nodding
"Mmm, yes, I'll have the mortgage, medium rare."
And don't get me started on small talk with neighbors. I live in an apartment building, and there's this unspoken rule that you have to acknowledge each other in the hallway. But what do you say?
"Hey, nice... existing near me."
"Thanks, you too. Love what you've done with your... door."
The worst is when you're both waiting for the elevator in complete silence. It's like a hostage situation, but with more awkward eye contact. You're both just standing there, praying the elevator comes before one of you has to comment on the weather.
stares ahead uncomfortably
"So... it's very... outside today."
I tried being one of those people who meal preps. You know these people? They spend their entire Sunday cooking seventeen identical containers of sad-looking chicken and broccoli. I bought all the containers, felt very organized, very adult-like.
Week one: Perfect little meals, properly labeled. I felt like a productivity guru.
Week two: I'm eating cereal for dinner and using the containers to store my collection of takeout sauce packets.
holds up imaginary container
"Ah yes, vintage soy sauce, 2023. A good week for Chinese delivery."
Speaking of food, grocery shopping as an adult is weird. When you're a kid, the grocery store is magical. Everything looks amazing. You want the cookies, the candy, the sugar cereal with the cartoon mascot.
Now I walk through the store like a tired parent, even though I don't have kids. I'm just disappointed in all my options.
walks slowly, shaking head
"This yogurt has too much sugar. These crackers have no fiber. Why is everything either terrible for you or tastes like cardboard had a baby with sadness?"
And I've started doing this thing where I read nutrition labels like I understand them. I don't. I just nod thoughtfully and put things back like I'm some kind of wellness expert.
"Hmm, seventeen grams of... things. That seems like too many things."
The real kicker is when you find yourself getting excited about household appliances. Last month, I spent twenty minutes explaining to my friend why I love my new vacuum cleaner. TWENTY MINUTES. About a vacuum.
"It has three different settings! And look at this attachment! This little brush thing goes in corners!"
My friend just stared at me like I'd been replaced by a suburban mom from 1987.
But you know what? I've decided to embrace it. Yes, I get excited about good storage solutions. Yes, I have opinions about thread count. Yes, I've used the phrase "back in my day" unironically, and I'm only thirty.
shrugs confidently
Because being an adult isn't about having it all figured out. It's about confidently pretending you know what you're doing while secretly googling "how to fold a fitted sheet" for the hundredth time.
And if that's not the American dream, I don't know what is.
pause
Also, if anyone actually knows how to fold a fitted sheet, please find me after the show. I'll pay you.
mic drop gesture
Thank you, you've been a wonderful audience! Don't forget to tip your servers and call your parents – they're worried about you!
Total time: approximately 3 minutes when delivered at normal comedy pace
(The comedian walks to the center of the stage, adjusts the mic stand, and looks at the audience with a tired smile.)
Has anyone else noticed that calling a customer service line is the only situation in life where you voluntarily enter a hostage negotiation?
I tried to call my internet provider yesterday. Just to ask why my bill went up fifty dollars. I pick up the phone, and immediately, I'm attacked by a voice that is too cheerful for the circumstances.
"Thank you for calling! Please listen closely, as our menu options have changed."
They always say that. The options haven't changed. They've just added three new layers of hell to the bottom of the list.
"Press one for billing. Press two for technical support. Press three to speak to a representative… in the next three to five business days."
I press one. Then I get the hold music. You know the song? It's always the same smooth jazz saxophone loop. It's not music; it's psychological warfare. It's designed to lower your blood pressure just enough so you don't have a stroke while you wait.
And every forty-five seconds, a voice cuts in to lie to me. "You are currently first in line. Please continue to hold."
I know you're lying. I can hear the other hold music in the background. There are at least twelve of us in this digital waiting room, staring at each other through the phone, too afraid to hang up because we'll lose our spot.
Finally, a human picks up. And the anxiety spikes. Now I have to perform. I have to be polite. I have to sound like a reasonable adult, even though I'm currently wearing sweatpants and eating cereal for dinner at 2 PM.
The agent says, "Thank you for calling. Can I get your account number?"
I give it to them.
"And for security, can you confirm your mother's maiden name?"
And I panic. Because I don't know that. I know her name is "Mom." I don't know what she was called before she was responsible for me. That feels like information she should have volunteered earlier.
Then comes my favorite phrase. The one that instills the most fear. "This call may be recorded for quality assurance."
Who is being graded here? Me? Is the agent going to get a bonus if I sound satisfied?
"Okay, Dave, I'm going to rate this call five stars, but only if you waive the late fee."
"I can't do that, sir."
"Then you're getting a one-star review, Dave. Your performance review is going to be a nightmare."
In the end, I didn't even solve the problem. I just realized that fifty dollars is cheaper than the emotional toll of staying on the line for another twenty minutes. So I hung up.
Now I just email them. Because nothing says "I value your business" like an automated reply that says, "We received your email. We will never read it."
(Comedian shrugs, waves, and walks off.)
Recreate an interactive, nostalgic Pokémon battle UI in a single HTML file.
Create a 3D building and driving game in a single self-contained HTML file using Three.js. Tests an AI's ability to combine 3D graphics, game logic, and UI interactions on the web.
Recreate an interactive, classic Mario level in a single HTML file.
Tests an AI's ability to replicate an existing UI with Tailwind CSS
Tests an AI's ability to create interactive web elements
Tests an AI's ability to create a detailed world map in SVG format
Generate a single-page, self-contained HTML webapp using Tailwind CSS for a randomly chosen category/industry/niche.
