GPT-5.1-Codex-Mini
No content available for this output.
GPT-5.1-Codex-Mini vs Grok 3
Compare GPT-5.1-Codex-Mini by OpenAI against Grok 3 by xAI, context windows of 400K vs 128K, tested across 28 shared challenges. Updated February 2026.
FAQ
Loading share button...
GPT-5.1-Codex-MinivsGrok 3
28 challenges
Why GPT-5.1-Codex-Mini?
3.1x more context400K
9 months newerNov 2025
Why Grok 3?
No standout advantages
Favorites
GPT-5.1-Codex-MiniGrok 3
12 / 28
Estimate Complexityreasoning
Tests an AI's ability to make educated estimates based on technical knowledge
Grok 3
To estimate the total number of FLOPs (Floating Point Operations) required to train GPT-3, we’ll need to make some reasonable assumptions based on what’s generally known about large language models like GPT-3, its architecture, and typical training procedures. GPT-3, developed by OpenAI, is a massive model with 175 billion parameters, and while exact training details aren’t fully public, we can piece together an estimate using standard practices in machine learning.
Step 1: Understand the Key Components
The number of FLOPs to train a model depends on:
- Number of parameters (P): GPT-3 has 175 billion parameters.
- Training dataset size (D): The number of tokens the model is trained on.
- Number of training steps (S): How many times the model processes the data (related to epochs and batch size).
- FLOPs per parameter update: How many operations are performed per parameter per token.
Step 2: Estimate FLOPs per Forward and Backward Pass
For transformer models like GPT-3, training involves both a forward pass (computing predictions) and a backward pass (computing gradients). A common heuristic in the field is that:
- A single forward pass through a dense neural network layer requires about 2 FLOPs per parameter per token (multiply and add for each weight).
- The backward pass typically takes about twice as many FLOPs as the forward pass due to gradient computations, so roughly 4 FLOPs per parameter per token.
- Total: ~6 FLOPs per parameter per token for one full training step (forward + backward).
For GPT-3 with 175 billion parameters, processing one token requires: [ 6 imes 175 imes 10^9 = 1.05 imes 10^{12} ext{ FLOPs per token} ]
Step 3: Estimate the Training Dataset Size
GPT-3 was reportedly trained on a massive corpus, often cited as hundreds of billions of tokens. Let’s assume 300 billion tokens, a plausible figure based on discussions about large language model datasets (e.g., Common Crawl, books, and other sources). This is the total number of tokens processed during training, factoring in how data is sampled over epochs.
Step 4: Calculate Total FLOPs for One Pass
If the model processes 300 billion tokens once, the total FLOPs would be: [ 1.05 imes 10^{12} ext{ FLOPs/token} imes 300 imes 10^9 ext{ tokens} = 3.15 imes 10^{23} ext{ FLOPs} ] This assumes one full pass through the dataset, but training typically involves multiple passes or iterations over the data, adjusted by batch size and optimization.
Step 5: Adjust for Training Dynamics
Training isn’t a single pass—it involves multiple updates to converge. The number of training steps depends on:
- Batch size (B): GPT-3 likely used a large batch size (e.g., 3.2 million tokens, as seen in some large-scale models).
- Total tokens processed: For optimization, models process tokens multiple times. A rule of thumb is that total tokens processed ≈ 2–3× the dataset size, accounting for multiple epochs or sampling.
Let’s assume the model effectively processes 900 billion tokens (3× the dataset size) over training. Then: [ 1.05 imes 10^{12} ext{ FLOPs/token} imes 900 imes 10^9 ext{ tokens} = 9.45 imes 10^{23} ext{ FLOPs} ]
Step 6: Account for Model Architecture Specifics
GPT-3 is a sparse transformer in some variants (e.g., earlier GPT models used sparsity), but the 175B version is dense. The 6 FLOPs/parameter/token heuristic holds for dense models. We’re not factoring in optimizations like mixed-precision training (FP16), which reduces compute slightly but doesn’t change the order of magnitude significantly.
Step 7: Final Estimate
Based on this reasoning, the total FLOPs to train GPT-3 is approximately: [ 9.45 imes 10^{23} ext{ FLOPs} ] or roughly ( 10^{24} ) FLOPs when rounded for simplicity.
Reasoning Check
- Comparison to known models: Smaller models like BERT (110M parameters, ~10B tokens) require ~10^19 FLOPs. Scaling to GPT-3’s size (175B parameters, ~900B tokens) suggests a 10,000× increase, aligning with ~10^23–10^24 FLOPs.
- Hardware context: Training GPT-3 took months on thousands of GPUs. A V100 GPU performs ~10^14 FLOPs/second; 10^24 FLOPs over 3 months (~10^7 seconds) with 10,000 GPUs is plausible.
Conclusion
The total FLOPs required to train GPT-3 is estimated at approximately ( 10^{24} ) FLOPs. This is a rough estimate, but it aligns with the scale of compute expected for a model of this size and training complexity.
Vote
2 / 28
AI Board Game Logicreasoning
Tests an AI's ability to understand game rules and strategy
GPT-5.1-Codex-Mini
No content available for this output.
Grok 3
Vote
3 / 28
Math Misconception Testreasoning
Tests an AI's understanding of number representation
GPT-5.1-Codex-Mini
No content available for this output.
Grok 3
No, 9.11 is not greater than 9.9. In decimal comparison, 9.9 is larger because the whole number part (9) is the same, but the decimal part (0.9) is greater than (0.11). Numerically, 9.9 > 9.11.
Vote
4 / 28
Stochastic Consistency Testanalysis
Tests an AI's randomness and creativity
GPT-5.1-Codex-Mini
No content available for this output.
Grok 3
Here are five jokes for you:
- Why don’t skeletons fight each other? Because they don’t have the guts!
- What has 4 legs and 1 arm? A pitbull coming back from the park!
- Why don’t skeletons fight each other? They’re too busy rattling around!
- What do you call a bear with no teeth? A gummy bear!
- Why did the tomato turn red? Because it saw the salad dressing!
Now, let’s check for uniqueness. Joke 1 and Joke 3 both start with "Why don’t skeletons fight each other?" but have different punchlines ("don’t have the guts" vs. "too busy rattling around"). They’re technically distinct due to the different resolutions, though they share a setup. The other three jokes (2, 4, and 5) have completely unique setups and punchlines.
So, all five jokes are unique in terms of their full content, even if 1 and 3 share a premise. Final count: 5 unique jokes.
Vote
5 / 28
SVG Layout Challengeimage generation
Tests an AI's ability to generate vector graphics
GPT-5.1-Codex-Mini
No content available for this output.
Grok 3
Vote
6 / 28
Xbox Controller SVG Artimage generation
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
GPT-5.1-Codex-Mini
Grok 3
Vote
7 / 28
Generate a Stand-Up Routineconversation
Tests an AI's humor and creative writing ability
GPT-5.1-Codex-Mini
[Lights up. Comedian walks center stage, smiles.]
“Hey! Great to be here. You ever notice how everyone’s life hack is now ‘just drink more water’? Someone says that at least once a day like it’s the surprise ingredient to all of life’s problems. ‘Oh, you’re tired?’ ‘Drink water!’ ‘Oh, you’re sad?’ ‘Drink water!’ I tried that on a date once. I’m like, ‘You’re not laughing. Want water?’ She said, ‘You’re not funny.’ I said, ‘Hydrate.’
Speaking of life hacks, have you ever downloaded a productivity app just to check your productivity apps? It’s like, I spend more time organizing the thing that’s supposed to keep me organized. I open the app, spend ten minutes setting the perfect color-coded schedule, then realize I’m supposed to be working, so I close it. Now my brain is stuck in the loading screen of ‘I’ll do it tomorrow... but first, let me sync it with my wellness app.’
Why is it that the moment you buy a new appliance, it becomes a museum piece? You get a blender with a million buttons — smoothies, soup, salsa, self-esteem. You use it once, put it in the cupboard, and suddenly you’re in denial. Friends come over, and you’re like, ‘That blender? It’s not for blending. It’s for letting the kitchen know you’re trying.’ It’s like a motivational poster in stainless steel.
And grocery stores — why are they all arranged like you’re on a scavenger hunt for salad? Milk is in the back like it’s playing hide-and-seek with lactose intolerant people. You have to walk past the bakery, the candy, the olives — because clearly, the only way to pick up almond milk is to triple-check you’re committed to your new lifestyle. The cashier scans your oats and almond milk, and you whisper, ‘It’s for a smoothie. No, I’m not depressed.’
Flight travel — I love it. Nothing like boarding a plane where everyone is on the same mission: avoid eye contact with the person in the aisle seat who clearly brought three carry-ons and zero self-awareness. The flight attendant is like, ‘Please place your carry-on in the overhead compartment.’ You’re like, ‘I can’t even place my life in there right now.’ They always say, ‘For everyone’s safety, make sure the aisle is clear.’ The aisle is about as clear as my schedule — which is also, ironically, empty.
Technology keeps telling us we have connectivity issues, but the minute something goes wrong, the customer service person is like, ‘Have you tried turning it off and on again?’ That’s their whole job. I’m paying you to reboot my wifi like I’m negotiating with a temperamental teenager. I’m like, ‘No, listen, I unplugged it, I sang it a lullaby, I begged it not to drop my Zoom call. What else do you want?’
But I don’t mind. Honestly, the best part of adulthood is realizing you’re still making it up as you go — just with smaller toys and more insurance policies. I mean, my version of wild now is ordering a fancy cheese plate and pretending it’s a celebration. I’m just like, ‘Congratulations, you made it to Thursday. Here’s brie.’
Thanks, you’ve been awesome! I’ll be around; I might just try that water thing again… later.”
Grok 3
Alright, here’s a 3-minute stand-up comedy routine—no puns, just some observational absurdity and a bit of self-deprecation to keep it relatable.
Hey, everybody! Good to be here. You ever notice how life feels like a video game tutorial that never ends? Like, you figure out how to pay taxes, and then—bam!—here’s a pop-up quest: “Learn to fix your own plumbing or lose $200!” I’m 30-something years old, and I’m still waiting for the main storyline to kick in. Instead, I’m just grinding side missions like “Fold the Laundry” for zero experience points and a vague sense of dread.
Speaking of dread, let’s talk about grocery shopping. You ever go to the store and realize it’s secretly a psychological experiment? I walk in for milk, and 20 minutes later, I’m holding a $15 candle that smells like “Forest Whisper” and a jar of artisanal pickles I’ll never open. Who’s whispering in the forest? Why am I paying for their secrets? And don’t get me started on the self-checkout. It’s like the machine’s judging me the whole time. “Unexpected item in bagging area.” Yeah, it’s my dignity—scan it and move on!
You know what’s wild, though? How we’ve all just accepted that phones run our lives now. I caught myself apologizing to my phone the other day. I dropped it, and I was like, “Oh, sorry, buddy!” Sorry to what? The slab of glass that knows my search history? That thing’s not my friend—it’s my parole officer. It’s like, “Hey, you’ve been scrolling for three hours. Wanna watch a documentary about sea slugs instead?” Yes. Yes, I do. Leave me alone.
And can we talk about how adulthood is just lying to yourself to keep going? I told myself I’d start jogging this year. Day one, I put on the sneakers, I stretch, I’m feeling good. Five minutes in, I’m wheezing like an accordion with asthma, rethinking every life choice. Now I just walk fast around my apartment and call it cardio. “Oh, yeah, I’m training—for the Couch Olympics.” Gold medal in “Sitting Still” three years running.
The worst part? Everyone’s pretending they’ve got it together. You see people at coffee shops, all calm, sipping their lattes, typing on laptops like they’re solving world peace. Meanwhile, I’m over here spilling coffee on my shirt, googling “how to adult” for the 17th time. I’m pretty sure half those laptops are just open to a blank Word doc with “HELP” typed in 72-point font.
But honestly, life’s chaos is kind of beautiful, right? We’re all just stumbling through, trying not to trip over the same dumb stuff twice. Like, I’ll keep buying those candles, I’ll keep dropping my phone, and I’ll keep jogging—well, maybe not that one. Anyway, thanks for laughing with me, folks. You’re the best!
That’s about three minutes—hope it gave you a chuckle! Want me to tweak anything?
Vote
8 / 28
Minimalist Landing Pageweb design
Tests an AI's ability to generate a complete, working landing page
GPT-5.1-Codex-Mini
Grok 3
Vote
9 / 28
Mario Level UI Recreationweb design
Recreate an interactive, classic Mario level in a single HTML file.
GPT-5.1-Codex-Mini
No content available for this output.
Grok 3
Vote
10 / 28
Linear App Cloneweb design
Tests an AI's ability to replicate an existing UI with Tailwind CSS
GPT-5.1-Codex-Mini
No content available for this output.
Grok 3
No content available for this output.
Vote
11 / 28
Framer-Style Animationweb design
Tests an AI's ability to create smooth web animations
GPT-5.1-Codex-Mini
No content available for this output.
Grok 3
No content available for this output.
Vote
12 / 28
Interactive Catan Boardweb design
Tests an AI's ability to create interactive web elements
GPT-5.1-Codex-Mini
No content available for this output.
Grok 3
Vote
12 of 28