DeepSeek V3.1 vs Gemini 3 Flash Preview
Compare DeepSeek V3.1 by DeepSeek against Gemini 3 Flash Preview by Google AI, context windows of 164K vs 1.0M, tested across 51 shared challenges. Updated February 2026.
Compare DeepSeek V3.1 by DeepSeek against Gemini 3 Flash Preview by Google AI, context windows of 164K vs 1.0M, tested across 51 shared challenges. Updated February 2026.
46 challenges
Tests an AI's ability to make educated estimates based on technical knowledge
To estimate the total floating-point operations (FLOPs) required to train GPT-3, we can use a standard heuristic derived from the architecture of Transformer models.
Here is the step-by-step reasoning.
First, we need the two primary variables that determine training compute:
In deep learning, specifically for Transformers, there is a well-established "rule of thumb" for estimating training compute: $$\text{Compute (FLOPs)} \approx 6 \times N \times D$$
Why 6? The factor of 6 comes from the breakdown of the forward and backward passes:
Now, we plug in the values for GPT-3:
$$\text{Total FLOPs} = 6 \times (1.75 \times 10^{11}) \times (3.0 \times 10^{11})$$
Step-by-step multiplication:
$$\text{Total FLOPs} = 31.5 \times 10^{22}$$ $$\text{Total FLOPs} = 3.15 \times 10^{23}$$
The total estimated compute for training GPT-3 is $3.15 \times 10^{23}$ FLOPs.
To put $3.15 \times 10^{23}$ into perspective:
Note on accuracy: This estimate ignores the overhead of the "attention" mechanism (which scales with sequence length), but for models as large as GPT-3, the feed-forward and projection layers (represented by $N$) dominate the compute cost, making $6ND$ a very accurate approximation.
Tests an AI's ability to understand game rules and strategy
Tests an AI's ability to solve a simple but potentially confusing logic puzzle
Tests an AI's understanding of number representation
Tests an AI's randomness and creativity
Tests an AI's ability to generate vector graphics
Tests an AI's ability to create detailed SVG illustrations of gaming hardware
Tests an AI's humor and creative writing ability
Tests an AI's ability to simulate personalities and predict future trends
Tests an AI's humor and understanding of current events
Tests an AI's ability to write in distinct character voices
Tests an AI's ability to generate a complete, working landing page