Estimate Complexity

Models tested:Amazon Nova 2 Lite Aurora Alpha Bert-Nebulon Alpha Claude 3 Haiku Claude 3.7 Sonnet Claude 3.7 Thinking Sonnet Claude Fable 5 Claude Haiku 4.5 Claude Opus 4 Claude Opus 4.1 Claude Opus 4.5 Claude Opus 4.6 Claude Opus 4.7 Claude Opus 4.8 Claude Opus 5 Claude Sonnet 3.6 (2022-10-22)Claude Sonnet 4 Claude Sonnet 4.5 Claude Sonnet 4.6 Claude Sonnet 5 Cypher Alpha (free)DeepSeek R1 DeepSeek R1 0528 DeepSeek V3 (March 2024)DeepSeek V3.1 DeepSeek V3.2 DeepSeek V3.2 Exp DeepSeek V3.2 Speciale DeepSeek V4 Flash DeepSeek V4 Flash 0731 DeepSeek V4 Pro DeepSeek V4 Pro 0813 Devstral 2 2512 Dots3-Note Preview Elephant Alpha ERNIE 4.5 300B A47B Gemini 1.5 Pro Gemini 2.0 Flash Thinking Gemini 2.0 Pro Experimental Gemini 2.5 Flash Lite Preview 09-2025 Gemini 2.5 Flash Preview Gemini 2.5 Flash Preview 09-2025 Gemini 2.5 Pro (I/O Edition)Gemini 2.5 Pro Preview 06-05 Gemini 3 Flash Preview Gemini 3 Pro Preview Gemini 3.1 Flash Lite Gemini 3.1 Flash Lite Preview Gemini 3.1 Pro Preview Gemini 3.5 Flash Gemini 3.6 Flash Gemini 3.7 Flash Gemini Pro 1.0 Gemma 3 12B Gemma 3 27B Gemma 3n 4B Gemma 4 26B A4B Gemma 4 31B GLM 4 32B GLM 4.5 GLM 4.5 Air GLM 4.6 GLM 4.7 GLM 4.7 Flash GLM 5 GLM 5 Turbo GLM 5.1 GLM 5.2 GPT OSS 120B GPT OSS 20B GPT-3.5 Turbo GPT-4.1 GPT-4.1 Mini GPT-4.1 Nano GPT-4.5 GPT-4o (Omni)GPT-4o mini GPT-5 GPT-5 Codex GPT-5 Mini GPT-5 Nano GPT-5 Pro GPT-5.1 GPT-5.1 Chat GPT-5.1 Codex Max GPT-5.1-Codex GPT-5.1-Codex-Mini GPT-5.2 GPT-5.2 Chat GPT-5.2 Pro GPT-5.3 Chat GPT-5.3-Codex GPT-5.4 GPT-5.4 Mini GPT-5.4 Nano GPT-5.5 GPT-5.6 Luna GPT-5.6 Luna Pro GPT-5.6 Sol GPT-5.6 Terra Grok 3 Grok 3 Beta Grok 3 Thinking Grok 4 Grok 4 Fast (free)Grok 4.1 Fast Grok 4.20 Beta Grok 4.20 Multi-Agent Beta Grok 4.3 Grok 4.5 Grok 4.6 Grok Code Fast 1 Healer Alpha Horizon Alpha Horizon Beta Hunter Alpha Inkling INTELLECT-3 Kimi K2 Kimi K2 0905 Kimi K2 Thinking Kimi K2.5 Kimi K2.6 Kimi K2.7 Code Kimi K3 Kimi Linear 48B A3B Instruct LFM2.5-2.6B Ling 2.6 1T Ling 2.6 Flash Llama 3 70B Llama 3.1 70B (Instruct)Llama 4 Maverick Llama 4 Scout Mercury Mercury 2 MiMo-V2-Flash MiMo-V2-Omni MiMo-V2-Pro MiMo-V2.5 MiMo-V2.5-Pro MiniMax M1 MiniMax M2 MiniMax M2-her MiniMax M2.1 MiniMax M2.5 MiniMax M2.7 MiniMax M3 Mistral Devstral Medium Mistral Devstral Small 1.1 Mistral Large Mistral Large 3 2512 Mistral Medium 3 Mistral Medium 3.1 Mistral Nemo Mistral Small 4 Mistral Small Creative Muse Spark 1.1 Nemotron 3 Ultra Nemotron 3.5 Content Safety Nemotron 3.5 Lightning North Mini Code Nova Premier 1.0 NVIDIA Nemotron 3 Super (free)NVIDIA Nemotron Nano 9B V2 o1 o3 Mini OpenAI o3 OpenAI o4 Mini High OpenAI o4-mini OpenRouter Fusion · Budget (Jun 2026)OpenRouter Fusion · Quality (Jun 2026)Optimus Alpha Owl Alpha Ox Alpha PaLM 2 Chat Polaris Alpha Pony Alpha Qwen Plus 0728 Qwen Plus 0728 (thinking)Qwen3 235B A22B Qwen3 235B A22B 2507 Qwen3 235B A22B Thinking 2507 Qwen3 30B A3B Qwen3 30B A3B Instruct 2507 Qwen3 30B A3B Thinking 2507 Qwen3 Coder Qwen3 Coder Flash Qwen3 Coder Next Qwen3 Coder Plus Qwen3 Max Qwen3 Max Thinking Qwen3 Next 80B A3B Instruct Qwen3 Next 80B A3B Thinking Qwen3.5 122B A10B Qwen3.5 27B Qwen3.5 35B A3B Qwen3.5 397B A17B Qwen3.5 9B Qwen3.5 Flash Qwen3.5 Plus 2026-02-15 Qwen3.5 Plus 2026-04-20 Qwen3.6 27B Qwen3.6 35B A3B Qwen3.6 Flash Qwen3.6 Max Preview Qwen3.6 Plus Preview (free)Qwen3.7 Max Qwen3.7 Plus Qwen3.8 2.4T A95B Qwen3.8 27B Ring 2.6 1T Seed 2.0 Code Seed 2.0 Lite Seed 2.1 Turbo Sherlock Dash Alpha Sherlock Think Alpha Solar Pro 3 Sonar Pro Search Sonoma Dusk Alpha Sonoma Sky Alpha TNG R1T Chimera Trinity Large Preview

Single-shot · temp 0.7 · real votes · identical prompts·How we test →

Loading...

Best AI for:Complex Reasoning Mathematics Word Problems

Top Performers: Estimate Complexity

May 2024 – Aug 2026

#1Qwen3.6 27B81% win rateHigh confidence

#2Qwen3.7 Max81% win rateMed confidence

#3GLM 4.5 Air74% win rateHigh confidence

Models tested:Amazon Nova 2 Lite Aurora Alpha Bert-Nebulon Alpha Claude 3 Haiku Claude 3.7 Sonnet Claude 3.7 Thinking Sonnet Claude Fable 5 Claude Haiku 4.5 Claude Opus 4 Claude Opus 4.1 Claude Opus 4.5 Claude Opus 4.6 Claude Opus 4.7 Claude Opus 4.8 Claude Opus 5 Claude Sonnet 3.6 (2022-10-22)Claude Sonnet 4 Claude Sonnet 4.5 Claude Sonnet 4.6 Claude Sonnet 5 Cypher Alpha (free)DeepSeek R1 DeepSeek R1 0528 DeepSeek V3 (March 2024)DeepSeek V3.1 DeepSeek V3.2 DeepSeek V3.2 Exp DeepSeek V3.2 Speciale DeepSeek V4 Flash DeepSeek V4 Flash 0731 DeepSeek V4 Pro DeepSeek V4 Pro 0813 Devstral 2 2512 Dots3-Note Preview Elephant Alpha ERNIE 4.5 300B A47B Gemini 1.5 Pro Gemini 2.0 Flash Thinking Gemini 2.0 Pro Experimental Gemini 2.5 Flash Lite Preview 09-2025 Gemini 2.5 Flash Preview Gemini 2.5 Flash Preview 09-2025 Gemini 2.5 Pro (I/O Edition)Gemini 2.5 Pro Preview 06-05 Gemini 3 Flash Preview Gemini 3 Pro Preview Gemini 3.1 Flash Lite Gemini 3.1 Flash Lite Preview Gemini 3.1 Pro Preview Gemini 3.5 Flash Gemini 3.6 Flash Gemini 3.7 Flash Gemini Pro 1.0 Gemma 3 12B Gemma 3 27B Gemma 3n 4B Gemma 4 26B A4B Gemma 4 31B GLM 4 32B GLM 4.5 GLM 4.5 Air GLM 4.6 GLM 4.7 GLM 4.7 Flash GLM 5 GLM 5 Turbo GLM 5.1 GLM 5.2 GPT OSS 120B GPT OSS 20B GPT-3.5 Turbo GPT-4.1 GPT-4.1 Mini GPT-4.1 Nano GPT-4.5 GPT-4o (Omni)GPT-4o mini GPT-5 GPT-5 Codex GPT-5 Mini GPT-5 Nano GPT-5 Pro GPT-5.1 GPT-5.1 Chat GPT-5.1 Codex Max GPT-5.1-Codex GPT-5.1-Codex-Mini GPT-5.2 GPT-5.2 Chat GPT-5.2 Pro GPT-5.3 Chat GPT-5.3-Codex GPT-5.4 GPT-5.4 Mini GPT-5.4 Nano GPT-5.5 GPT-5.6 Luna GPT-5.6 Luna Pro GPT-5.6 Sol GPT-5.6 Terra Grok 3 Grok 3 Beta Grok 3 Thinking Grok 4 Grok 4 Fast (free)Grok 4.1 Fast Grok 4.20 Beta Grok 4.20 Multi-Agent Beta Grok 4.3 Grok 4.5 Grok 4.6 Grok Code Fast 1 Healer Alpha Horizon Alpha Horizon Beta Hunter Alpha Inkling INTELLECT-3 Kimi K2 Kimi K2 0905 Kimi K2 Thinking Kimi K2.5 Kimi K2.6 Kimi K2.7 Code Kimi K3 Kimi Linear 48B A3B Instruct LFM2.5-2.6B Ling 2.6 1T Ling 2.6 Flash Llama 3 70B Llama 3.1 70B (Instruct)Llama 4 Maverick Llama 4 Scout Mercury Mercury 2 MiMo-V2-Flash MiMo-V2-Omni MiMo-V2-Pro MiMo-V2.5 MiMo-V2.5-Pro MiniMax M1 MiniMax M2 MiniMax M2-her MiniMax M2.1 MiniMax M2.5 MiniMax M2.7 MiniMax M3 Mistral Devstral Medium Mistral Devstral Small 1.1 Mistral Large Mistral Large 3 2512 Mistral Medium 3 Mistral Medium 3.1 Mistral Nemo Mistral Small 4 Mistral Small Creative Muse Spark 1.1 Nemotron 3 Ultra Nemotron 3.5 Content Safety Nemotron 3.5 Lightning North Mini Code Nova Premier 1.0 NVIDIA Nemotron 3 Super (free)NVIDIA Nemotron Nano 9B V2 o1 o3 Mini OpenAI o3 OpenAI o4 Mini High OpenAI o4-mini OpenRouter Fusion · Budget (Jun 2026)OpenRouter Fusion · Quality (Jun 2026)Optimus Alpha Owl Alpha Ox Alpha PaLM 2 Chat Polaris Alpha Pony Alpha Qwen Plus 0728 Qwen Plus 0728 (thinking)Qwen3 235B A22B Qwen3 235B A22B 2507 Qwen3 235B A22B Thinking 2507 Qwen3 30B A3B Qwen3 30B A3B Instruct 2507 Qwen3 30B A3B Thinking 2507 Qwen3 Coder Qwen3 Coder Flash Qwen3 Coder Next Qwen3 Coder Plus Qwen3 Max Qwen3 Max Thinking Qwen3 Next 80B A3B Instruct Qwen3 Next 80B A3B Thinking Qwen3.5 122B A10B Qwen3.5 27B Qwen3.5 35B A3B Qwen3.5 397B A17B Qwen3.5 9B Qwen3.5 Flash Qwen3.5 Plus 2026-02-15 Qwen3.5 Plus 2026-04-20 Qwen3.6 27B Qwen3.6 35B A3B Qwen3.6 Flash Qwen3.6 Max Preview Qwen3.6 Plus Preview (free)Qwen3.7 Max Qwen3.7 Plus Qwen3.8 2.4T A95B Qwen3.8 27B Ring 2.6 1T Seed 2.0 Code Seed 2.0 Lite Seed 2.1 Turbo Sherlock Dash Alpha Sherlock Think Alpha Solar Pro 3 Sonar Pro Search Sonoma Dusk Alpha Sonoma Sky Alpha TNG R1T Chimera Trinity Large Preview

Single-shot · temp 0.7 · real votes · identical prompts·How we test →

Loading...

Best AI for:Complex Reasoning Mathematics Word Problems

Top Performers: Estimate Complexity

May 2024 – Aug 2026

#1Qwen3.6 27B81% win rateHigh confidence

#2Qwen3.7 Max81% win rateMed confidence

#3GLM 4.5 Air74% win rateHigh confidence

Single-shot · temp 0.7 · real votes · identical prompts·How we test →

HardReasoning

Estimate Complexity

A Fermi estimate with the reasoning shown, not just the number.

The Prompt

Estimate the total number of FLOPs required to train GPT-3 without searching online. Explain your reasoning step by step.

How the models did

222 found

Aurora AlphaEstimate Complexity

The model returned empty.

Feb 2026·Estimate Complexity~$0.0025

Bert-Nebulon AlphaEstimate Complexity

The model returned empty.

Nov 2025·Estimate Complexity8

Claude 3 HaikuEstimate Complexity

The model returned empty.

Mar 2026·Estimate Complexity$0.0008413

Claude Sonnet 3.6 (2022-10-22)Estimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0000915

Claude 3.7 Thinking SonnetEstimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0001939

Claude 3.7 SonnetEstimate Complexity

Models tested:Amazon Nova 2 Lite Aurora Alpha Bert-Nebulon Alpha Claude 3 Haiku Claude 3.7 Sonnet Claude 3.7 Thinking Sonnet Claude Fable 5 Claude Haiku 4.5 Claude Opus 4 Claude Opus 4.1 Claude Opus 4.5 Claude Opus 4.6 Claude Opus 4.7 Claude Opus 4.8 Claude Opus 5 Claude Sonnet 3.6 (2022-10-22)Claude Sonnet 4 Claude Sonnet 4.5 Claude Sonnet 4.6 Claude Sonnet 5 Cypher Alpha (free)DeepSeek R1 DeepSeek R1 0528 DeepSeek V3 (March 2024)DeepSeek V3.1 DeepSeek V3.2 DeepSeek V3.2 Exp DeepSeek V3.2 Speciale DeepSeek V4 Flash DeepSeek V4 Flash 0731 DeepSeek V4 Pro DeepSeek V4 Pro 0813 Devstral 2 2512 Dots3-Note Preview Elephant Alpha ERNIE 4.5 300B A47B Gemini 1.5 Pro Gemini 2.0 Flash Thinking Gemini 2.0 Pro Experimental Gemini 2.5 Flash Lite Preview 09-2025 Gemini 2.5 Flash Preview Gemini 2.5 Flash Preview 09-2025 Gemini 2.5 Pro (I/O Edition)Gemini 2.5 Pro Preview 06-05 Gemini 3 Flash Preview Gemini 3 Pro Preview Gemini 3.1 Flash Lite Gemini 3.1 Flash Lite Preview Gemini 3.1 Pro Preview Gemini 3.5 Flash Gemini 3.6 Flash Gemini 3.7 Flash Gemini Pro 1.0 Gemma 3 12B Gemma 3 27B Gemma 3n 4B Gemma 4 26B A4B Gemma 4 31B GLM 4 32B GLM 4.5 GLM 4.5 Air GLM 4.6 GLM 4.7 GLM 4.7 Flash GLM 5 GLM 5 Turbo GLM 5.1 GLM 5.2 GPT OSS 120B GPT OSS 20B GPT-3.5 Turbo GPT-4.1 GPT-4.1 Mini GPT-4.1 Nano GPT-4.5 GPT-4o (Omni)GPT-4o mini GPT-5 GPT-5 Codex GPT-5 Mini GPT-5 Nano GPT-5 Pro GPT-5.1 GPT-5.1 Chat GPT-5.1 Codex Max GPT-5.1-Codex GPT-5.1-Codex-Mini GPT-5.2 GPT-5.2 Chat GPT-5.2 Pro GPT-5.3 Chat GPT-5.3-Codex GPT-5.4 GPT-5.4 Mini GPT-5.4 Nano GPT-5.5 GPT-5.6 Luna GPT-5.6 Luna Pro GPT-5.6 Sol GPT-5.6 Terra Grok 3 Grok 3 Beta Grok 3 Thinking Grok 4 Grok 4 Fast (free)Grok 4.1 Fast Grok 4.20 Beta Grok 4.20 Multi-Agent Beta Grok 4.3 Grok 4.5 Grok 4.6 Grok Code Fast 1 Healer Alpha Horizon Alpha Horizon Beta Hunter Alpha Inkling INTELLECT-3 Kimi K2 Kimi K2 0905 Kimi K2 Thinking Kimi K2.5 Kimi K2.6 Kimi K2.7 Code Kimi K3 Kimi Linear 48B A3B Instruct LFM2.5-2.6B Ling 2.6 1T Ling 2.6 Flash Llama 3 70B Llama 3.1 70B (Instruct)Llama 4 Maverick Llama 4 Scout Mercury Mercury 2 MiMo-V2-Flash MiMo-V2-Omni MiMo-V2-Pro MiMo-V2.5 MiMo-V2.5-Pro MiniMax M1 MiniMax M2 MiniMax M2-her MiniMax M2.1 MiniMax M2.5 MiniMax M2.7 MiniMax M3 Mistral Devstral Medium Mistral Devstral Small 1.1 Mistral Large Mistral Large 3 2512 Mistral Medium 3 Mistral Medium 3.1 Mistral Nemo Mistral Small 4 Mistral Small Creative Muse Spark 1.1 Nemotron 3 Ultra Nemotron 3.5 Content Safety Nemotron 3.5 Lightning North Mini Code Nova Premier 1.0 NVIDIA Nemotron 3 Super (free)NVIDIA Nemotron Nano 9B V2 o1 o3 Mini OpenAI o3 OpenAI o4 Mini High OpenAI o4-mini OpenRouter Fusion · Budget (Jun 2026)OpenRouter Fusion · Quality (Jun 2026)Optimus Alpha Owl Alpha Ox Alpha PaLM 2 Chat Polaris Alpha Pony Alpha Qwen Plus 0728 Qwen Plus 0728 (thinking)Qwen3 235B A22B Qwen3 235B A22B 2507 Qwen3 235B A22B Thinking 2507 Qwen3 30B A3B Qwen3 30B A3B Instruct 2507 Qwen3 30B A3B Thinking 2507 Qwen3 Coder Qwen3 Coder Flash Qwen3 Coder Next Qwen3 Coder Plus Qwen3 Max Qwen3 Max Thinking Qwen3 Next 80B A3B Instruct Qwen3 Next 80B A3B Thinking Qwen3.5 122B A10B Qwen3.5 27B Qwen3.5 35B A3B Qwen3.5 397B A17B Qwen3.5 9B Qwen3.5 Flash Qwen3.5 Plus 2026-02-15 Qwen3.5 Plus 2026-04-20 Qwen3.6 27B Qwen3.6 35B A3B Qwen3.6 Flash Qwen3.6 Max Preview Qwen3.6 Plus Preview (free)Qwen3.7 Max Qwen3.7 Plus Qwen3.8 2.4T A95B Qwen3.8 27B Ring 2.6 1T Seed 2.0 Code Seed 2.0 Lite Seed 2.1 Turbo Sherlock Dash Alpha Sherlock Think Alpha Solar Pro 3 Sonar Pro Search Sonoma Dusk Alpha Sonoma Sky Alpha TNG R1T Chimera Trinity Large Preview

The model returned empty.

Feb 2025·Estimate Complexity~$0.0000918

Loading...

Best AI for:Complex Reasoning Mathematics Word Problems

Top Performers: Estimate Complexity

May 2024 – Aug 2026

#1Qwen3.6 27B81% win rateHigh confidence

#2Qwen3.7 Max81% win rateMed confidence

#3GLM 4.5 Air74% win rateHigh confidence

Single-shot · temp 0.7 · real votes · identical prompts·How we test →

HardReasoning

Estimate Complexity

A Fermi estimate with the reasoning shown, not just the number.

The Prompt

Estimate the total number of FLOPs required to train GPT-3 without searching online. Explain your reasoning step by step.

How the models did

222 found

Aurora AlphaEstimate Complexity

The model returned empty.

Feb 2026·Estimate Complexity~$0.0025

Bert-Nebulon AlphaEstimate Complexity

The model returned empty.

Nov 2025·Estimate Complexity8

Claude 3 HaikuEstimate Complexity

The model returned empty.

Mar 2026·Estimate Complexity$0.0008413

Claude Sonnet 3.6 (2022-10-22)Estimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0000915

Claude 3.7 Thinking SonnetEstimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0001939

Claude 3.7 SonnetEstimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0000918

Loading...

HardReasoning

Estimate Complexity

A Fermi estimate with the reasoning shown, not just the number.

The Prompt

Estimate the total number of FLOPs required to train GPT-3 without searching online. Explain your reasoning step by step.

How the models did

222 found

Aurora AlphaEstimate Complexity

The model returned empty.

Feb 2026·Estimate Complexity~$0.0025

Bert-Nebulon AlphaEstimate Complexity

The model returned empty.

Nov 2025·Estimate Complexity8

Claude 3 HaikuEstimate Complexity

The model returned empty.

Mar 2026·Estimate Complexity$0.0008413

Claude Sonnet 3.6 (2022-10-22)Estimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0000915

Claude 3.7 Thinking SonnetEstimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0001939

Claude 3.7 SonnetEstimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0000918

HardReasoning

Estimate Complexity

A Fermi estimate with the reasoning shown, not just the number.

The Prompt

Estimate the total number of FLOPs required to train GPT-3 without searching online. Explain your reasoning step by step.

How the models did

222 found

Aurora AlphaEstimate Complexity

The model returned empty.

Feb 2026·Estimate Complexity~$0.0025

Bert-Nebulon AlphaEstimate Complexity

The model returned empty.

Nov 2025·Estimate Complexity8

Claude 3 HaikuEstimate Complexity

The model returned empty.

Mar 2026·Estimate Complexity$0.0008413

Claude Sonnet 3.6 (2022-10-22)Estimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0000915

Claude 3.7 Thinking SonnetEstimate Complexity

The model returned empty.

Feb 2025·Estimate Complexity~$0.0001939

Claude 3.7 SonnetEstimate Complexity