whichLlmmodel
Back to Dashboard

AnthropicClaude Haiku 4.5VSGoogleGemini 3.1 Pro

Analysis by:the whichllmmodel Editorial Team|Updated: June 2026

Our Take

We recommend Gemini 3.1 Pro for complex complex codebases, multi-file repositories, and architectural planning, or the 2.3x cheaper Claude Haiku 4.5 if your budget requires optimizing costs for very high-volume pipelines. While Gemini 3.1 Pro offers a clear reasoning advantage, it carries a moderate price premium. Choose Gemini 3.1 Pro for architectural codebase planning, or Claude Haiku 4.5 to save on API costs for simple scripts.
WHY?
Benchmark Calculations & Evidence:
  • Coding Evaluation: Claude Haiku 4.5 was evaluated on SWE-bench Verified (scoring 73.3%), while Gemini 3.1 Pro was evaluated on SWE-bench Pro (scoring 54.2%).
  • Reasoning Accuracy: Both models were evaluated on the GPQA Diamond benchmark. Gemini 3.1 Pro scored 94.3%, while Claude Haiku 4.5 scored 73%.
  • Cost Efficiency: Claude Haiku 4.5 pricing ($1/M input, $5/M output) is 2.3x cheaper than Gemini 3.1 Pro ($2/M input, $12/M output).
  • Was this recommendation helpful?
    Model Specs

    Claude Haiku 4.5

    Benchmarks & Scores

    Coding (swe-bench-verified)
    73.3%

    multi-file code and clearly defined tasks

    Reasoning (gpqa-diamond)
    73%

    graduate-level science QA

    Cost & Context

    Cost (per 1M tokens)2.3x cheaper
    $2.00Input: $1.00 | Output: $5.00
    Context Window
    200k tokens
    Model Specs

    Gemini 3.1 Pro

    Benchmarks & Scores

    Coding (swe-bench-pro)
    54.2%

    complex codebases, multi-file repositories, and architectural planning

    Reasoning (gpqa-diamond)Winner (+21.3%)
    94.3%

    graduate-level science QA

    Cost & Context

    Cost (per 1M tokens)
    $4.50Input: $2.00 | Output: $12.00
    Context WindowLarger
    1.05M tokens

    Frequently Asked Questions about Claude Haiku 4.5 vs Gemini 3.1 Pro

    Claude Haiku 4.5 is cheaper than Gemini 3.1 Pro. Claude Haiku 4.5 has a blended cost of $2.00/1M tokens, which is about 2.3x cheaper than Gemini 3.1 Pro at $4.50/1M tokens.

    For coding tasks, Claude Haiku 4.5 scores 73.3% on swe-bench-verified (multi-file code and clearly defined tasks), while Gemini 3.1 Pro scores 54.2% on swe-bench-pro (complex codebases, multi-file repositories, and architectural planning).

    Do you want to find a model for your constraints?

    Use our interactive model finder to filter LLMs by reasoning capability, coding performance, cost, and context length.

    Open Model Finder