Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works

How smart is Gemma 3 27B?

77 SI-IQ · 90% interval 72–81
Rank 75 of 80 ranked models · Plausible rank range 74–79

Gemma 3 27B is a model from Google DeepMind, released on Mar 12, 2025. Its SI-IQ is 77 (90% interval 72–81), estimated from 5 benchmark results by 3 independent evaluators.

Facts

Developer
Google DeepMind
Released
Mar 12, 2025
Access
Open weights (restricted licence)
Benchmarks used
5 results from 3 evaluators

Ability by area (SI-IQ, 90% interval)

6080100120140160Math81

Every benchmark result we used

Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.

Benchmark Area Score Implied SI-IQ Evaluated by As listed by the source Retrieved Source
MATH Level 5 Math 74.0% 82 Epoch AI gemma-3-27b-it Oct 18, 2026 Epoch AI Benchmarking Hub · data file
OTIS Mock AIME 2024–2025 Math 22.5% 80 Epoch AI gemma-3-27b-it Oct 18, 2026 Epoch AI Benchmarking Hub · data file
Aider Polyglot Coding 4.9% 54 Aider gemma-3-27b-it Oct 18, 2026 Aider LLM Leaderboards · data file
GPQA Diamond Knowledge 47.7% 70 Epoch AI gemma-3-27b-it Oct 18, 2026 Epoch AI Benchmarking Hub · data file
Berkeley Function Calling Leaderboard Agents 29.5% 70 UC Berkeley (Gorilla) Gemma-3-27b-it (Prompt) Oct 18, 2026 Berkeley Function Calling Leaderboard · data file

Human preference (Arena)

On the Arena leaderboard, where people vote between two anonymous answers, Gemma 3 27B has a rating of 1,365 (1,362–1,369) from 46,666 votes (published Oct 15, 2026). Human preference is a different measure from benchmark ability and is not part of SI-IQ. Arena (Hugging Face)

Models with similar SI-IQ

ModelSI-IQ
GPT-4.1 nanoOpenAI76Gemma 3 27B vs GPT-4.1 nano
Llama 4 MaverickMeta AI81Gemma 3 27B vs Llama 4 Maverick
GPT-4o (Aug 2024)OpenAI73Gemma 3 27B vs GPT-4o (Aug 2024)
GPT-4o (Nov 2024)OpenAI69Gemma 3 27B vs GPT-4o (Nov 2024)
GPT-4o miniOpenAI68Gemma 3 27B vs GPT-4o mini

Computed with SI-IQ method version 1.0.0. Read the full methodology

Data sources: Aider polyglot leaderboard data (Apache-2.0); Arena leaderboard dataset on Hugging Face (CC BY 4.0); Berkeley Function Calling Leaderboard, Gorilla project (Apache-2.0); Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0).