Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works
How smart is Gemma 3 27B?
Gemma 3 27B is a model from Google DeepMind, released on Mar 12, 2025. Its SI-IQ is 77 (90% interval 72–81), estimated from 5 benchmark results by 3 independent evaluators.
Facts
- Developer
- Google DeepMind
- Released
- Mar 12, 2025
- Access
- Open weights (restricted licence)
- Benchmarks used
- 5 results from 3 evaluators
Ability by area (SI-IQ, 90% interval)
Every benchmark result we used
Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.
| Benchmark | Score | Evaluated by | Source |
|---|---|---|---|
| MATH Level 5 | 74.0% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| OTIS Mock AIME 2024–2025 | 22.5% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| Aider Polyglot | 4.9% | Aider | Aider LLM Leaderboards · data file |
| GPQA Diamond | 47.7% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| Berkeley Function Calling Leaderboard | 29.5% | UC Berkeley (Gorilla) | Berkeley Function Calling Leaderboard · data file |
Human preference (Arena)
On the Arena leaderboard, where people vote between two anonymous answers, Gemma 3 27B has a rating of 1,365 (1,362–1,369) from 46,666 votes (published Oct 15, 2026). Human preference is a different measure from benchmark ability and is not part of SI-IQ. Arena (Hugging Face)
Models with similar SI-IQ
| Model | SI-IQ | |
|---|---|---|
| GPT-4.1 nanoOpenAI | 76 | Gemma 3 27B vs GPT-4.1 nano |
| Llama 4 MaverickMeta AI | 81 | Gemma 3 27B vs Llama 4 Maverick |
| GPT-4o (Aug 2024)OpenAI | 73 | Gemma 3 27B vs GPT-4o (Aug 2024) |
| GPT-4o (Nov 2024)OpenAI | 69 | Gemma 3 27B vs GPT-4o (Nov 2024) |
| GPT-4o miniOpenAI | 68 | Gemma 3 27B vs GPT-4o mini |
Computed with SI-IQ method version 1.0.0. Read the full methodology
Data sources: Aider polyglot leaderboard data (Apache-2.0); Arena leaderboard dataset on Hugging Face (CC BY 4.0); Berkeley Function Calling Leaderboard, Gorilla project (Apache-2.0); Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0).