Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works
How smart is Llama 4 Maverick?
Llama 4 Maverick is a model from Meta AI, released on Apr 5, 2025. Its SI-IQ is 81 (90% interval 77–85), estimated from 6 benchmark results by 4 independent evaluators. Its strongest area is Agents and its weakest is Math.
Facts
- Developer
- Meta AI
- Released
- Apr 5, 2025
- Access
- Open weights (restricted licence)
- Benchmarks used
- 6 results from 4 evaluators
Ability by area (SI-IQ, 90% interval)
Every benchmark result we used
Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.
| Benchmark | Score | Evaluated by | Source |
|---|---|---|---|
| MATH Level 5 | 73.0% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| OTIS Mock AIME 2024–2025 | 20.6% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| Aider Polyglot | 15.6% | Aider | Aider LLM Leaderboards · data file |
| GPQA Diamond | 67.0% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| GPQA Diamond (OpenRouter run) | 64.8% | OpenRouter | OpenRouter benchmark datasets · data file |
| Berkeley Function Calling Leaderboard | 37.3% | UC Berkeley (Gorilla) | Berkeley Function Calling Leaderboard · data file |
| τ²-bench Airline (OpenRouter run) | 43.1% | OpenRouter | OpenRouter benchmark datasets · data file |
Human preference (Arena)
On the Arena leaderboard, where people vote between two anonymous answers, Llama 4 Maverick has a rating of 1,327 (1,323–1,331) from 39,450 votes (published Oct 15, 2026). Human preference is a different measure from benchmark ability and is not part of SI-IQ. Arena (Hugging Face)
Models with similar SI-IQ
| Model | SI-IQ | |
|---|---|---|
| Gemma 3 27BGoogle DeepMind | 77 | Llama 4 Maverick vs Gemma 3 27B |
| GPT-4.1 nanoOpenAI | 76 | Llama 4 Maverick vs GPT-4.1 nano |
| GPT-4o (Aug 2024)OpenAI | 73 | Llama 4 Maverick vs GPT-4o (Aug 2024) |
| GPT-4.1OpenAI | 91 | Llama 4 Maverick vs GPT-4.1 |
| GPT-4.1 miniOpenAI | 91 | Llama 4 Maverick vs GPT-4.1 mini |
Computed with SI-IQ method version 1.0.0. Read the full methodology
Data sources: Aider polyglot leaderboard data (Apache-2.0); Arena leaderboard dataset on Hugging Face (CC BY 4.0); Berkeley Function Calling Leaderboard, Gorilla project (Apache-2.0); Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0); Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter..