Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works
How smart is GPT-4o (Nov 2024)?
GPT-4o (Nov 2024) is a model from OpenAI, released on Nov 20, 2024. Its SI-IQ is 69 (90% interval 64–73), estimated from 5 benchmark results by 2 independent evaluators. Its strongest area is Math and its weakest is Coding.
Facts
- Developer
- OpenAI
- Released
- Nov 20, 2024
- Access
- API access
- Benchmarks used
- 5 results from 2 evaluators
- API price
- $2.50 input / $10 output per 1M tokens (developer's price list, Oct 18, 2026)
- Context window
- 128,000 tokens
Ability by area (SI-IQ, 90% interval)
Every benchmark result we used
Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.
| Benchmark | Score | Evaluated by | Source |
|---|---|---|---|
| MATH Level 5 | 49.8% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| OTIS Mock AIME 2024–2025 | 6.2% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| Aider Polyglot | 18.2% | Aider | Aider LLM Leaderboards · data file |
| SWE-bench Verified (Epoch AI run) | 31.0% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| GPQA Diamond | 47.9% | Epoch AI | Epoch AI Benchmarking Hub · data file |
Models with similar SI-IQ
| Model | SI-IQ | |
|---|---|---|
| GPT-4o miniOpenAI | 68 | GPT-4o (Nov 2024) vs GPT-4o mini |
| Llama 3.3 70BMeta AI | 66 | GPT-4o (Nov 2024) vs Llama 3.3 70B |
| GPT-4o (Aug 2024)OpenAI | 73 | GPT-4o (Nov 2024) vs GPT-4o (Aug 2024) |
| GPT-4.1 nanoOpenAI | 76 | GPT-4o (Nov 2024) vs GPT-4.1 nano |
| Gemma 3 27BGoogle DeepMind | 77 | GPT-4o (Nov 2024) vs Gemma 3 27B |
Computed with SI-IQ method version 1.0.0. Read the full methodology
Data sources: Aider polyglot leaderboard data (Apache-2.0); Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0); API list prices via LiteLLM's price table (MIT); each price links to the developer's pricing page.