Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works

How smart is Llama 3-8B?

40 SI-IQ · 90% interval 34–46
Not ranked: results from fewer than 5 benchmarks; results in fewer than 3 areas; results from fewer than 2 evaluators

Llama 3-8B is a model from Meta AI, released on Apr 18, 2024. Its SI-IQ is 40 (90% interval 34–46), estimated from 3 benchmark results by 1 evaluator.

Data as of Oct 18, 2026 · method 1.0.0

A model is ranked when its results come from at least 5 benchmarks (the two GPQA Diamond runs count as one) in at least 3 areas, from at least 2 different evaluators, and its versions are released no more than 60 days apart. This model does not meet that yet (results from fewer than 5 benchmarks; results in fewer than 3 areas; results from fewer than 2 evaluators). Its provisional estimate rests on 3 benchmark results and can change a lot when more results arrive.

Facts

Developer
Meta AI
Released
Apr 18, 2024
Access
Open weights (restricted licence)
Benchmarks used
3 benchmark results from 1 evaluator

Ability by area (SI-IQ, 90% interval)

6080100120140160Math39

Every benchmark result we used

Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.

Benchmark Area Score Implied SI-IQ Evaluated by As listed by the source Retrieved Source
MATH Level 5 Math 6.1% 37 Epoch AI Meta-Llama-3-8B-Instruct Oct 18, 2026 Epoch AI Benchmarking Hub · data file
OTIS Mock AIME 2024–2025 Math 1.9% 54 Epoch AI Meta-Llama-3-8B-Instruct Oct 18, 2026 Epoch AI Benchmarking Hub · data file
GPQA Diamond Knowledge 26.1% 5 Epoch AI Meta-Llama-3-8B-Instruct Oct 18, 2026 Epoch AI Benchmarking Hub · data file

Computed with SI-IQ method version 1.0.0. Read the full methodology

Data sources: Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0) (licences and changes).