Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works

How smart is Gemini 2.5 Flash (Jun 2025)?

102 SI-IQ · 90% interval 91–113
Not ranked: results from fewer than 5 benchmarks; results in fewer than 3 areas

Gemini 2.5 Flash (Jun 2025) is a model from Google DeepMind, released on Jun 17, 2025. Its SI-IQ is 102 (90% interval 91–113), estimated from 3 benchmark results by 2 evaluators.

Data as of Oct 18, 2026 · method 1.0.0

A model is ranked when its results come from at least 5 benchmarks (the two GPQA Diamond runs count as one) in at least 3 areas, from at least 2 different evaluators, and its versions are released no more than 60 days apart. This model does not meet that yet (results from fewer than 5 benchmarks; results in fewer than 3 areas). Its provisional estimate rests on 3 benchmark results and can change a lot when more results arrive.

Facts

Developer: Google DeepMind
Released: Jun 17, 2025
Access: API access
Benchmarks used: 3 benchmark results from 2 evaluators
API price: $0.30 input / $2.50 output per 1M tokens (developer's price list, Oct 18, 2026)
Context window: 1,048,576 tokens

Ability by area (SI-IQ, 90% interval)

Every benchmark result we used

Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.

Benchmark	Area	Score	Implied SI-IQ	Evaluated by	As listed by the source	Retrieved	Source
GPQA Diamond (OpenRouter run)	Knowledge	73.8%	102	OpenRouter	`google/gemini-2.5-flash` Google · first-party provider (2 of 2 rows), lower median	Oct 18, 2026	OpenRouter benchmark datasets · data file
Berkeley Function Calling Leaderboard	Agents	56.2%	105	UC Berkeley (Gorilla)	`Gemini-2.5-Flash (FC)`	Oct 18, 2026	Berkeley Function Calling Leaderboard · data file
τ²-bench Airline (OpenRouter run)	Agents	55.1%	97	OpenRouter	`google/gemini-2.5-flash` Google AI Studio · first-party provider (2 of 2 rows), lower median	Oct 18, 2026	OpenRouter benchmark datasets · data file

Human preference (Arena)

On the Arena leaderboard, where people vote between two anonymous answers, Gemini 2.5 Flash (Jun 2025) has a rating of 1,409 (1,407–1,412) from 125,521 votes (published Oct 15, 2026). Human preference is a different measure from benchmark ability and is not part of SI-IQ. Arena (Hugging Face)

Computed with SI-IQ method version 1.0.0. Read the full methodology

Data sources: Arena leaderboard dataset on Hugging Face (CC BY 4.0); Berkeley Function Calling Leaderboard, Gorilla project (Apache-2.0); LiteLLM, model_prices_and_context_window.json (MIT); Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter (licences and changes).