2 vs 1 benchmarks won
Google Gemini 2.5 Pro | Mistral Mistral Medium 3.5 | |
|---|---|---|
| Overview | ||
| Company | Mistral | |
| Release date | Mar 25 2025 | Apr 29 2026 |
| Model type | — | — |
| Open source | No | Yes |
| Specifications | ||
Parameters | — | 128B |
Context window | — | 256k |
| Benchmarks | ||
Science reasoning GPQA Diamond | 86.4% | — |
Software engineering SWE-Bench Verified | 59.6% | 77.6% |
Multimodal understanding MMMU | 68% | — |
| Timeline | ||
| Release gap | Gemini 2.5 Pro shipped 400 days before Mistral Medium 3.5 | |
Gemini 2.5 Pro leads Mistral Medium 3.5 on 2 of the tracked benchmarks (GPQA Diamond, SWE-Bench Verified, MMMU). Gemini 2.5 Pro shipped 400 days before Mistral Medium 3.5, so benchmark comparisons should account for the intervening progress.
Mistral Medium 3.5 is an open-source / open-weight model; Gemini 2.5 Pro is proprietary.
On SWE-Bench Verified, Mistral Medium 3.5 scores 77.6%, 18 points above Gemini 2.5 Pro at 59.6%.