- Source
- Model registry API
- Verified
- 19 Sep 2026
- Confidence
- High
01What this is
- Author
- mistralai
- Family
- Mistral 3
- Task
- text-generation
- Hugging Face
- mistralai/Mistral-Medium-3.5-128B
- OpenRouter
- mistralai/mistral-medium-3-5
- Also known as
- Mistral Medium 3.5, mistral-medium-3.5, mistral medium
02Registry facts
- LicenceFACT
other
- FreshRetrieved 19 Sep 2026
- ParametersFACT
127.7B
- FreshRetrieved 19 Sep 2026
- Context lengthFACT
not returned by the registry
- Evidence not verified
- Downloads (30 days)FACT
89,896
- FreshRetrieved 19 Sep 2026
- LikesFACT
447
- FreshRetrieved 19 Sep 2026
- GatedFACT
no
- FreshRetrieved 19 Sep 2026
Model
- downloadsFACT
89896
- Verification may be outdatedRetrieved 19 Sep 2026
- gatedFACT
false
- Verification may be outdatedRetrieved 19 Sep 2026
- hosted context length · MistralFACT
262144
- Verification may be outdatedRetrieved 19 Sep 2026
- likesFACT
447
- Verification may be outdatedRetrieved 19 Sep 2026
- model licenseFACT
other
- Verification may be outdatedRetrieved 19 Sep 2026
- parameter countFACT
127704210176
- Verification may be outdatedRetrieved 19 Sep 2026
Pricing
- hosted price completion per m · MistralFACT
7.5000
- AgeingRetrieved 19 Sep 2026
- hosted price prompt per m · MistralFACT
1.5000
- AgeingRetrieved 19 Sep 2026
Other
- available on platform · vendorFACT
vendor
- AgeingRetrieved 19 Sep 2026
- available on platform · azureFACT
azure
Evidence not verified — the quoted phrase was not found in the fetched document.
- Evidence not verified
- last modifiedFACT
2026-07-15T12:23:17.000Z
- Verification may be outdatedRetrieved 19 Sep 2026
03VRAM by quantisation
Peak VRAM for serving this model, computed by lib/deployment/hardware.ts from weights + KV cache + 15% runtime overhead. Inputs: 127.7B parameters, 8,192 tokens of context (assumed — none fetched yet), 4 concurrent requests (assumed).
| Quantisation | Weights | Total |
|---|---|---|
| bf16bf16 is two bytes per weight, the same arithmetic as fp16. | 255.41 GB | 311.01 GB |
| fp8 | 127.7 GB | 164.15 GB |
| int8 | 127.7 GB | 164.15 GB |
What this estimate assumes
- Weights: 127.7B parameters × 2 bytes per parameter (fp16) = 255.41 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.459 MB per token, from extrapolated above 90B — no configuration was fetched for this band.
- KV cache: 0.459 MB per token × 8,192 tokens of context × 4 concurrent requests = 15.03 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 40.57 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
04Hardware profiles
No hardware profile was sized for this answer.
05Hosted providers
- Prompt (per million tokens, USD)FACT
1.5
Source: openrouter
- FreshRetrieved 19 Sep 2026
- Completion (per million tokens, USD)FACT
7.5
- FreshRetrieved 19 Sep 2026
| Provider | Context |
|---|---|
| Mistral | 262,144 |
| Mistral | 262,144 |
06Deployment stacks
No published deployment stack names this model yet.
07Evidence
- 01Tier 2official vendor legal documentationVendor legal and technical documentation
https://docs.mistral.ai/models
AgeingRetrieved 19 Sep 2026sha256:75db4776a3cb1 record
- 02–04Tier 4official repository / model cardOpenRouter
OpenRouter endpoints — mistralai/mistral-medium-3-5
https://openrouter.ai/api/v1/models/mistralai/mistral-medium-3-5/endpoints
AgeingRetrieved 19 Sep 2026sha256:56aebee726753 records · ·
- 05–10Tier 4official repository / model cardHugging Face Hub
Hugging Face model card data — mistralai/Mistral-Medium-3.5-128B
https://huggingface.co/api/models/mistralai/Mistral-Medium-3.5-128B
Verification may be outdatedRetrieved 19 Sep 2026sha256:f106b7b6d9e96 records · · · · ·
Improve this page
Sign in to contribute
From the field
0 deployments · 0 questions
Nobody has reported deploying this here yet, and no question has been opened against this page. Both appear once a reviewer accepts them.