- Source
- Model registry API
- Verified
- 19 Sep 2026
- Confidence
- High
01What this is
- Author
- Thinking Machines Lab
- Family
- Inkling
- Task
- text-generation
- Hugging Face
- thinkingmachines/Inkling
- OpenRouter
- thinkingmachines/inkling
- Also known as
- Inkling, thinkingmachines inkling, tml inkling
02Registry facts
- LicenceFACT
apache-2.0
- FreshRetrieved 19 Sep 2026
- ParametersFACT
952.4B
- FreshRetrieved 19 Sep 2026
- Context lengthFACT
not returned by the registry
- Evidence not verified
- Downloads (30 days)FACT
338,819
- FreshRetrieved 19 Sep 2026
- LikesFACT
1,780
- FreshRetrieved 19 Sep 2026
- GatedFACT
no
- FreshRetrieved 19 Sep 2026
Model
- downloadsFACT
338819
- Verification may be outdatedRetrieved 19 Sep 2026
- gatedFACT
false
- Verification may be outdatedRetrieved 19 Sep 2026
- hosted context length · TogetherFACT
524288
- Verification may be outdatedRetrieved 19 Sep 2026
- hosted context length · BaseTenFACT
1048576
- Verification may be outdatedRetrieved 19 Sep 2026
- hosted context length · DeepInfraFACT
524288
- Verification may be outdatedRetrieved 19 Sep 2026
- likesFACT
1780
- Verification may be outdatedRetrieved 19 Sep 2026
- model licenseFACT
apache-2.0
- Verification may be outdatedRetrieved 19 Sep 2026
- parameter countFACT
952377623626
- Verification may be outdatedRetrieved 19 Sep 2026
Pricing
- hosted price completion per m · TogetherFACT
4.0500
- AgeingRetrieved 19 Sep 2026
- hosted price completion per m · BaseTenFACT
4.0500
- AgeingRetrieved 19 Sep 2026
- hosted price completion per m · DeepInfraFACT
4.0500
- AgeingRetrieved 19 Sep 2026
- hosted price prompt per m · TogetherFACT
1.0000
- AgeingRetrieved 19 Sep 2026
- hosted price prompt per m · BaseTenFACT
1.0000
- AgeingRetrieved 19 Sep 2026
- hosted price prompt per m · DeepInfraFACT
0.9500
- AgeingRetrieved 19 Sep 2026
Other
- last modifiedFACT
2026-07-23T17:27:17.000Z
- Verification may be outdatedRetrieved 19 Sep 2026
- libraryFACT
transformers
- AgeingRetrieved 19 Sep 2026
03VRAM by quantisation
Peak VRAM for serving this model, computed by lib/deployment/hardware.ts from weights + KV cache + 15% runtime overhead. Inputs: 952.4B parameters, 8,192 tokens of context (assumed — none fetched yet), 4 concurrent requests (assumed).
| Quantisation | Weights | Total |
|---|---|---|
| bf16bf16 is two bytes per weight, the same arithmetic as fp16. | 1904.76 GB | 2207.76 GB |
| int8 | 952.38 GB | 1112.52 GB |
| int4 | 476.19 GB | 564.9 GB |
What this estimate assumes
- Weights: 952.4B parameters × 2 bytes per parameter (fp16) = 1904.76 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.459 MB per token, from extrapolated above 90B — no configuration was fetched for this band.
- KV cache: 0.459 MB per token × 8,192 tokens of context × 4 concurrent requests = 15.03 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 287.97 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
04Hardware profiles
No hardware profile was sized for this answer.
05Hosted providers
- Prompt (per million tokens, USD)FACT
0.95
Source: openrouter
- FreshRetrieved 19 Sep 2026
- Completion (per million tokens, USD)FACT
4.05
- FreshRetrieved 19 Sep 2026
| Provider | Context |
|---|---|
| DeepInfra | 524,288 |
| BaseTen | 1,048,576 |
| Together | 524,288 |
| BaseTen | 1,048,576 |
06Deployment stacks
No published deployment stack names this model yet.
07Evidence
- 01–09Tier 4official repository / model cardOpenRouter
OpenRouter endpoints — thinkingmachines/inkling
https://openrouter.ai/api/v1/models/thinkingmachines/inkling/endpoints
AgeingRetrieved 19 Sep 2026sha256:97ccaae4b9f89 records · · · · · · · ·
- 10–16Tier 4official repository / model cardHugging Face Hub
Hugging Face model card data — thinkingmachines/Inkling
https://huggingface.co/api/models/thinkingmachines/Inkling
Verification may be outdatedRetrieved 19 Sep 2026sha256:6b9a7aa409457 records · · · · · ·
Improve this page
Sign in to contribute
From the field
0 deployments · 0 questions
Nobody has reported deploying this here yet, and no question has been opened against this page. Both appear once a reviewer accepts them.