- Source
- Model registry API
- Verified
- 25 Aug 2026
- Confidence
- High
01What this is
- Author
- nomic-ai
- Family
- Nomic Embed
- Task
- embedding
- Hugging Face
- nomic-ai/nomic-embed-text-v1.5
- OpenRouter
- not listed
- Also known as
- nomic-embed-text-v1.5, nomic embed, nomic-embed
02Registry facts
- LicenceFACT
apache-2.0
- FreshRetrieved 25 Aug 2026
- ParametersFACT
137M
- FreshRetrieved 25 Aug 2026
- Context lengthFACT
not returned by the registry
- Evidence not verified
- Downloads (30 days)FACT
16,578,152
- FreshRetrieved 25 Aug 2026
- LikesFACT
893
- FreshRetrieved 25 Aug 2026
- GatedFACT
no
- FreshRetrieved 25 Aug 2026
Model
- downloadsFACT
16578152
- FreshRetrieved 25 Aug 2026
- gatedFACT
false
- FreshRetrieved 25 Aug 2026
- likesFACT
893
- FreshRetrieved 25 Aug 2026
- model licenseFACT
apache-2.0
- FreshRetrieved 25 Aug 2026
- parameter countFACT
136731648
- FreshRetrieved 25 Aug 2026
Other
- last modifiedFACT
2026-04-07T14:17:02.000Z
- FreshRetrieved 25 Aug 2026
- libraryFACT
sentence-transformers
- FreshRetrieved 25 Aug 2026
03VRAM by quantisation
Peak VRAM for serving this model, computed by lib/deployment/hardware.ts from weights + KV cache + 15% runtime overhead. Inputs: 137M parameters, 8,192 tokens of context (assumed — none fetched yet), 4 concurrent requests (assumed).
| Quantisation | Weights | Total |
|---|---|---|
| fp16 | 0.27 GB | 5.87 GB |
What this estimate assumes
- Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
- KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
04Hardware profiles
Cloud GPU instance — 1 × NVIDIA L4 24 GB
- GPU
- NVIDIA L4 24 GB (AWS G6, Azure NVadsA10/NCads equivalents, GCP G2)
- VRAM
- 24 GB
- System RAM
- 64 GB
- Storage
- 1000 GB
- CPU
- 8–16 vCPU
- Form factor
- Cloud instance
Indicative costUS$1 – US$2
indicative on-demand rental, USD per hour, Aug 2026 — verify against the provider price list for your region
The private-cloud counterpart of `onprem-small-24gb`: same model sizes, no capital outlay, and a region you choose explicitly. Running it continuously for a year usually costs more than buying the equivalent box, so it suits pilots, bursts and firms without a server room. The cloud provider becomes a data processor — a DPA and a documented region are required.
Sizing basis
- Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
- KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
On-premise single 24 GB GPU server
- GPU
- NVIDIA RTX 4090 24 GB (or NVIDIA L4 24 GB for a rack-mounted, 72 W alternative)
- VRAM
- 24 GB
- System RAM
- 64 GB
- Storage
- 2000 GB
- CPU
- 16-core x86 server CPU (AMD EPYC 7003/9004 or Intel Xeon Scalable)
- Form factor
- Tower server
Indicative costUS$4,000 – US$9,000
indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier
The default box for a 20–60 person firm. Fits a 14B model at 4-bit with roughly 8 GB of KV cache left for concurrent chat, or an 8B model at fp16. NVMe storage sized for the model cache plus a document corpus and its embeddings. Add a UPS and an offsite backup target — this machine holds the whole knowledge base.
Sizing basis
- Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
- KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
On-premise single 48 GB GPU server
- GPU
- NVIDIA L40S 48 GB (rack) or NVIDIA RTX 6000 Ada 48 GB (office workstation)
- VRAM
- 48 GB
- System RAM
- 128 GB
- Storage
- 4000 GB
- CPU
- 24–32-core x86 server CPU (AMD EPYC or Intel Xeon Scalable)
- Form factor
- Rack server
Indicative costUS$12,000 – US$22,000
indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier
The step up when answer quality matters more than price: a 32B model at 4-bit with generous KV cache, or a 14B model at fp16 with a long context. ECC memory and a standard 2U chassis mean it belongs in a rack or comms room rather than under a desk.
Sizing basis
- Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
- KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
Cloud GPU instance — 1–2 × NVIDIA A100 80 GB
- GPU
- NVIDIA A100 80 GB (AWS P4d, Azure NDasr A100 v4, GCP A2)
- VRAM
- 80 GB
- System RAM
- 256 GB
- Storage
- 2000 GB
- CPU
- 24–48 vCPU
- Form factor
- Cloud instance
Indicative costUS$2 – US$12
indicative on-demand rental, USD per hour, Aug 2026 — verify against the provider price list for your region
For 32B models with long context, or 70B-class models on two cards. The band covers one to two GPUs and the gap between committed-use and on-demand rates. Check that the GPU family you need exists in the region you are required to stay in before committing to a design.
Sizing basis
- Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
- KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
Apple Silicon workstation (unified memory)
- GPU
- Apple M4 Max (up to 128 GB unified) or M3 Ultra (up to 256 GB unified)
- VRAM
- 96 GB
- System RAM
- 128 GB
- Storage
- 2000 GB
- CPU
- Apple M4 Max / M3 Ultra
- Form factor
- Workstation
Indicative costUS$4,500 – US$12,000
indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier
Quiet, standard-socket power draw, and a large memory pool — about 75% of installed unified memory is addressable by the GPU, which is where the 96 GB figure comes from on a 128 GB M4 Max. Memory bandwidth, not capacity, sets the ceiling: excellent for a pilot, a partner workstation or a single heavy user, weak for 40 people at once. Runs Ollama, llama.cpp and MLX; does not run CUDA builds of vLLM.
Sizing basis
- Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
- KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
On-premise dual 80 GB GPU server
- GPU
- 2 × NVIDIA A100 80 GB or 2 × NVIDIA H100 80 GB with NVLink
- VRAM
- 160 GB
- System RAM
- 512 GB
- Storage
- 8000 GB
- CPU
- Dual-socket x86 server CPU, 48+ cores total
- Form factor
- Rack server
Indicative costUS$35,000 – US$110,000
indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier
For a 70B-class model at fp16/int8 with tensor parallelism, or several mid-size models served side by side. Needs real data-centre conditions: 4–8 kW of power, front-to-back cooling and a rack. The price band is wide because A100 and H100 are several times apart.
Sizing basis
- Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
- KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
CPU-only server (small models and embeddings)
- GPU
- unknown
- VRAM
- unknown
- System RAM
- 64 GB
- Storage
- 1000 GB
- CPU
- 16–32 core x86 server CPU with AVX-512
- Form factor
- Tower server
Indicative costUS$1,500 – US$4,000
indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier
No GPU. Embedding models and document parsing run acceptably here, which is enough for a search-only pilot or a nightly batch pipeline. Chat generation with a 7–8B model at 4-bit works but reads at a few tokens per second — usable for one person testing, not for a team. The honest use of this profile is to prove the retrieval quality before buying a GPU.
Sizing basis
- Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
- No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
- KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
- Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
- GB means 10⁹ bytes, matching how GPU memory is advertised.
- KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
- Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
- "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
05Hosted providers
No hosted provider has been fetched for this model. OpenRouter’s catalogue is read by pnpm sync; until it runs, this is empty rather than assumed.
06Deployment stacks
No published deployment stack names this model yet.
07Evidence
- 01–07Tier 4official repository / model cardHugging Face Hub
Hugging Face model card data — nomic-ai/nomic-embed-text-v1.5
https://huggingface.co/api/models/nomic-ai/nomic-embed-text-v1.5
FreshRetrieved 25 Aug 2026sha256:d16cbecf31867 records · · · · · ·
Improve this page
Sign in to contribute
From the field
0 deployments · 0 questions
Nobody has reported deploying this here yet, and no question has been opened against this page. Both appear once a reviewer accepts them.