Skip to content
Is there an AI for this?

Model

Nomic Embed Text v1.5

Recorded as suitable for rag.

Source
Model registry API
Verified
25 Aug 2026
Confidence
High

01What this is

Author
nomic-ai
Family
Nomic Embed
Task
embedding
Hugging Face
nomic-ai/nomic-embed-text-v1.5
OpenRouter
not listed
Also known as
nomic-embed-text-v1.5, nomic embed, nomic-embed

02Registry facts

25 Aug 2026
LicenceFACT

apache-2.0

FreshRetrieved 25 Aug 2026
ParametersFACT

137M

FreshRetrieved 25 Aug 2026
Context lengthFACT

not returned by the registry

Evidence not verified
Downloads (30 days)FACT

16,578,152

FreshRetrieved 25 Aug 2026
LikesFACT

893

FreshRetrieved 25 Aug 2026
GatedFACT

no

FreshRetrieved 25 Aug 2026

Model

downloadsFACT

16578152

FreshRetrieved 25 Aug 2026
gatedFACT

false

FreshRetrieved 25 Aug 2026
likesFACT

893

FreshRetrieved 25 Aug 2026
model licenseFACT

apache-2.0

FreshRetrieved 25 Aug 2026
parameter countFACT

136731648

FreshRetrieved 25 Aug 2026

Other

last modifiedFACT

2026-04-07T14:17:02.000Z

FreshRetrieved 25 Aug 2026
libraryFACT

sentence-transformers

FreshRetrieved 25 Aug 2026

03VRAM by quantisation

ASSESSMENT

Peak VRAM for serving this model, computed by lib/deployment/hardware.ts from weights + KV cache + 15% runtime overhead. Inputs: 137M parameters, 8,192 tokens of context (assumed — none fetched yet), 4 concurrent requests (assumed).

Decimal GB (10⁹ bytes), matching how GPU memory is advertised.
QuantisationWeightsTotal
fp160.27 GB5.87 GB

What this estimate assumes

  • Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
  • No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
  • KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
  • Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
  • GB means 10⁹ bytes, matching how GPU memory is advertised.
  • KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
  • Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
  • "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.

04Hardware profiles

  • Cloud GPU instance — 1 × NVIDIA L4 24 GB

    GPU
    NVIDIA L4 24 GB (AWS G6, Azure NVadsA10/NCads equivalents, GCP G2)
    VRAM
    24 GB
    System RAM
    64 GB
    Storage
    1000 GB
    CPU
    8–16 vCPU
    Form factor
    Cloud instance

    Indicative costUS$1 – US$2

    indicative on-demand rental, USD per hour, Aug 2026 — verify against the provider price list for your region

    The private-cloud counterpart of `onprem-small-24gb`: same model sizes, no capital outlay, and a region you choose explicitly. Running it continuously for a year usually costs more than buying the equivalent box, so it suits pilots, bursts and firms without a server room. The cloud provider becomes a data processor — a DPA and a documented region are required.

    Sizing basis

    • Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
    • No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
    • KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
    • Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
    • GB means 10⁹ bytes, matching how GPU memory is advertised.
    • KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
    • Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
    • "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
  • On-premise single 24 GB GPU server

    GPU
    NVIDIA RTX 4090 24 GB (or NVIDIA L4 24 GB for a rack-mounted, 72 W alternative)
    VRAM
    24 GB
    System RAM
    64 GB
    Storage
    2000 GB
    CPU
    16-core x86 server CPU (AMD EPYC 7003/9004 or Intel Xeon Scalable)
    Form factor
    Tower server

    Indicative costUS$4,000 – US$9,000

    indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

    The default box for a 20–60 person firm. Fits a 14B model at 4-bit with roughly 8 GB of KV cache left for concurrent chat, or an 8B model at fp16. NVMe storage sized for the model cache plus a document corpus and its embeddings. Add a UPS and an offsite backup target — this machine holds the whole knowledge base.

    Sizing basis

    • Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
    • No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
    • KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
    • Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
    • GB means 10⁹ bytes, matching how GPU memory is advertised.
    • KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
    • Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
    • "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
  • On-premise single 48 GB GPU server

    GPU
    NVIDIA L40S 48 GB (rack) or NVIDIA RTX 6000 Ada 48 GB (office workstation)
    VRAM
    48 GB
    System RAM
    128 GB
    Storage
    4000 GB
    CPU
    24–32-core x86 server CPU (AMD EPYC or Intel Xeon Scalable)
    Form factor
    Rack server

    Indicative costUS$12,000 – US$22,000

    indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

    The step up when answer quality matters more than price: a 32B model at 4-bit with generous KV cache, or a 14B model at fp16 with a long context. ECC memory and a standard 2U chassis mean it belongs in a rack or comms room rather than under a desk.

    Sizing basis

    • Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
    • No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
    • KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
    • Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
    • GB means 10⁹ bytes, matching how GPU memory is advertised.
    • KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
    • Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
    • "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
  • Cloud GPU instance — 1–2 × NVIDIA A100 80 GB

    GPU
    NVIDIA A100 80 GB (AWS P4d, Azure NDasr A100 v4, GCP A2)
    VRAM
    80 GB
    System RAM
    256 GB
    Storage
    2000 GB
    CPU
    24–48 vCPU
    Form factor
    Cloud instance

    Indicative costUS$2 – US$12

    indicative on-demand rental, USD per hour, Aug 2026 — verify against the provider price list for your region

    For 32B models with long context, or 70B-class models on two cards. The band covers one to two GPUs and the gap between committed-use and on-demand rates. Check that the GPU family you need exists in the region you are required to stay in before committing to a design.

    Sizing basis

    • Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
    • No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
    • KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
    • Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
    • GB means 10⁹ bytes, matching how GPU memory is advertised.
    • KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
    • Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
    • "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
  • Apple Silicon workstation (unified memory)

    GPU
    Apple M4 Max (up to 128 GB unified) or M3 Ultra (up to 256 GB unified)
    VRAM
    96 GB
    System RAM
    128 GB
    Storage
    2000 GB
    CPU
    Apple M4 Max / M3 Ultra
    Form factor
    Workstation

    Indicative costUS$4,500 – US$12,000

    indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

    Quiet, standard-socket power draw, and a large memory pool — about 75% of installed unified memory is addressable by the GPU, which is where the 96 GB figure comes from on a 128 GB M4 Max. Memory bandwidth, not capacity, sets the ceiling: excellent for a pilot, a partner workstation or a single heavy user, weak for 40 people at once. Runs Ollama, llama.cpp and MLX; does not run CUDA builds of vLLM.

    Sizing basis

    • Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
    • No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
    • KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
    • Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
    • GB means 10⁹ bytes, matching how GPU memory is advertised.
    • KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
    • Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
    • "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
  • On-premise dual 80 GB GPU server

    GPU
    2 × NVIDIA A100 80 GB or 2 × NVIDIA H100 80 GB with NVLink
    VRAM
    160 GB
    System RAM
    512 GB
    Storage
    8000 GB
    CPU
    Dual-socket x86 server CPU, 48+ cores total
    Form factor
    Rack server

    Indicative costUS$35,000 – US$110,000

    indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

    For a 70B-class model at fp16/int8 with tensor parallelism, or several mid-size models served side by side. Needs real data-centre conditions: 4–8 kW of power, front-to-back cooling and a rack. The price band is wide because A100 and H100 are several times apart.

    Sizing basis

    • Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
    • No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
    • KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
    • Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
    • GB means 10⁹ bytes, matching how GPU memory is advertised.
    • KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
    • Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
    • "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.
  • CPU-only server (small models and embeddings)

    GPU
    unknown
    VRAM
    unknown
    System RAM
    64 GB
    Storage
    1000 GB
    CPU
    16–32 core x86 server CPU with AVX-512
    Form factor
    Tower server

    Indicative costUS$1,500 – US$4,000

    indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

    No GPU. Embedding models and document parsing run acceptably here, which is enough for a search-only pilot or a nightly batch pipeline. Chat generation with a 7–8B model at 4-bit works but reads at a few tokens per second — usable for one person testing, not for a team. The honest use of this profile is to prove the retrieval quality before buying a GPU.

    Sizing basis

    • Weights: 0.1B parameters × 2 bytes per parameter (fp16) = 0.27 GB.
    • No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
    • KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
    • Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.77 GB.
    • GB means 10⁹ bytes, matching how GPU memory is advertised.
    • KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
    • Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
    • "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.

05Hosted providers

No hosted provider has been fetched for this model. OpenRouter’s catalogue is read by pnpm sync; until it runs, this is empty rather than assumed.


06Deployment stacks

0 using it

No published deployment stack names this model yet.


07Evidence

7 verified
  1. 01–07
    Tier 4official repository / model cardHugging Face Hub

    Hugging Face model card data — nomic-ai/nomic-embed-text-v1.5

    https://huggingface.co/api/models/nomic-ai/nomic-embed-text-v1.5

    FreshRetrieved 25 Aug 2026sha256:d16cbecf3186

    7 records · · · · · ·

Improve this page

Sign in to contribute

From the field

0 deployments · 0 questions

Nobody has reported deploying this here yet, and no question has been opened against this page. Both appear once a reviewer accepts them.