BGE-M3

LicenceFACT

mit

Fresh·Retrieved 25 Aug 2026

ParametersFACT

not returned by the registry

Evidence not verified

Context lengthFACT

not returned by the registry

Evidence not verified

Downloads (30 days)FACT

36,435,148

Fresh·Retrieved 25 Aug 2026

LikesFACT

3,429

Fresh·Retrieved 25 Aug 2026

GatedFACT

no

Fresh·Retrieved 25 Aug 2026

Peak VRAM for serving this model, computed by lib/deployment/hardware.ts from weights + KV cache + 15% runtime overhead. Inputs: — parameters, 8,192 tokens of context (assumed — none fetched yet), 4 concurrent requests (assumed).

No parameter count has been fetched for this model, so there is nothing to compute. We will not infer a size from the model’s name.

• Cloud GPU instance — 1 × NVIDIA L4 24 GB

  GPU

  NVIDIA L4 24 GB (AWS G6, Azure NVadsA10/NCads equivalents, GCP G2)

  VRAM

  24 GB

  System RAM

  64 GB

  Storage

  1000 GB

  CPU

  8–16 vCPU

  Form factor

  Cloud instance

  Indicative costUS$1 – US$2

  indicative on-demand rental, USD per hour, Aug 2026 — verify against the provider price list for your region

  The private-cloud counterpart of `onprem-small-24gb`: same model sizes, no capital outlay, and a region you choose explicitly. Running it continuously for a year usually costs more than buying the equivalent box, so it suits pilots, bursts and firms without a server room. The cloud provider becomes a data processor — a DPA and a documented region are required.

• On-premise single 24 GB GPU server

  GPU

  NVIDIA RTX 4090 24 GB (or NVIDIA L4 24 GB for a rack-mounted, 72 W alternative)

  VRAM

  24 GB

  System RAM

  64 GB

  Storage

  2000 GB

  CPU

  16-core x86 server CPU (AMD EPYC 7003/9004 or Intel Xeon Scalable)

  Form factor

  Tower server

  Indicative costUS$4,000 – US$9,000

  indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

  The default box for a 20–60 person firm. Fits a 14B model at 4-bit with roughly 8 GB of KV cache left for concurrent chat, or an 8B model at fp16. NVMe storage sized for the model cache plus a document corpus and its embeddings. Add a UPS and an offsite backup target — this machine holds the whole knowledge base.

• On-premise single 48 GB GPU server

  GPU

  NVIDIA L40S 48 GB (rack) or NVIDIA RTX 6000 Ada 48 GB (office workstation)

  VRAM

  48 GB

  System RAM

  128 GB

  Storage

  4000 GB

  CPU

  24–32-core x86 server CPU (AMD EPYC or Intel Xeon Scalable)

  Form factor

  Rack server

  Indicative costUS$12,000 – US$22,000

  indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

  The step up when answer quality matters more than price: a 32B model at 4-bit with generous KV cache, or a 14B model at fp16 with a long context. ECC memory and a standard 2U chassis mean it belongs in a rack or comms room rather than under a desk.

• Cloud GPU instance — 1–2 × NVIDIA A100 80 GB

  GPU

  NVIDIA A100 80 GB (AWS P4d, Azure NDasr A100 v4, GCP A2)

  VRAM

  80 GB

  System RAM

  256 GB

  Storage

  2000 GB

  CPU

  24–48 vCPU

  Form factor

  Cloud instance

  Indicative costUS$2 – US$12

  indicative on-demand rental, USD per hour, Aug 2026 — verify against the provider price list for your region

  For 32B models with long context, or 70B-class models on two cards. The band covers one to two GPUs and the gap between committed-use and on-demand rates. Check that the GPU family you need exists in the region you are required to stay in before committing to a design.

• Apple Silicon workstation (unified memory)

  GPU

  Apple M4 Max (up to 128 GB unified) or M3 Ultra (up to 256 GB unified)

  VRAM

  96 GB

  System RAM

  128 GB

  Storage

  2000 GB

  CPU

  Apple M4 Max / M3 Ultra

  Form factor

  Workstation

  Indicative costUS$4,500 – US$12,000

  indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

  Quiet, standard-socket power draw, and a large memory pool — about 75% of installed unified memory is addressable by the GPU, which is where the 96 GB figure comes from on a 128 GB M4 Max. Memory bandwidth, not capacity, sets the ceiling: excellent for a pilot, a partner workstation or a single heavy user, weak for 40 people at once. Runs Ollama, llama.cpp and MLX; does not run CUDA builds of vLLM.

• On-premise dual 80 GB GPU server

  GPU

  2 × NVIDIA A100 80 GB or 2 × NVIDIA H100 80 GB with NVLink

  VRAM

  160 GB

  System RAM

  512 GB

  Storage

  8000 GB

  CPU

  Dual-socket x86 server CPU, 48+ cores total

  Form factor

  Rack server

  Indicative costUS$35,000 – US$110,000

  indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

  For a 70B-class model at fp16/int8 with tensor parallelism, or several mid-size models served side by side. Needs real data-centre conditions: 4–8 kW of power, front-to-back cooling and a rack. The price band is wide because A100 and H100 are several times apart.

• CPU-only server (small models and embeddings)

  GPU

  unknown

  VRAM

  unknown

  System RAM

  64 GB

  Storage

  1000 GB

  CPU

  16–32 core x86 server CPU with AVX-512

  Form factor

  Tower server

  Indicative costUS$1,500 – US$4,000

  indicative build cost for the complete machine, USD, Aug 2026 — verify with a local supplier

  No GPU. Embedding models and document parsing run acceptably here, which is enough for a search-only pilot or a nightly batch pipeline. Chat generation with a 7–8B model at 4-bit works but reads at a few tokens per second — usable for one person testing, not for a team. The honest use of this profile is to prove the retrieval quality before buying a GPU.

No hosted provider has been fetched for this model. OpenRouter’s catalogue is read by pnpm sync; until it runs, this is empty rather than assumed.

• Self hostedDocument classification and OCR pipelineDocling (or Unstructured) converts and OCRs, embeddings plus rules classify, a local model reads only the documents that need reading, and Paperless-ngx gives the business a place to search and file. Starts CPU-only; a GPU is added when the volume justifies it.
• Self hostedPrivate company knowledge base (self-hosted RAG)Open WebUI as the employee interface, vLLM serving a Qwen2.5-14B-Instruct model on a single 24 GB GPU, PostgreSQL with pgvector for chats and embeddings, and OIDC single sign-on — all in Docker on one server in your office or colocation rack. Ollama replaces vLLM for teams under about 20 users; a 48 GB GPU lets you run a 32B model for better answers.

1. 01–06
   Tier 4·official repository / model cardHugging Face Hub

   Hugging Face model card data — BAAI/bge-m3

   https://huggingface.co/api/models/BAAI/bge-m3

   Fresh·Retrieved 25 Aug 2026sha256:4ae1edd6491a

   6 records01 license ·02 likes ·03 lastModified ·04 library name ·05 downloads ·06 gated