Skip to content
Is there an AI for this?

Model

BGE Reranker v2 M3

Recorded as suitable for rag, multilingual, zh, ja, ko.

Source
Model registry API
Verified
19 Sep 2026
Confidence
High

01What this is

Author
BAAI
Family
BGE
Task
reranking
Hugging Face
BAAI/bge-reranker-v2-m3
OpenRouter
not listed
Also known as
bge-reranker-v2-m3, bge reranker, bge-reranker

02Registry facts

19 Sep 2026
LicenceFACT

apache-2.0

FreshRetrieved 19 Sep 2026
ParametersFACT

568M

FreshRetrieved 19 Sep 2026
Context lengthFACT

not returned by the registry

Evidence not verified
Downloads (30 days)FACT

17,581,835

FreshRetrieved 19 Sep 2026
LikesFACT

1,203

FreshRetrieved 19 Sep 2026
GatedFACT

no

FreshRetrieved 19 Sep 2026

Model

downloadsFACT

17581835

Verification may be outdatedRetrieved 19 Sep 2026
gatedFACT

false

Verification may be outdatedRetrieved 19 Sep 2026
likesFACT

1203

Verification may be outdatedRetrieved 19 Sep 2026
model licenseFACT

apache-2.0

Verification may be outdatedRetrieved 19 Sep 2026
parameter countFACT

567755777

Verification may be outdatedRetrieved 19 Sep 2026

Other

last modifiedFACT

2024-06-24T14:08:45.000Z

Verification may be outdatedRetrieved 19 Sep 2026
libraryFACT

sentence-transformers

AgeingRetrieved 19 Sep 2026

03VRAM by quantisation

ASSESSMENT

Peak VRAM for serving this model, computed by lib/deployment/hardware.ts from weights + KV cache + 15% runtime overhead. Inputs: 568M parameters, 8,192 tokens of context (assumed — none fetched yet), 4 concurrent requests (assumed).

Decimal GB (10⁹ bytes), matching how GPU memory is advertised.
QuantisationWeightsTotal
fp161.14 GB6.86 GB

What this estimate assumes

  • Weights: 0.6B parameters × 2 bytes per parameter (fp16) = 1.14 GB.
  • No model configuration was supplied, so the KV cache uses the size heuristic for this band: 0.147 MB per token, from Qwen3-8B (36 layers × 8 KV heads × 128 head dim).
  • KV cache: 0.147 MB per token × 8,192 tokens of context × 4 concurrent requests = 4.83 GB, sized for every user holding a full context at once.
  • Overhead: 15% of weights plus KV cache for the runtime, activations and memory fragmentation = 0.9 GB.
  • GB means 10⁹ bytes, matching how GPU memory is advertised.
  • KV cache held at fp16 (2 bytes per element); quantising weights does not by itself quantise the cache.
  • Peak figure, not average: prefix caching and paged attention usually keep real usage lower, while speculative decoding, CUDA graphs and a second resident model push it higher.
  • "Concurrent" counts requests generated at the same instant, not people: 4 simultaneous requests is the worst case this estimate is built on — measure yours before buying.

04Hardware profiles

No hardware profile was sized for this answer.


05Hosted providers

No hosted provider has been fetched for this model. OpenRouter’s catalogue is read when our refresh next runs; until then this is empty rather than assumed.


06Deployment stacks

0 using it

No published deployment stack names this model yet.


07Evidence

7 verified
  1. 01–07
    Tier 4official repository / model cardHugging Face Hub

    Hugging Face model card data — BAAI/bge-reranker-v2-m3

    https://huggingface.co/api/models/BAAI/bge-reranker-v2-m3

    Verification may be outdatedRetrieved 19 Sep 2026sha256:4bb030295166

    7 records · · · · · ·

Improve this page

Sign in to contribute

From the field

0 deployments · 0 questions

Nobody has reported deploying this here yet, and no question has been opened against this page. Both appear once a reviewer accepts them.