Repository
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
- Source
- GitHub REST API
- Verified
- 25 Aug 2026
- Confidence
- High
01Repository record
vllm-project/vllm
Maturity81/ 100
- Maintenance
- 100%
- Releases
- 80%
- Contributors
- 50%
- Issues
- 22%
- Community
- 99%
- Stars
- 89,956
- Forks
- 21,167
- Open issues
- 6,986
- Contributors
- —
- Primary language
- Python
- Licence
- Apache-2.0
- Latest release
- v0.27.1
- Last push
- 25 Aug 2026
Basis
- Maintenance 1 — last push 0 days ago (25 Aug 2026)
- Releases 0.8 — latest release 14 days ago (11 Aug 2026)
- Contributors 0.5 (not measured) — the contributor count was not available
- Issues 0.223 — 6986 open issues against 89956 stars (0 at 10% of stars)
- Community 0.991 — 89956 stars (log10/5, capped at 1)
- Overall 0.805 — weighted mean of maintenance, releases, contributors, issues, community (weights maintenance 0.3, releases 0.2, contributors 0.15, issues 0.1, community 0.25, renormalised over the components present)
02Facts by topic
11 verified
Open-source licensing
- license nameFACT
Apache License 2.0
- FreshRetrieved 25 Aug 2026
- license spdxFACT
Apache-2.0
- FreshRetrieved 25 Aug 2026
Repository
- archivedFACT
false
- FreshRetrieved 25 Aug 2026
- forksFACT
21167
- FreshRetrieved 25 Aug 2026
- latest releaseFACT
v0.27.1
- FreshRetrieved 25 Aug 2026
- open issuesFACT
6986
- FreshRetrieved 25 Aug 2026
- primary languageFACT
Python
- FreshRetrieved 25 Aug 2026
- pushed atFACT
2026-08-25T08:50:23.000Z
- FreshRetrieved 25 Aug 2026
- release dateFACT
2026-08-11T10:47:49.000Z
- FreshRetrieved 25 Aug 2026
- starsFACT
89956
- FreshRetrieved 25 Aug 2026
Other
- readme publishedFACT
https://raw.githubusercontent.com/vllm-project/vllm/HEAD/README.md
- FreshRetrieved 25 Aug 2026
03Tools built on it
1
04Used in deployment stacks
5
- self_hostedPrivate company knowledge base (self-hosted RAG)Open WebUI as the employee interface, vLLM serving a Qwen2.5-14B-Instruct model on a single 24 GB GPU, PostgreSQL with pgvector for chats and embeddings, and OIDC single sign-on — all in Docker on one server in your office or colocation rack. Ollama replaces vLLM for teams under about 20 users; a 48 GB GPU lets you run a 32B model for better answers.
- self_hostedLocal LLM inference server (Ollama / vLLM)vLLM for throughput or Ollama for simplicity, one GPU, and LiteLLM in front as the gateway that issues per-team keys and records spend. The endpoint other recipes point at.
- private_cloudPrivate-cloud RAG in a single regionA GPU instance in one region running vLLM and Open WebUI, a managed PostgreSQL with pgvector for chats and embeddings, object storage for the original files, and your existing identity provider for sign-in. Same software as the on-premise recipe; different trust boundary.
- self_hostedContract review and clause extractionDocling converts the contract to structured text with layout preserved; a 32B open-weight model on vLLM fills a JSON schema of clause fields under constrained decoding; results land in PostgreSQL with pgvector for search and precedent lookup; a reviewer approves in the UI.
- self_hostedInvoice capture and extractionInvoices arrive by email or watched folder, Docling converts them (OCR included), a local vision-capable model fills a JSON schema under constrained decoding, code checks the arithmetic and the supplier against your master data, and n8n posts the clean ones while routing the rest to a person.
05Evidence
11 documents
- 01Tier 4official repository / model cardGitHub
https://raw.githubusercontent.com/vllm-project/vllm/HEAD/README.md
FreshRetrieved 25 Aug 2026sha256:8d2e7cd8d1201 record
- 02–11Tier 4official repository / model cardGitHub
GitHub API — vllm-project/vllm
https://api.github.com/repos/vllm-project/vllm
FreshRetrieved 25 Aug 2026sha256:f979a5859f7910 records · · · · · · · · ·
Improve this page
Sign in to contribute
From the field
0 deployments · 0 questions
Nobody has reported deploying this here yet, and no question has been opened against this page. Both appear once a reviewer accepts them.