Skip to content
Is there an AI for this?

Alternatives

Self-hosted alternatives to Milvus

Projects in the registry that can run on your own hardware and serve at least one of the same use cases as Milvus.

Source
Registry relations over fetched repository records — the evidence sits on each repository page
Verified
Evidence not verified
Confidence
High

01How this list was built

Compared against
Milvus
Delivery
Hybrid — hosted or self-hosted
Shared use cases
Internal company search, Document Q&A, Data extraction
Selection rule
open source, or self-hostable, and shares a use case
Candidates found
21

02Alternatives

21
  • AnythingLLM

    Hybrid — hosted or self-hosted

    Desktop and server application that turns a document set into a chat workspace, with per-workspace embeddings, multiple model back ends and a built-in vector store.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Document qa · Internal knowledge search

  • authentik

    Hybrid — hosted or self-hosted

    Identity provider with OpenID Connect, SAML and proxy-based authentication, application-level policies and a forward-auth outpost for services that have no login of their own.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Internal knowledge search

  • Chroma

    Hybrid — hosted or self-hosted

    Embedded and server-mode vector store with a small API surface, often used for prototypes and single-node retrieval before a larger engine is justified.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Document qa · Internal knowledge search

  • Dify

    Hybrid — hosted or self-hosted

    Platform for building LLM applications: visual workflow editor, retrieval pipelines, agent tools, prompt management and an API layer. Available self-hosted or as a managed cloud service.

    Repository
    langgenius/dify
    Stars
    153,448
    Licence
    Other
    In stacks
    1

    Shares: Internal knowledge search · Document qa

  • Docling

    Libraries

    Document conversion toolkit that parses PDF, Office and image files into structured Markdown or JSON, preserving reading order, tables and figures for downstream retrieval.

    Stars
    65,519
    Licence
    MIT
    In stacks
    4

    Shares: Data extraction · Document qa · Internal knowledge search

  • Flowise

    Hybrid — hosted or self-hosted

    Visual builder for LLM chains and agents, with retrieval nodes, tool calling and an API or embeddable chat widget for the finished flow.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Document qa · Internal knowledge search

  • Keycloak

    Self-hosted projects

    Identity and access management server providing OpenID Connect and SAML single sign-on, user federation, groups and roles for self-hosted applications.

    Stars
    Licence
    unknown
    In stacks
    3

    Shares: Internal knowledge search

  • Kotaemon

    Self-hosted projects

    Document question-answering application with a configurable retrieval pipeline, inline citations that highlight the source passage, and support for local or hosted models.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Document qa · Internal knowledge search

  • LangChain

    Frameworks

    Library for composing model calls, retrieval and tools into applications, with adapters for most providers and vector stores. A building block, not a deployable product.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Document qa · Internal knowledge search

  • Langflow

    Hybrid — hosted or self-hosted

    Visual environment for composing LLM pipelines and agents from components, with export to a Python application or an API endpoint.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Document qa · Internal knowledge search

  • Langfuse

    Hybrid — hosted or self-hosted

    Tracing, evaluation and prompt management for LLM applications, self-hostable so prompts and responses can stay inside the network being audited.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Internal knowledge search

  • LibreChat

    Self-hosted projects

    Self-hosted multi-model chat application with authentication, per-conversation model switching, plugins, file upload and an admin configuration file. Familiar interface for staff moving off consumer tools.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Document qa

  • LlamaIndex

    Frameworks

    Data framework for retrieval applications: loaders for many document types, indexing and query pipelines, and evaluation helpers for retrieval quality.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Document qa · Internal knowledge search · Data extraction

  • LM Studio

    Hybrid — hosted or self-hosted

    Desktop application for downloading and running open-weight models locally, with a chat interface and a local OpenAI-compatible server. Windows, macOS and Linux.

    Repository
    none linked
    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Document qa

  • Onyx

    Hybrid — hosted or self-hosted

    Open-source enterprise search and chat over company systems, with connectors to common SaaS tools, permission-aware indexing and a self-hosted deployment path.

    Stars
    31,754
    Licence
    Other
    In stacks
    0

    Shares: Internal knowledge search · Document qa

  • Open WebUI

    Self-hosted projects

    Self-hosted chat interface for local and hosted models, with user accounts, groups, document upload and built-in retrieval. Runs in Docker against Ollama, vLLM or any OpenAI-compatible endpoint.

    Stars
    149,870
    Licence
    Other
    In stacks
    4

    Shares: Internal knowledge search · Document qa

  • PaddleOCR

    Libraries

    OCR toolkit with detection, recognition and layout models, including Chinese and other East Asian scripts, plus table and formula recognition. Runs offline on CPU or GPU.

    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Data extraction

  • pgvector

    Libraries

    PostgreSQL extension adding vector types and HNSW or IVFFlat indexes, so embeddings live in the same database and the same backup as the rest of the application data.

    Stars
    22,735
    Licence
    Other
    In stacks
    5

    Shares: Internal knowledge search · Document qa

  • PostgreSQL

    Self-hosted projects

    Relational database used here as the system of record for documents, metadata and job queues, and — with pgvector — for embeddings as well.

    Repository
    none linked
    Stars
    Licence
    unknown
    In stacks
    3

    Shares: Internal knowledge search · Document qa

  • Qdrant

    Hybrid — hosted or self-hosted

    Vector search engine written in Rust with payload filtering, hybrid search, quantisation and snapshots. Runs as a single container or a cluster, or as a managed cloud service.

    Repository
    qdrant/qdrant
    Stars
    Licence
    unknown
    In stacks
    0

    Shares: Internal knowledge search · Document qa

  • RAGFlow

    Self-hosted projects

    Retrieval engine built around deep document parsing: layout-aware chunking of PDFs, tables and scans, citation-backed answers, and a visual pipeline for building knowledge bases.

    Stars
    Licence
    unknown
    In stacks
    1

    Shares: Internal knowledge search · Document qa · Data extraction


03Repository facts

RepositoryStarsHealth
Mintplex-Labs/anything-llmHealth not measuredunknown
goauthentik/authentikHealth not measuredunknown
chroma-core/chromaHealth not measuredunknown
langgenius/difyBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.153kMaintenance 100%, Releases 80%, Contributors 50%, Issues 94%, Community 100%88
docling-project/doclingGet your documents ready for gen AI66kMaintenance 100%, Releases 100%, Contributors 50%, Issues 85%, Community 96%90
FlowiseAI/FlowiseHealth not measuredunknown
keycloak/keycloakHealth not measuredunknown
Cinnamon/kotaemonHealth not measuredunknown
langchain-ai/langchainHealth not measuredunknown
langflow-ai/langflowHealth not measuredunknown
langfuse/langfuseHealth not measuredunknown
danny-avila/LibreChatHealth not measuredunknown
run-llama/llama_indexHealth not measuredunknown
onyx-dot-app/onyxOpen Source AI Platform - AI Chat with advanced features that works with every LLM32kMaintenance 100%, Releases 100%, Contributors 50%, Issues 87%, Community 90%89
open-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)150kMaintenance 100%, Releases 80%, Contributors 50%, Issues 99%, Community 100%88
PaddlePaddle/PaddleOCRHealth not measuredunknown
pgvector/pgvectorOpen-source vector similarity search for Postgres23kMaintenance 100%, Releases 30%, Contributors 50%, Issues 99%, Community 87%75
qdrant/qdrantHealth not measuredunknown
infiniflow/ragflowHealth not measuredunknown

04Ask about your own case

Which alternative is right depends on how many people will use it, what the data is and what you can operate. Ask and the answer is researched for your organisation.

  1. 01What is a self-hosted alternative to Milvus that we can run ourselves?