Alternatives
Self-hosted alternatives to Google Vertex AI
Projects in the registry that can run on your own hardware and serve at least one of the same use cases as Google Vertex AI.
- Source
- Registry relations over fetched repository records — the evidence sits on each repository page
- Verified
- Evidence not verified
- Confidence
- High
01How this list was built
- Compared against
- Google Vertex AI
- Delivery
- Cloud platforms
- Shared use cases
- Private LLM, Internal company search, Document Q&A, Translation, Data extraction, Choosing a cloud platform
- Selection rule
- open source, or self-hostable, and shares a use case
- Candidates found
- 10
02Alternatives
AnythingLLM
Hybrid — hosted or self-hosted
Desktop and server application that turns a document set into a chat workspace, with per-workspace embeddings, multiple model back ends and a built-in vector store.
- Repository
- Mintplex-Labs/anything-llm
- Stars
- 65,673
- Licence
- MIT
- In stacks
- 0
Shares: Document qa · Internal knowledge search
authentik
Hybrid — hosted or self-hosted
Identity provider with OpenID Connect, SAML and proxy-based authentication, application-level policies and a forward-auth outpost for services that have no login of their own.
- Repository
- goauthentik/authentik
- Stars
- 25,644
- Licence
- Other
- In stacks
- 0
Shares: Internal knowledge search
Chroma
Hybrid — hosted or self-hosted
Embedded and server-mode vector store with a small API surface, often used for prototypes and single-node retrieval before a larger engine is justified.
- Repository
- chroma-core/chroma
- Stars
- 29,329
- Licence
- Apache-2.0
- In stacks
- 0
Shares: Document qa · Internal knowledge search
Dify
Hybrid — hosted or self-hosted
Platform for building LLM applications: visual workflow editor, retrieval pipelines, agent tools, prompt management and an API layer. Available self-hosted or as a managed cloud service.
- Repository
- langgenius/dify
- Stars
- 153,448
- Licence
- Other
- In stacks
- 1
Shares: Internal knowledge search · Document qa
Docling
Libraries
Document conversion toolkit that parses PDF, Office and image files into structured Markdown or JSON, preserving reading order, tables and figures for downstream retrieval.
- Repository
- docling-project/docling
- Stars
- 65,519
- Licence
- MIT
- In stacks
- 5
Shares: Data extraction · Document qa · Internal knowledge search
Flowise
Hybrid — hosted or self-hosted
Visual builder for LLM chains and agents, with retrieval nodes, tool calling and an API or embeddable chat widget for the finished flow.
- Repository
- FlowiseAI/Flowise
- Stars
- 55,469
- Licence
- Other
- In stacks
- 0
Shares: Document qa · Internal knowledge search
Jan
Hybrid — hosted or self-hosted
Open-source desktop assistant that runs open-weight models locally and can also call remote endpoints. The open alternative to LM Studio for a single-machine deployment.
- Repository
- janhq/jan
- Stars
- 44,559
- Licence
- Other
- In stacks
- 0
Shares: Private llm · Document qa
Keycloak
Self-hosted projects
Identity and access management server providing OpenID Connect and SAML single sign-on, user federation, groups and roles for self-hosted applications.
- Repository
- keycloak/keycloak
- Stars
- 36,449
- Licence
- Apache-2.0
- In stacks
- 4
Shares: Internal knowledge search
Kotaemon
Self-hosted projects
Document question-answering application with a configurable retrieval pipeline, inline citations that highlight the source passage, and support for local or hosted models.
- Repository
- Cinnamon/kotaemon
- Stars
- 25,775
- Licence
- Apache-2.0
- In stacks
- 0
Shares: Document qa · Internal knowledge search
LangChain
Frameworks
Library for composing model calls, retrieval and tools into applications, with adapters for most providers and vector stores. A building block, not a deployable product.
- Repository
- langchain-ai/langchain
- Stars
- 146,657
- Licence
- MIT
- In stacks
- 0
Shares: Document qa · Internal knowledge search
03Repository facts
| Repository | Stars | Health |
|---|---|---|
| Mintplex-Labs/anything-llmStop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience | 66k | Maintenance 60%, Releases 60%, Contributors 50%, Issues 95%, Community 96%71 |
| goauthentik/authentikThe authentication glue you need. | 26k | Maintenance 80%, Releases 80%, Contributors 50%, Issues 57%, Community 88%75 |
| chroma-core/chromaSearch infrastructure for AI | 29k | Maintenance 80%, Releases 40%, Contributors 50%, Issues 70%, Community 89%69 |
| langgenius/difyBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack. | 153k | Maintenance 60%, Releases 60%, Contributors 50%, Issues 94%, Community 100%72 |
| docling-project/doclingGet your documents ready for gen AI | 66k | Maintenance 60%, Releases 60%, Contributors 50%, Issues 85%, Community 96%70 |
| FlowiseAI/FlowisearchivedBuild AI Agents, Visually | 55k | Maintenance 0%, Releases 60%, Contributors 50%, Issues 81%, Community 95%51 |
| janhq/janJan is an open source alternative to ChatGPT that runs 100% offline on your computer. | 45k | Maintenance 80%, Releases 60%, Contributors 50%, Issues 88%, Community 93%76 |
| keycloak/keycloakOpen Source Identity and Access Management For Modern Applications and Services | 36k | Maintenance 60%, Releases 60%, Contributors 50%, Issues 14%, Community 91%62 |
| Cinnamon/kotaemonAn open-source RAG-based tool for chatting with your documents. | 26k | Maintenance 40%, Releases 40%, Contributors 50%, Issues 90%, Community 88%59 |
| langchain-ai/langchainThe agent engineering platform. | 147k | Maintenance 80%, Releases 60%, Contributors 50%, Issues 96%, Community 100%78 |
04Ask about your own case
Which alternative is right depends on how many people will use it, what the data is and what you can operate. Ask and the answer is researched for your organisation.