Alternatives
Self-hosted alternatives to Jan
Projects in the registry that can run on your own hardware and serve at least one of the same use cases as Jan.
- Source
- Registry relations over fetched repository records — the evidence sits on each repository page
- Verified
- Evidence not verified
- Confidence
- High
01How this list was built
- Compared against
- Jan
- Delivery
- Hybrid — hosted or self-hosted
- Shared use cases
- Local LLM, Private LLM, Document Q&A
- Selection rule
- open source, or self-hostable, and shares a use case
- Candidates found
- 19
02Alternatives
AnythingLLM
Hybrid — hosted or self-hosted
Desktop and server application that turns a document set into a chat workspace, with per-workspace embeddings, multiple model back ends and a built-in vector store.
- Repository
- Mintplex-Labs/anything-llm
- Stars
- 65,673
- Licence
- MIT
- In stacks
- 0
Shares: Document qa · Local llm
Chroma
Hybrid — hosted or self-hosted
Embedded and server-mode vector store with a small API surface, often used for prototypes and single-node retrieval before a larger engine is justified.
- Repository
- chroma-core/chroma
- Stars
- 29,329
- Licence
- Apache-2.0
- In stacks
- 0
Shares: Document qa
Continue
Hybrid — hosted or self-hosted
Open-source IDE extension for VS Code and JetBrains that connects completion and chat to any model back end, including a local server, under a checked-in configuration file.
- Repository
- continuedev/continue
- Stars
- 35,622
- Licence
- Apache-2.0
- In stacks
- 1
Shares: Local llm
Dify
Hybrid — hosted or self-hosted
Platform for building LLM applications: visual workflow editor, retrieval pipelines, agent tools, prompt management and an API layer. Available self-hosted or as a managed cloud service.
- Repository
- langgenius/dify
- Stars
- 153,448
- Licence
- Other
- In stacks
- 1
Shares: Document qa
Docling
Libraries
Document conversion toolkit that parses PDF, Office and image files into structured Markdown or JSON, preserving reading order, tables and figures for downstream retrieval.
- Repository
- docling-project/docling
- Stars
- 65,519
- Licence
- MIT
- In stacks
- 5
Shares: Document qa
Flowise
Hybrid — hosted or self-hosted
Visual builder for LLM chains and agents, with retrieval nodes, tool calling and an API or embeddable chat widget for the finished flow.
- Repository
- FlowiseAI/Flowise
- Stars
- 55,469
- Licence
- Other
- In stacks
- 0
Shares: Document qa
Kotaemon
Self-hosted projects
Document question-answering application with a configurable retrieval pipeline, inline citations that highlight the source passage, and support for local or hosted models.
- Repository
- Cinnamon/kotaemon
- Stars
- 25,775
- Licence
- Apache-2.0
- In stacks
- 0
Shares: Document qa
LangChain
Frameworks
Library for composing model calls, retrieval and tools into applications, with adapters for most providers and vector stores. A building block, not a deployable product.
- Repository
- langchain-ai/langchain
- Stars
- 146,657
- Licence
- MIT
- In stacks
- 0
Shares: Document qa
Langflow
Hybrid — hosted or self-hosted
Visual environment for composing LLM pipelines and agents from components, with export to a Python application or an API endpoint.
- Repository
- langflow-ai/langflow
- Stars
- 155,003
- Licence
- MIT
- In stacks
- 0
Shares: Document qa
LibreChat
Self-hosted projects
Self-hosted multi-model chat application with authentication, per-conversation model switching, plugins, file upload and an admin configuration file. Familiar interface for staff moving off consumer tools.
- Repository
- danny-avila/LibreChat
- Stars
- 42,850
- Licence
- MIT
- In stacks
- 0
Shares: Private llm · Document qa
LiteLLM
Cloud platforms
Gateway that presents one OpenAI-compatible API in front of many providers and local servers, with per-team keys, budgets, rate limits, fallbacks and request logging.
- Repository
- BerriAI/litellm
- Stars
- 57,216
- Licence
- Other
- In stacks
- 3
Shares: Private llm · Local llm
llama.cpp
Libraries
C++ inference engine for quantised models on CPU, Apple Silicon and GPUs, with a bundled HTTP server. The engine underneath many desktop runtimes and the GGUF quantisation format.
- Repository
- ggml-org/llama.cpp
- Stars
- 128,796
- Licence
- MIT
- In stacks
- 0
Shares: Local llm · Private llm
LlamaIndex
Frameworks
Data framework for retrieval applications: loaders for many document types, indexing and query pipelines, and evaluation helpers for retrieval quality.
- Repository
- run-llama/llama_index
- Stars
- 52,226
- Licence
- MIT
- In stacks
- 0
Shares: Document qa
LMDeploy
Model servers
Serving toolkit from the InternLM team with its own inference engine and quantisation tooling, and strong coverage of Chinese open-weight model families.
- Repository
- InternLM/lmdeploy
- Stars
- 8,082
- Licence
- Apache-2.0
- In stacks
- 0
Shares: Local llm · Private llm
LM Studio
Hybrid — hosted or self-hosted
Desktop application for downloading and running open-weight models locally, with a chat interface and a local OpenAI-compatible server. Windows, macOS and Linux.
- Repository
- none linked
- Stars
- —
- Licence
- unknown
- In stacks
- 1
Shares: Local llm · Private llm · Document qa
LocalAI
Model servers
Drop-in OpenAI-compatible API server that runs text, embedding, image and audio models locally across several back ends, including CPU-only deployments.
- Repository
- mudler/LocalAI
- Stars
- 49,166
- Licence
- MIT
- In stacks
- 0
Shares: Local llm · Private llm
Marker
Libraries
PDF-to-Markdown converter aimed at long documents, with optional model-assisted correction. Published under a licence with a revenue condition — read it before commercial use.
- Repository
- datalab-to/marker
- Stars
- 39,841
- Licence
- Apache-2.0
- In stacks
- 0
Shares: Document qa
Milvus
Hybrid — hosted or self-hosted
Distributed vector database designed for large collections, with several index types, GPU indexing options and a separated storage and compute architecture.
- Repository
- milvus-io/milvus
- Stars
- 46,159
- Licence
- Apache-2.0
- In stacks
- 0
Shares: Document qa
MinerU
Libraries
Converts PDFs to structured Markdown or JSON, keeping reading order, tables and formulae. Handles Chinese layouts, which most Western-trained parsers do poorly.
- Repository
- opendatalab/MinerU
- Stars
- 80,242
- Licence
- Other
- In stacks
- 0
Shares: Document qa
03Repository facts
| Repository | Stars | Health |
|---|---|---|
| Mintplex-Labs/anything-llmStop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience | 66k | Maintenance 60%, Releases 60%, Contributors 50%, Issues 95%, Community 96%71 |
| chroma-core/chromaSearch infrastructure for AI | 29k | Maintenance 80%, Releases 40%, Contributors 50%, Issues 70%, Community 89%69 |
| continuedev/continueopen-source coding agent | 36k | Maintenance 60%, Releases 40%, Contributors 50%, Issues 74%, Community 91%64 |
| langgenius/difyBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack. | 153k | Maintenance 60%, Releases 60%, Contributors 50%, Issues 94%, Community 100%72 |
| docling-project/doclingGet your documents ready for gen AI | 66k | Maintenance 60%, Releases 60%, Contributors 50%, Issues 85%, Community 96%70 |
| FlowiseAI/FlowisearchivedBuild AI Agents, Visually | 55k | Maintenance 0%, Releases 60%, Contributors 50%, Issues 81%, Community 95%51 |
| Cinnamon/kotaemonAn open-source RAG-based tool for chatting with your documents. | 26k | Maintenance 40%, Releases 40%, Contributors 50%, Issues 90%, Community 88%59 |
| langchain-ai/langchainThe agent engineering platform. | 147k | Maintenance 80%, Releases 60%, Contributors 50%, Issues 96%, Community 100%78 |
| langflow-ai/langflowLangflow is a powerful tool for building and deploying AI-powered agents and workflows. | 155k | Maintenance 80%, Releases 60%, Contributors 50%, Issues 93%, Community 100%78 |
| danny-avila/LibreChatEnhanced ChatGPT Clone: Features Agents, MCP, Skills, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, Code Interpreter, langchain, DALL-E-3, OpenAPI Actions, Functions, Secure Multi-User Auth, Presets, open-source for self-hosting. Active | 43k | Maintenance 60%, Releases 30%, Contributors 50%, Issues 83%, Community 93%63 |
| BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] | 57k | Maintenance 60%, Releases 60%, Contributors 50%, Issues 14%, Community 95%63 |
| ggml-org/llama.cppLLM inference in C/C++ | 129k | Maintenance 80%, Releases 60%, Contributors 50%, Issues 81%, Community 100%77 |
| run-llama/llama_indexLlamaIndex is the document processing platform for AI | 52k | Maintenance 80%, Releases 60%, Contributors 50%, Issues 85%, Community 94%76 |
| InternLM/lmdeployLMDeploy is a toolkit for compressing, deploying, and serving LLMs. | 8.1k | Maintenance 80%, Releases 60%, Contributors 50%, Issues 26%, Community 78%66 |
| mudler/LocalAILocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. | 49k | Maintenance 80%, Releases 80%, Contributors 50%, Issues 97%, Community 94%81 |
| datalab-to/markerConvert PDF to markdown + JSON quickly with high accuracy | 40k | Maintenance 60%, Releases 60%, Contributors 50%, Issues 88%, Community 92%69 |
| milvus-io/milvusMilvus is a high-performance, cloud-native vector database built for scalable vector ANN search | 46k | Maintenance 80%, Releases 60%, Contributors 50%, Issues 69%, Community 93%74 |
| opendatalab/MinerUTransforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows. | 80k | Maintenance 80%, Releases 80%, Contributors 50%, Issues 99%, Community 98%82 |
04Ask about your own case
Which alternative is right depends on how many people will use it, what the data is and what you can operate. Ask and the answer is researched for your organisation.