Alternatives
Self-hosted alternatives to OpenRouter
Projects in the registry that can run on your own hardware and serve at least one of the same use cases as OpenRouter.
- Source
- Registry relations over fetched repository records — the evidence sits on each repository page
- Verified
- Evidence not verified
- Confidence
- High
01How this list was built
- Compared against
- OpenRouter
- Delivery
- Cloud platforms
- Shared use cases
- Choosing a model, Agent workflow, Private company ChatGPT
- Selection rule
- open source, or self-hostable, and shares a use case
- Candidates found
- 11
02Alternatives
AnythingLLM
Hybrid — hosted or self-hosted
Desktop and server application that turns a document set into a chat workspace, with per-workspace embeddings, multiple model back ends and a built-in vector store.
- Repository
- Mintplex-Labs/anything-llm
- Stars
- —
- Licence
- unknown
- In stacks
- 0
Shares: Private company chatgpt
authentik
Hybrid — hosted or self-hosted
Identity provider with OpenID Connect, SAML and proxy-based authentication, application-level policies and a forward-auth outpost for services that have no login of their own.
- Repository
- goauthentik/authentik
- Stars
- —
- Licence
- unknown
- In stacks
- 0
Shares: Private company chatgpt
Dify
Hybrid — hosted or self-hosted
Platform for building LLM applications: visual workflow editor, retrieval pipelines, agent tools, prompt management and an API layer. Available self-hosted or as a managed cloud service.
- Repository
- langgenius/dify
- Stars
- 153,448
- Licence
- Other
- In stacks
- 1
Shares: Private company chatgpt
Keycloak
Self-hosted projects
Identity and access management server providing OpenID Connect and SAML single sign-on, user federation, groups and roles for self-hosted applications.
- Repository
- keycloak/keycloak
- Stars
- 36,449
- Licence
- Apache-2.0
- In stacks
- 4
Shares: Private company chatgpt
Langfuse
Hybrid — hosted or self-hosted
Tracing, evaluation and prompt management for LLM applications, self-hostable so prompts and responses can stay inside the network being audited.
- Repository
- langfuse/langfuse
- Stars
- —
- Licence
- unknown
- In stacks
- 1
Shares: Private company chatgpt
LangGraph
Frameworks
Graph-structured agent framework with explicit state, checkpoints and interrupts — the mechanism behind a human approval step rather than a prompt asking for one.
- Repository
- langchain-ai/langgraph
- Stars
- —
- Licence
- unknown
- In stacks
- 1
Shares: Agent workflow
LibreChat
Self-hosted projects
Self-hosted multi-model chat application with authentication, per-conversation model switching, plugins, file upload and an admin configuration file. Familiar interface for staff moving off consumer tools.
- Repository
- danny-avila/LibreChat
- Stars
- —
- Licence
- unknown
- In stacks
- 0
Shares: Private company chatgpt
LiteLLM
Cloud platforms
Gateway that presents one OpenAI-compatible API in front of many providers and local servers, with per-team keys, budgets, rate limits, fallbacks and request logging.
- Repository
- BerriAI/litellm
- Stars
- 57,216
- Licence
- Other
- In stacks
- 3
Shares: Private company chatgpt
MLflow
Cloud platforms
Experiment tracking, a model registry and deployment packaging. The component that lets a prediction be traced back to the model version and data that produced it.
- Repository
- mlflow/mlflow
- Stars
- —
- Licence
- unknown
- In stacks
- 1
Shares: Model selection
NVIDIA NIM
Model servers
Prebuilt inference containers with an OpenAI-compatible API, deployable into your own cluster including air-gapped sites. Licensed through NVIDIA AI Enterprise rather than open source.
- Repository
- none linked
- Stars
- —
- Licence
- unknown
- In stacks
- 0
Shares: Private company chatgpt
Ollama
Model servers
Local model runtime with a one-command install, a model library and an OpenAI-compatible API. The usual starting point for running open-weight models on a workstation or small server.
- Repository
- ollama/ollama
- Stars
- 179,403
- Licence
- MIT
- In stacks
- 4
Shares: Private company chatgpt
03Repository facts
| Repository | Stars | Health |
|---|---|---|
| Mintplex-Labs/anything-llm | — | Health not measuredunknown |
| goauthentik/authentik | — | Health not measuredunknown |
| langgenius/difyBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack. | 153k | Maintenance 100%, Releases 60%, Contributors 50%, Issues 94%, Community 100%84 |
| keycloak/keycloakOpen Source Identity and Access Management For Modern Applications and Services | 36k | Maintenance 100%, Releases 80%, Contributors 50%, Issues 14%, Community 91%78 |
| langfuse/langfuse | — | Health not measuredunknown |
| langchain-ai/langgraph | — | Health not measuredunknown |
| danny-avila/LibreChat | — | Health not measuredunknown |
| BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] | 57k | Maintenance 100%, Releases 100%, Contributors 50%, Issues 14%, Community 95%83 |
| mlflow/mlflow | — | Health not measuredunknown |
| ollama/ollamaGet up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. | 179k | Maintenance 100%, Releases 80%, Contributors 50%, Issues 79%, Community 100%86 |
04Ask about your own case
Which alternative is right depends on how many people will use it, what the data is and what you can operate. Ask and the answer is researched for your organisation.