llama.cpp

Full repository record

Nothing has been verified about this tool yet, and no vendor document is being watched for it.

No vendor document is being watched for this tool.

Self-hosted

Can be run on hardware you own or rent, with no vendor in the data path.

No published deployment stack uses this tool yet.

Tools that serve at least one of the same use cases. Open-source alternatives, with the repository facts behind them, have their own page.

Self-hosted alternatives to llama.cpp

• Cloud platformsAmazon BedrockAWS service offering models from several providers behind one API in a chosen region, with VPC endpoints, IAM control, guardrails and knowledge bases for retrieval.
• Hybrid — hosted or self-hostedAnythingLLMDesktop and server application that turns a document set into a chat workspace, with per-workspace embeddings, multiple model back ends and a built-in vector store.
• Cloud platformsAzure OpenAI ServiceOpenAI models served from a customer-selected Azure region under Azure commercial terms, with private networking, content filtering and Entra ID integration.
• Hybrid — hosted or self-hostedContinueOpen-source IDE extension for VS Code and JetBrains that connects completion and chat to any model back end, including a local server, under a checked-in configuration file.
• Cloud platformsGoogle Vertex AIGoogle Cloud platform for Gemini and third-party models with regional endpoints, VPC Service Controls, grounding against your own data and enterprise IAM.
• Self-hosted projectsLibreChatSelf-hosted multi-model chat application with authentication, per-conversation model switching, plugins, file upload and an admin configuration file. Familiar interface for staff moving off consumer tools.
• Cloud platformsLiteLLMGateway that presents one OpenAI-compatible API in front of many providers and local servers, with per-team keys, budgets, rate limits, fallbacks and request logging.
• Hybrid — hosted or self-hostedLM StudioDesktop application for downloading and running open-weight models locally, with a chat interface and a local OpenAI-compatible server. Windows, macOS and Linux.
• Model serversLocalAIDrop-in OpenAI-compatible API server that runs text, embedding, image and audio models locally across several back ends, including CPU-only deployments.
• SaaS productsMistral Le ChatAssistant and API platform from a European vendor, offered as a hosted service and, for enterprise customers, as a deployment inside the customer’s own infrastructure.
• Model serversOllamaLocal model runtime with a one-command install, a model library and an OpenAI-compatible API. The usual starting point for running open-weight models on a workstation or small server.
• Self-hosted projectsOpen WebUISelf-hosted chat interface for local and hosted models, with user accounts, groups, document upload and built-in retrieval. Runs in Docker against Ollama, vLLM or any OpenAI-compatible endpoint.

Issue-spotting for this tool under each published jurisdiction, built from the same rules an answer uses. A page with nothing researched says so rather than filling the gap.

• europellama.cpp in European UnionRegulation (EU) 2016/679 (GDPR). Directly applicable in every Member State and unamended as of the review date. An AI deployment engages Articles 5 and 6 on principles and lawful basis, 9 on special categories, 13 and 14 on information, 22 on decisions based solely on automated processing, 28 on processors, 32 on security, 35 on impact assessments and Chapter V on transfers out of the EEA. Member States retain room to legislate on employment, which is where Germany’s BDSG § 26 comes in.
• europellama.cpp in United KingdomUK GDPR, as retained and amended, together with the Data Protection Act 2018. The core duties are unchanged in shape — lawful basis, transparency, purpose limitation, security, processor contracts, international transfers — but the automated decision-making regime now sits in Articles 22A to 22D rather than Article 22. Article 22A defines a decision as based solely on automated processing where there is no meaningful human involvement, and a significant decision as one producing a legal or similarly significant effect. Whether human involvement is meaningful must be considered in light of the extent to which the decision is reached by profiling.
• north-asiallama.cpp in China (mainland)Personal Information Protection Law (PIPL), in force since 1 November 2021. Requires a lawful basis, notice, and separate consent for defined activities including providing personal information to a third party, publicising it, processing sensitive personal information and sending it abroad. Sensitive personal information needs a specific purpose, sufficient necessity and strict protective measures. A personal information protection impact assessment is required before high-risk processing, including any outbound transfer. Article 38 sets the outbound routes. Entrusted processing must be governed by a contract that fixes purpose, period, method and protective measures.
• north-asiallama.cpp in Hong KongPersonal Data (Privacy) Ordinance (Cap. 486). The Ordinance applies to any person who controls the collection, holding, processing or use of personal data, and works through six Data Protection Principles in Schedule 1 covering collection, accuracy and retention, use, security, openness and access. Data processors are not directly regulated: the data user stays responsible and must impose the requirements on its processors by contract or other means. Contravening a Data Protection Principle is not itself an offence, but the Commissioner may issue an enforcement notice and contravening that notice is.
• north-asiallama.cpp in JapanAct on the Protection of Personal Information (個人情報の保護に関する法律, Act No. 57 of 2003). Requires the purpose of use to be specified and adhered to, restricts acquisition and third-party provision, sets security control measures, and imposes duties when personal data is entrusted to a contractor — which is what using a model provider usually is. Transfers to a third party in a foreign country are subject to their own regime, with an information duty to the individual. The e-Gov entry currently shows unenforced provisions pending, so check which version applies before relying on an article number.
• north-asiallama.cpp in South KoreaPersonal Information Protection Act (개인정보 보호법). The version in force is Act No. 20897, effective 2 October 2025. It sets consent and alternative bases, purpose limitation, retention limits, security duties, breach notification and cross-border rules, and since March 2023 has carried Article 37-2, the right of a data subject to object to or refuse a decision made by a completely automated system — expressly including systems applying artificial intelligence — where that decision significantly affects their rights or duties. An amendment promulgated on 10 March 2026 takes effect on 11 September 2026.
• north-asiallama.cpp in TaiwanPersonal Data Protection Act (個人資料保護法). Applies to public and non-public agencies, with separate collection and use rules for each. Notice at collection, purpose limitation, and a set of statutory bases are the core; special categories including medical records, genetic data, sexual life, health examination and criminal records are subject to a narrower regime. Article 21 lets the competent authority restrict international transfer in defined circumstances — under the text in force, that is the central sector regulator, and restrictions are issued sector by sector rather than as a general adequacy list.

No sources were recorded for this answer. Nothing on this page should be treated as verified.