Skip to content
Is there an AI for this?

Alternatives

Self-hosted alternatives to AssemblyAI

Projects in the registry that can run on your own hardware and serve at least one of the same use cases as AssemblyAI.

Source
Registry relations over fetched repository records — the evidence sits on each repository page
Verified
Evidence not verified
Confidence
High

01How this list was built

Compared against
AssemblyAI
Delivery
SaaS products
Shared use cases
Call transcription, Meeting transcription, Voice agent
Selection rule
open source, or self-hostable, and shares a use case
Candidates found
5

02Alternatives

5

  • faster-whisper

    Libraries

    Reimplementation of Whisper on CTranslate2 with substantially lower memory use and faster inference, including int8 execution on CPU. The usual engine behind self-hosted transcription.

    Repository
    SYSTRAN/faster-whisper
    Stars
    25,259
    Licence
    MIT
    In stacks
    2

    Shares: Meeting transcription · Call transcription · Voice agent

  • LiveKit Agents

    Hybrid — hosted or self-hosted

    Framework for real-time voice and video agents on LiveKit’s WebRTC infrastructure, with turn detection, interruption handling and pluggable speech and model providers.

    Repository
    livekit/agents
    Stars
    14,030
    Licence
    Apache-2.0
    In stacks
    1

    Shares: Voice agent · Call transcription

  • LocalAI

    Model servers

    Drop-in OpenAI-compatible API server that runs text, embedding, image and audio models locally across several back ends, including CPU-only deployments.

    Repository
    mudler/LocalAI
    Stars
    49,166
    Licence
    MIT
    In stacks
    0

    Shares: Meeting transcription

  • Pipecat

    Frameworks

    Open-source framework for real-time voice and multimodal agents, composing speech-to-text, model and speech synthesis services into a streaming pipeline with barge-in support.

    Repository
    pipecat-ai/pipecat
    Stars
    15,659
    Licence
    BSD-2-Clause
    In stacks
    1

    Shares: Voice agent

  • WhisperX

    Libraries

    Whisper-based transcription pipeline adding word-level timestamps, forced alignment and speaker diarisation. Runs locally on GPU for batch transcription of recordings.

    Repository
    m-bain/whisperX
    Stars
    24,121
    Licence
    BSD-2-Clause
    In stacks
    1

    Shares: Meeting transcription · Call transcription

03Repository facts

RepositoryStarsHealth
SYSTRAN/faster-whisperFaster Whisper transcription with CTranslate225kMaintenance 20%, Releases 20%, Contributors 50%, Issues 87%, Community 88%48
livekit/agentsA framework for building realtime voice AI agents14kMaintenance 60%, Releases 60%, Contributors 50%, Issues 44%, Community 83%63
mudler/LocalAILocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.49kMaintenance 80%, Releases 80%, Contributors 50%, Issues 97%, Community 94%81
pipecat-ai/pipecatOpen Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community.16kMaintenance 80%, Releases 80%, Contributors 50%, Issues 78%, Community 84%76
m-bain/whisperXWhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)24kMaintenance 60%, Releases 40%, Contributors 50%, Issues 91%, Community 88%65

04Ask about your own case

Which alternative is right depends on how many people will use it, what the data is and what you can operate. Ask and the answer is researched for your organisation.

  1. 01What is a self-hosted alternative to AssemblyAI that we can run ourselves?