ddalcu/mlx-serve

by ddalcu · Toolkits & Frameworks · updated today

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

More in Toolkits & Frameworks

Speech

NVIDIA-NeMo

15

Toolkits & Frameworks

A scalable generative AI framework built for researchers and developers working on Large L

pipecat

pipecat-ai

17

Toolkits & Frameworks

Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Da

sherpa-onnx

k2-fsa

19

Toolkits & Frameworks

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation

agents

livekit

20

Toolkits & Frameworks

A framework for building realtime voice AI agents 🤖🎙️📹