The Voice AI Index / Toolkits & Frameworks / #92
ddalcu

ddalcu/mlx-serve

by ddalcu · Toolkits & Frameworks · updated today

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

65
momentum
1,239
stars
114
forks
#92
rank
agentanthropic-apiapple-siliconclaude-codedeepseek-v4diffusionggufimage-generationinferencellmlocal-llmmacos
View on GitHub →