waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
$ git clone https://github.com/ARahim3/mlx-tune.gitHigh-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit
▲ +373 ★ this week
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
▲ +25 ★ this week
Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
Voice input for macOS on local models: transcribe, translate and rewrite in any app. The successor of Voxt.
Data from GitHub · snapshot Nov 16, 2026