Language Models
bigscience-workshop/petals
β² +13 β this week
πΈ Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
π§ Natural Language Processing
PythonMITupdated Sep 7, 2024
π¬ Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
$ git clone https://github.com/petals-infra/chat.petals.dev.gitβ² +13 β this week
πΈ Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
[EMNLP-2024] Build multimodal language agents for fast prototype and production
β² +9 β this week
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
π©ΉEditing large language models within 10 secondsβ‘
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
β² +117 β this week
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Data from GitHub Β· snapshot Nov 13, 2026