Language Models
petals-infra/chat.petals.dev
π¬ Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
Pythonno licenseupdated Apr 22, 2024
πΈ Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
$ git clone https://github.com/bigscience-workshop/petals.git㪠Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
π©ΉEditing large language models within 10 secondsβ‘
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
Tiny C++ LLM inference implementation from scratch
[EMNLP-2024] Build multimodal language agents for fast prototype and production
β² +8 β this week
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
Data from GitHub Β· snapshot Nov 16, 2026