πŸ† #223 overall#54 of 1,378 in Language Models

bigscience-workshop /petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

$ git clone https://github.com/bigscience-workshop/petals.git
GitHub social preview for bigscience-workshop/petals
Stars
10.7K
10,716
This week
+16 β˜…
+78 this month
Forks
658
658
Language
Python
License
MIT
Created
Jun 12, 2022
4.4 years old
Last push
Sep 7, 2024

Stars, last 30 days

Oct 15, 2026 β†’ Nov 16, 2026
β˜… 10.6Kβ–² +86β˜… 10.7K

Categories

GitHub topics

More in Language Models

Language Models

petals-infra/chat.petals.dev

πŸ’¬ Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

Pythonno licenseupdated Apr 22, 2024
GitHub β†—β˜… 319β‘‚ 79
Language Models

hiyouga/FastEdit

🩹Editing large language models within 10 seconds⚑

PythonApache-2.0updated Aug 13, 2023
GitHub β†—β˜… 1.4Kβ‘‚ 103
Language Models

young-geng/EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

🧠 Natural Language Processing
PythonApache-2.0updated Aug 13, 2024
GitHub β†—β˜… 2.5Kβ‘‚ 262
Language Models

keith2018/TinyGPT

Tiny C++ LLM inference implementation from scratch

🧠 Natural Language Processing
C++MITupdated Jun 23, 2026
GitHub β†—β˜… 132β‘‚ 21
Language Models

om-ai-lab/OmAgent

[EMNLP-2024] Build multimodal language agents for fast prototype and production

πŸ” Search & Retrieval
PythonApache-2.0updated Oct 16, 2026
GitHub β†—β˜… 2.7Kβ‘‚ 288
Language Models

GradientHQ/parallax

β–² +8 β˜… this week

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

PythonApache-2.0updated Jul 1, 2026
GitHub β†—β˜… 1.4Kβ‘‚ 154

Data from GitHub Β· snapshot Nov 16, 2026