πŸ† #3,323 overall#745 of 1,375 in Language Models

petals-infra /chat.petals.dev

πŸ’¬ Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

$ git clone https://github.com/petals-infra/chat.petals.dev.git
GitHub social preview for petals-infra/chat.petals.dev
Stars
319
319
This week
β€”
Forks
79
79
Language
Python
License
None
Created
Dec 28, 2022
3.9 years old
Last push
Apr 22, 2024

Categories

GitHub topics

More in Language Models

Language Models

bigscience-workshop/petals

β–² +13 β˜… this week

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

🧠 Natural Language Processing
PythonMITupdated Sep 7, 2024
GitHub β†—β˜… 10.7Kβ‘‚ 656
Language Models

om-ai-lab/OmAgent

[EMNLP-2024] Build multimodal language agents for fast prototype and production

πŸ” Search & Retrieval
PythonApache-2.0updated Oct 16, 2026
GitHub β†—β˜… 2.7Kβ‘‚ 288
Language Models

GradientHQ/parallax

β–² +9 β˜… this week

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

PythonApache-2.0updated Jul 1, 2026
GitHub β†—β˜… 1.4Kβ‘‚ 154
Language Models

hiyouga/FastEdit

🩹Editing large language models within 10 seconds⚑

PythonApache-2.0updated Aug 13, 2023
GitHub β†—β˜… 1.4Kβ‘‚ 103
Language Models

AI-Hypercomputer/JetStream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

PythonApache-2.0updated Jan 5, 2026
GitHub β†—β˜… 473β‘‚ 70
Language Models

hiyouga/LlamaFactoryπŸ”₯ active

β–² +117 β˜… this week

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🧠 Natural Language Processing
PythonApache-2.0updated Nov 13, 2026
GitHub β†—β˜… 76Kβ‘‚ 9.4K

Data from GitHub Β· snapshot Nov 13, 2026