🏆 #2,558 overall#573 of 1,375 in Language Models

AI-Hypercomputer /JetStream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

$ git clone https://github.com/AI-Hypercomputer/JetStream.git
GitHub social preview for AI-Hypercomputer/JetStream
Stars
473
473
This week
—
Forks
70
70
Language
Python
License
Apache-2.0
Created
Mar 1, 2024
2.7 years old
Last push
Jan 5, 2026

Categories

GitHub topics

More in Language Models

Language Models

darrenburns/elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

PythonApache-2.0updated Oct 10, 2024
GitHub ↗★ 2.5K⑂ 156
Language Models

JayZhang42/SLED

SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433

Pythonno licenseupdated Dec 5, 2024
GitHub ↗★ 123⑂ 20
Language Models

hiyouga/LlamaFactory🔥 active

▲ +117 ★ this week

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🧠 Natural Language Processing
PythonApache-2.0updated Nov 13, 2026
GitHub ↗★ 76K⑂ 9.4K
Language Models

Tiiny-AI/PowerInfer

▲ +13 ★ this week

High-speed Large Language Model Serving for Local Deployment

C++MITupdated May 11, 2026
GitHub ↗★ 9.9K⑂ 618
Language Models

ymcui/Chinese-LLaMA-Alpaca-2

▲ +1 ★ this week

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

🧠 Natural Language Processing
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 7.1K⑂ 557
Language Models

AI-Hypercomputer/maxtext🔥 active

▲ +3 ★ this week

A simple, performant, and scalable Jax LLM!

PythonApache-2.0updated Nov 13, 2026
GitHub ↗★ 2.5K⑂ 646

Data from GitHub · snapshot Nov 13, 2026