🏆 #2,894 overall#655 of 1,375 in Language Models

NVIDIA /Star-Attention

Efficient LLM Inference over Long Sequences

$ git clone https://github.com/NVIDIA/Star-Attention.git
GitHub social preview for NVIDIA/Star-Attention
Stars
392
392
This week
—
Forks
24
24
Language
Python
License
Apache-2.0
Created
Nov 19, 2024
2.0 years old
Last push
Jun 25, 2025

Categories

GitHub topics

More in Language Models

Language Models

ray-project/ray🔥 active

▲ +60 ★ this week

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

PythonApache-2.0updated Nov 13, 2026
GitHub ↗★ 44.3K⑂ 8.3K
Language Models

Lightning-AI/litgpt🔥 active

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

PythonApache-2.0updated Nov 10, 2026
GitHub ↗★ 13.7K⑂ 1.5K
Language Models

Tiiny-AI/PowerInfer

▲ +13 ★ this week

High-speed Large Language Model Serving for Local Deployment

C++MITupdated May 11, 2026
GitHub ↗★ 9.9K⑂ 618
Language Models

NVIDIA/GenerativeAIExamples

▲ +7 ★ this week

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

🔍 Search & Retrieval
Jupyter NotebookApache-2.0updated Nov 6, 2026
GitHub ↗★ 4.2K⑂ 1.1K
Language Models

SafeAILab/EAGLE

▲ +7 ★ this week

Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).

PythonOtherupdated Feb 20, 2026
GitHub ↗★ 2.6K⑂ 299
Language Models

amitshekhariitbhu/llm-internals🔥 active

▲ +4 ★ this week

Learn LLM internals step by step - from tokenization to attention to inference optimization.

OtherApache-2.0updated Nov 7, 2026
GitHub ↗★ 1.8K⑂ 202

Data from GitHub · snapshot Nov 13, 2026