Language Models
ray-project/ray🔥 active
▲ +60 ★ this week
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
PythonApache-2.0updated Nov 13, 2026
Efficient LLM Inference over Long Sequences
$ git clone https://github.com/NVIDIA/Star-Attention.git▲ +60 ★ this week
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
▲ +13 ★ this week
High-speed Large Language Model Serving for Local Deployment
▲ +7 ★ this week
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
▲ +7 ★ this week
Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).
▲ +4 ★ this week
Learn LLM internals step by step - from tokenization to attention to inference optimization.
Data from GitHub · snapshot Nov 13, 2026