🏆 #2,805 overall#626 of 1,375 in Language Models🔥 active this week

amitshekhariitbhu /llm-inference-engineering

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

$ git clone https://github.com/amitshekhariitbhu/llm-inference-engineering.git
GitHub social preview for amitshekhariitbhu/llm-inference-engineering
Stars
411
411
This week
—
Forks
51
51
Language
Markdown
License
Apache-2.0
Created
Aug 18, 2026
0.2 years old
Last push
Nov 9, 2026
🔥 this week

Categories

GitHub topics

More in Language Models

Language Models

Lightning-AI/litgpt🔥 active

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

PythonApache-2.0updated Nov 10, 2026
GitHub ↗★ 13.7K⑂ 1.5K
Language Models

robertvacareanu/llm4regression

Examining how large language models (LLMs) perform across various synthetic regression tasks when given (input, output) examples in their context, without any parameter update

Pythonno licenseupdated Oct 12, 2025
GitHub ↗★ 161⑂ 20
Language Models

ray-project/ray🔥 active

▲ +60 ★ this week

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

PythonApache-2.0updated Nov 13, 2026
GitHub ↗★ 44.3K⑂ 8.3K
Language Models

eugeneyan/open-llms

📋 A list of open LLMs available for commercial use.

OtherApache-2.0updated Feb 13, 2025
GitHub ↗★ 12.9K⑂ 986
Language Models

RUCAIBox/LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

🧠 Natural Language Processing
Pythonno licenseupdated Mar 11, 2025
GitHub ↗★ 12.2K⑂ 929

Data from GitHub · snapshot Nov 13, 2026