🔥🔥 The extremely fast inference engine for decision model
$ git clone https://github.com/OmniJev/Flide.git▲ +1 ★ this week
LLM inference engine from scratch — paged KV cache, continuous batching, chunked prefill, prefix caching, speculative decoding, CUDA graph, tensor parallelism, OpenAI-compatible serving
▲ +117 ★ this week
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
▲ +310 ★ this week
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
▲ +10 ★ this week
[ICLR 2023] ReAct: Synergizing Reasoning and Acting in Language Models
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
▲ +4 ★ this week
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
Data from GitHub · snapshot Nov 13, 2026