πŸ† #1,049 overall#302 of 601 in Language Models

kennethleungty /Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for DocumentΒ Q&A

$ git clone https://github.com/kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference.git
GitHub social preview for kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
Stars
972
972
Forks
206
206
Language
Python
License
MIT
Created
Jul 6, 2023
3.2 years old
Last push
Nov 6, 2023

Categories

GitHub topics

More in Language Models

Language Models

curiousily/Get-Things-Done-with-Prompt-Engineering-and-LangChain

LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.

Jupyter NotebookApache-2.0updated Jan 7, 2024
GitHub β†—β˜… 1.3Kβ‘‚ 372
Language Models

OpenMOSS/MOSS

An open-source, tool-augmented conversational language model from Fudan University

🧠 Natural Language Processing
PythonApache-2.0updated Sep 6, 2026
GitHub β†—β˜… 12.3Kβ‘‚ 1.1K
Language Models

bigscience-workshop/petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

🧠 Natural Language Processing
PythonMITupdated Sep 7, 2024
GitHub β†—β˜… 10.6Kβ‘‚ 651
Language Models

trigaten/Learn_Prompting

Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community

🧠 Natural Language Processing
MDXOtherupdated Jan 14, 2025
GitHub β†—β˜… 4.7Kβ‘‚ 667
Language Models

zjunlp/Prompt4ReasoningPapers

[ACL 2023] Reasoning with Language Model Prompting: A Survey

🧠 Natural Language Processing
OtherMITupdated May 21, 2025
GitHub β†—β˜… 1Kβ‘‚ 68
Language Models

OpenGVLab/Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

PythonMITupdated Jul 17, 2026
GitHub β†—β˜… 3.4Kβ‘‚ 268

Data from GitHub Β· snapshot Sep 24, 2026