🏆 #1,973 overall#437 of 1,375 in Language Models

cxcscmu /Craw4LLM

Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

$ git clone https://github.com/cxcscmu/Craw4LLM.git
GitHub social preview for cxcscmu/Craw4LLM
Stars
667
667
This week
—
Forks
60
60
Language
Python
License
MIT
Created
Feb 17, 2025
1.7 years old
Last push
Feb 24, 2025

Categories

GitHub topics

More in Language Models

Language Models

RUCAIBox/LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

🧠 Natural Language Processing
Pythonno licenseupdated Mar 11, 2025
GitHub ↗★ 12.2K⑂ 929
Language Models

ZigeW/data_management_LLM

Collection of training data management explorations for large language models

🧠 Natural Language Processing
Otherno licenseupdated Aug 2, 2024
GitHub ↗★ 343⑂ 30
Language Models

mlabonne/llm-course

▲ +158 ★ this week

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

OtherApache-2.0updated Feb 5, 2026
GitHub ↗★ 85.1K⑂ 9.9K
Language Models

bojieli/ai-agent-book

▲ +592 ★ this week

《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

🔍 Search & Retrieval
PythonApache-2.0updated Oct 8, 2026
GitHub ↗★ 57.9K⑂ 6.7K
Language Models

ray-project/ray🔥 active

▲ +60 ★ this week

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

PythonApache-2.0updated Nov 13, 2026
GitHub ↗★ 44.3K⑂ 8.3K
Language Models

HKUDS/LightRAG🔥 active

▲ +112 ★ this week

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

🔍 Search & Retrieval
PythonMITupdated Nov 13, 2026
GitHub ↗★ 40.7K⑂ 5.8K

Data from GitHub · snapshot Nov 13, 2026