πŸ† #566 overall#174 of 601 in Language Models

chiphuyen /lazynlp

Library to scrape and clean web pages to create massive datasets.

$ git clone https://github.com/chiphuyen/lazynlp.git
GitHub social preview for chiphuyen/lazynlp
Stars
2.3K
2,293
Forks
325
325
Language
Python
License
None
Created
Feb 27, 2019
7.6 years old
Last push
Nov 11, 2020

Categories

GitHub topics

More in Language Models

Language Models

LLMBook-zh/LLMBook-zh.github.io

γ€Šε€§θ―­θ¨€ζ¨‘εž‹γ€‹δ½œθ€…οΌšθ΅΅ι‘«οΌŒζŽε†›ζ―…οΌŒε‘¨ζ˜†οΌŒε”ε€©δΈ€οΌŒζ–‡η»§θ£

🧠 Natural Language Processing
Pythonno licenseupdated Sep 2, 2025
GitHub β†—β˜… 4.6Kβ‘‚ 350
Language Models

extreme-bert/extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper β€œExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

🧠 Natural Language Processing
PythonApache-2.0updated Mar 5, 2023
GitHub β†—β˜… 267β‘‚ 14
Language Models

neuml/txtaiπŸ”₯ active

πŸ’‘ All-in-one AI framework for semantic search, LLM orchestration and language model workflows

🧬 EmbeddingsπŸ” Search & Retrieval🧠 Natural Language Processing
PythonApache-2.0updated Sep 23, 2026
GitHub β†—β˜… 13Kβ‘‚ 899
Language Models

huggingface/tokenizersπŸ”₯ active

πŸ’₯ Fast State-of-the-Art Tokenizers optimized for Research and Production

🧠 Natural Language Processing
RustApache-2.0updated Sep 23, 2026
GitHub β†—β˜… 11.1Kβ‘‚ 1.2K
Language Models

Andrew-Jang/RAGHub

A community-driven collection of RAG (Retrieval-Augmented Generation) frameworks, projects, and resources. Contribute and explore the evolving RAG ecosystem.

🧠 Natural Language Processing
OtherMITupdated Jul 28, 2026
GitHub β†—β˜… 2Kβ‘‚ 184
Language Models

Farama-Foundation/ChatArena

ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.

🧠 Natural Language Processing
PythonApache-2.0updated Aug 11, 2025
GitHub β†—β˜… 1.6Kβ‘‚ 151

Data from GitHub Β· snapshot Sep 24, 2026