Open Source Text Mining

pymupdf/PyMuPDF🔥 active

▲ +49 ★ this week

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

adbar/trafilatura🔥 active

▲ +43 ★ this week

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

lynote-ai/humanize-text

▲ +22 ★ this week

Open-source AI humanizer: rewrite AI-generated text into natural, human-sounding prose. LLM rewriting + multi-engine translation, with step-by-step traces. Python CLI, n8n & Docker.

shcherbak-ai/contextgem🔥 active

▲ +19 ★ this week

Extract structured data and insights from documents using LLMs and decision models

seyedehsanhadi/sloptrim🔥 active

▲ +10 ★ this week

A local detector for AI-writing patterns. Scores every prose file your agent saves. Python standard library only, no network, no model.

elder-plinius/ST3GG

▲ +9 ★ this week

all-in-one steganography suite

pymupdf/PyMuPDF🔥 active

▲ +49 ★ this week

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

chmln/sd

Intuitive find & replace CLI (sed alternative)

adbar/trafilatura🔥 active

▲ +43 ★ this week

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

deanmalmgren/textract

▲ +4 ★ this week

extract text from any document. no muss. no fuss.

lynote-ai/humanize-text

▲ +22 ★ this week

Open-source AI humanizer: rewrite AI-generated text into natural, human-sounding prose. LLM rewriting + multi-engine translation, with step-by-step traces. Python CLI, n8n & Docker.

FudanNLP/fastNLP

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

jbesomi/texthero

Text preprocessing, representation and visualization from zero to hero.

pyparsing/pyparsing

Python library for creating PEG parsers

JasonKessler/scattertext

▲ +2 ★ this week

Beautiful visualizations of how language differs among document types.

chiphuyen/lazynlp

▲ +4 ★ this week

Library to scrape and clean web pages to create massive datasets.

ujjwalkarn/DataScienceR

▲ +1 ★ this week

a curated list of R tutorials for Data Science, NLP and Machine Learning

shcherbak-ai/contextgem🔥 active

▲ +19 ★ this week

Extract structured data and insights from documents using LLMs and decision models

elder-plinius/ST3GG

▲ +9 ★ this week

all-in-one steganography suite

kk7nc/Text_Classification

Text Classification Algorithms: A Survey

dipanjanS/text-analytics-with-python

Learn how to process, classify, cluster, summarize, understand syntax, semantics and sentiment of text data with the power of Python! This repository contains code and datasets used in my book, "Text Analytics with Python" published by Apress/Springer.

Olcmyk/HuChenFeng

▲ +4 ★ this week

收集户晨风的所有内容

helix-editor/nucleo

A fast and convenient fuzzy matcher library for rust

konlpy/konlpy

Python package for Korean natural language processing.

roshan-research/hazm

▲ +1 ★ this week

Persian NLP Toolkit

PCRE2Project/pcre2🔥 active

PCRE2 is a library implementing regular expression pattern matching with a C API

juliasilge/tidy-text-mining

▲ +2 ★ this week

Manuscript of the book "Tidy Text Mining with R" by Julia Silge and David Robinson

pemistahl/lingua-go

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

BurntSushi/aho-corasick

A fast implementation of Aho-Corasick in Rust.

opensemanticsearch/open-semantic-search

▲ +2 ★ this week

Open Source research tool to search, browse, analyze and explore large document collections by Semantic Search Engine and Open Source Text Mining & Text Analytics platform (Integrates ETL for document processing, OCR for images & PDF, named entity recognition for persons, organizations & locations, metadata management by thesaurus & ontologies, search user interface & search apps for fulltext search, faceted search & knowledge graph)

juliasilge/tidytext

▲ +1 ★ this week

Text mining using tidy tools :sparkles::page_facing_up::sparkles:

shangjingbo1226/AutoPhrase

AutoPhrase: Automated Phrase Mining from Massive Text Corpora

birchb1024/frangipanni

Program to convert lines of text into a tree structure.

kavgan/nlp-in-practice

Starter code to solve real world text data problems. Includes: Gensim Word2Vec, phrase embeddings, Text Classification with Logistic Regression, word count with pyspark, simple text preprocessing, pre-trained embeddings and more.

PyThaiNLP/pythainlp🔥 active

▲ +1 ★ this week

Thai natural language processing in Python

greyblake/whatlang-rs

▲ +1 ★ this week

Natural language detection library for Rust. Try demo online: https://whatlang.org/