The world's largest social media toxicity dataset.
$ git clone https://github.com/surge-ai/toxicity.gitTrained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers.
WhiteLightning distills massive, state-of-the-art language models into lightweight, hyper-efficient text classifiers. It's a command-line tool that lets you create specialized models that run anywhere—from the cloud to the edge—using the universal ONNX format for maximum compatibility.
Self-hosted content moderation API that outperforms Amazon Comprehend. 100% offline, your data never leaves your server. Text + Image moderation.
中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理
▲ +18 ★ this week
💫 Industrial-strength Natural Language Processing (NLP) in Python
▲ +2 ★ this week
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
Data from GitHub · snapshot Nov 13, 2026