Machine Translation
google/sentencepiece🔥 active
▲ +2 ★ this week
Unsupervised text tokenizer for Neural Network-based text generation.
🧠 Natural Language Processing
C++Apache-2.0updated Nov 11, 2026
Preprocessed Python functions and docstrings for automated code documentation (code2doc) and automated code generation (doc2code) tasks.
$ git clone https://github.com/EdinburghNLP/code-docstring-corpus.git▲ +2 ★ this week
Unsupervised text tokenizer for Neural Network-based text generation.
▲ +1 ★ this week
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
搜索所有中文NLP数据集,附常用英文NLP数据集
▲ +1 ★ this week
《机器翻译:基础与模型》肖桐 朱靖波 著 - Machine Translation: Foundations and Models
Unsupervised Word Segmentation for Neural Machine Translation and Text Generation
Data from GitHub · snapshot Nov 13, 2026