Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
$ git clone https://github.com/asahi417/lmppl.gitRust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
▲ +12 ★ this week
The open-source hub to build & deploy GPT/LLM Agents ⚡️
▲ +36 ★ this week
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
▲ +4 ★ this week
EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
▲ +4 ★ this week
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
中文nlp解决方案(大模型、数据、模型、训练、推理)
Data from GitHub · snapshot Nov 13, 2026