Natural Language Processing
Ki6an/fastT5
▲ +1 ★ this week
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
❓ Question Answering
PythonApache-2.0updated Apr 24, 2023
Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.
$ git clone https://github.com/patil-suraj/onnx_transformers.git▲ +1 ★ this week
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.
Edge Inference in Browser with Transformer NLP model
It is a simple library to speed up CLIP inference up to 3x (K80 GPU)
Data from GitHub · snapshot Nov 13, 2026