🏆 #2,643 overall#594 of 1,375 in Language Models

luyug /GradCache

Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint

$ git clone https://github.com/luyug/GradCache.git
GitHub social preview for luyug/GradCache
Stars
451
451
This week
—
Forks
30
30
Language
Python
License
Apache-2.0
Created
Jun 8, 2021
5.4 years old
Last push
Mar 26, 2024

Categories

GitHub topics

More in Language Models

Language Models

young-geng/EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

🧠 Natural Language Processing
PythonApache-2.0updated Aug 13, 2024
GitHub ↗★ 2.5K⑂ 262
Language Models

BorealisAI/flora-opt

This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.

PythonLGPL-3.0updated Jul 1, 2024
GitHub ↗★ 106⑂ 5
Language Models

NVIDIA/DeepLearningExamples

▲ +8 ★ this week

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

🎙️ Speech Recognition🧠 Natural Language Processing
Jupyter Notebookno licenseupdated Aug 12, 2024
GitHub ↗★ 14.9K⑂ 3.4K
Language Models

AviSoori1x/makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

Jupyter NotebookMITupdated Oct 30, 2024
GitHub ↗★ 821⑂ 96
Language Models

HugAILab/HugNLP

CIKM2023 Best Demo Paper Award. HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊

⛏️ Information Extraction🧠 Natural Language Processing
PythonApache-2.0updated Oct 31, 2023
GitHub ↗★ 392⑂ 46
Language Models

AviSoori1x/seemore

From scratch implementation of a vision language model in pure PyTorch

Jupyter NotebookMITupdated May 6, 2024
GitHub ↗★ 262⑂ 31

Data from GitHub · snapshot Nov 13, 2026