🏆 #6,719 overall#1337 of 1,375 in Language Models

BorealisAI /flora-opt

This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.

$ git clone https://github.com/BorealisAI/flora-opt.git
GitHub social preview for BorealisAI/flora-opt
Stars
106
106
This week
—
Forks
5
5
Language
Python
License
LGPL-3.0
Created
Feb 5, 2024
2.8 years old
Last push
Jul 1, 2024

Categories

GitHub topics

More in Language Models

Language Models

young-geng/EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

🧠 Natural Language Processing
PythonApache-2.0updated Aug 13, 2024
GitHub ↗★ 2.5K⑂ 262
Language Models

luyug/GradCache

Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint

PythonApache-2.0updated Mar 26, 2024
GitHub ↗★ 451⑂ 30
Language Models

ARahim3/mlx-tune

▲ +13 ★ this week

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

🎙️ Speech Recognition
PythonApache-2.0updated Jun 23, 2026
GitHub ↗★ 1.5K⑂ 102
Language Models

NVlabs/DoRA

▲ +1 ★ this week

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

PythonOtherupdated Mar 24, 2026
GitHub ↗★ 1K⑂ 70
Language Models

sunrainyg/RandOpt

Official Codebase for "Neural Thickets: Diverse Task Experts Are Dense Around Pretrained Weights" (ICML 2026 Spotlight)

Pythonno licenseupdated Sep 21, 2026
GitHub ↗★ 659⑂ 74
Language Models

adalkiran/llama-nuts-and-bolts

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

GoApache-2.0updated Aug 20, 2024
GitHub ↗★ 317⑂ 17

Data from GitHub · snapshot Nov 13, 2026