πŸ† #1,031 overall#294 of 601 in Language Models

Liuhong99 /Sophia

The official implementation of β€œSophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”

$ git clone https://github.com/Liuhong99/Sophia.git
GitHub social preview for Liuhong99/Sophia
Stars
1K
1,000
Forks
57
57
Language
Python
License
MIT
Created
May 23, 2023
3.3 years old
Last push
Jan 30, 2024

Categories

GitHub topics

More in Language Models

Language Models

ray-project/rayπŸ”₯ active

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

PythonApache-2.0updated Sep 24, 2026
GitHub β†—β˜… 43.9Kβ‘‚ 8.1K
Language Models

camel-ai/camelπŸ”₯ active

🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

🧠 Natural Language Processing
PythonApache-2.0updated Sep 20, 2026
GitHub β†—β˜… 17.8Kβ‘‚ 2.1K
Language Models

NVIDIA/DeepLearningExamples

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

πŸŽ™οΈ Speech Recognition🧠 Natural Language Processing
Jupyter Notebookno licenseupdated Aug 12, 2024
GitHub β†—β˜… 14.9Kβ‘‚ 3.4K
Language Models

Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

PythonApache-2.0updated Sep 14, 2026
GitHub β†—β˜… 13.7Kβ‘‚ 1.5K
Language Models

sapientinc/HRM

Hierarchical Reasoning Model Official Release

PythonApache-2.0updated Mar 31, 2026
GitHub β†—β˜… 12.6Kβ‘‚ 1.8K

Data from GitHub Β· snapshot Sep 24, 2026