🏆 #962 overall#312 of 2,559 in Natural Language Processing

AnswerDotAI /ModernBERT

Bringing BERT into modernity via both architecture changes and scaling

$ git clone https://github.com/AnswerDotAI/ModernBERT.git
GitHub social preview for AnswerDotAI/ModernBERT
Stars
1.8K
1,782
This week
+3 ★
+12 this month
Forks
148
148
Language
Python
License
Apache-2.0
Created
May 13, 2024
2.5 years old
Last push
Mar 1, 2026

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 1.8K▲ +14★ 1.8K

Categories

GitHub topics

More in Natural Language Processing

Natural Language Processing

neuml/txtai🔥 active

▲ +300 ★ this week

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

🔍 Search & Retrieval🤖 Language Models🧬 Embeddings
PythonApache-2.0updated Nov 13, 2026
GitHub ↗★ 13.4K⑂ 1K
Natural Language Processing

JohnSnowLabs/spark-nlp🔥 active

▲ +4 ★ this week

State of the Art Natural Language Processing

🏷️ Named Entity Recognition💖 Sentiment Analysis🗂️ Text Classification❓ Question Answering🌍 Machine Translation✂️ Tokenization & Preprocessing
ScalaApache-2.0updated Nov 14, 2026
GitHub ↗★ 4.2K⑂ 743
Natural Language Processing

milvus-io/bootcamp

▲ +2 ★ this week

Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.

🔍 Search & Retrieval❓ Question Answering
Jupyter NotebookApache-2.0updated Oct 21, 2026
GitHub ↗★ 2.5K⑂ 683
Natural Language Processing

beir-cellar/beir

▲ +1 ★ this week

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

🔍 Search & Retrieval🧬 Embeddings
PythonApache-2.0updated Oct 16, 2025
GitHub ↗★ 2.3K⑂ 257
Natural Language Processing

Tongjilibo/bert4torch

An elegent pytorch implement of transformers

🏷️ Named Entity Recognition⛏️ Information Extraction🗂️ Text Classification🤖 Language Models
PythonMITupdated May 16, 2026
GitHub ↗★ 1.3K⑂ 166
Natural Language Processing

MilaNLProc/contextualized-topic-models

▲ +1 ★ this week

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

🫧 Topic Modeling
PythonMITupdated Jul 24, 2025
GitHub ↗★ 1.3K⑂ 154

Data from GitHub · snapshot Nov 16, 2026