Benjamin Warner @benjaminwarner.dev · Dec 22 This week we released ModernBERT, the first encoder to reach SOTA on most common benchmarks across language understanding, retrieval, and code, while running twice as fast as DeBERTaV3 on short context and three times faster than NomicBERT & GTE on long context.
74 likes 2 replies
?
Replies
ModernBERT is available to use today on Transformers (pip install from main). More details in our announcement post. huggingface.co/blog/modernb...
This is awesome! Are there any docs on how to use ModernBERT for ColBERT?