content.raw: Quite excited by the ModernBERT release! 0.15/0.4B small, 2T modern pre-training data and tokenizer with code, 8k context window, great efficient model for embeddings & classification!
content.type: text
content.value: Quite excited by the ModernBERT release! 0.15/0.4B small, 2T modern pre-training data and tokenizer with code, 8k context window, great efficient model for embeddings & classification!
content.type: new_line
content.type: new_line
content.raw: This will probably be the basis for many future SOTA encoders! And I can finally stop using DeBERTav3 from 2021  :D 
content.type: text
content.value: This will probably be the basis for many future SOTA encoders! And I can finally stop using DeBERTav3 from 2021  :D 
content.type: new_line
content.type: new_line
content.raw: Congrats 
content.type: text
content.value: Congrats 
content.raw: @answerdotai
content.type: mention
content.user: answerdotai
content.raw: , 
content.type: text
content.value: , 
content.raw: @LightOnIO
content.type: mention
content.user: LightOnIO
content.raw:  and collaborators like 
content.type: text
content.value:  and collaborators like 
content.raw: @tomaarsen
content.type: mention
content.user: tomaarsen
content.raw:  !
content.type: text
content.value:  !
content.type: new_line
content.type: new_line
content.raw: Paper and models here 👇https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb
content.type: text
content.value: Paper and models here 👇https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb
rawContent: Quite excited by the ModernBERT release! 0.15/0.4B small, 2T modern pre-training data and tokenizer with code, 8k context window, great efficient model for embeddings & classification!
  
  This will probably be the basis for many future SOTA encoders! And I can finally stop using DeBERTav3 from 2021  :D 
  
  Congrats @answerdotai, @LightOnIO and collaborators like @tomaarsen !
  
  Paper and models here 👇https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb
reactions.reaction: 👍
reactions.users: jobreu csabakecskemeti pszemraj reonyy calmodovar morsczx IlyaTakov Felladrin prsyahmi KS112 mlburnham GordonM
reactions.reaction: 👀
reactions.users: John6666 reonyy
commentators._id: 64d0341901931c60161f2a06
commentators.avatarUrl: /avatars/0e097958c5835a62d5d318414257e1d8.svg
commentators.fullname: Mike Burnham
commentators.name: mlburnham
commentators.type: user
commentators._id: 5fb15d1e84389b139cf3b508
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1613511937628-5fb15d1e84389b139cf3b508.jpeg
commentators.fullname: Moritz Laurer
commentators.name: MoritzLaurer
commentators.type: user
commentators._id: 5ff60d4352c26e9bc240badd
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/5ff60d4352c26e9bc240badd/HzoknJibrSasc1ZzU71XA.png
commentators.fullname: Benjamin Clavié
commentators.name: bclavie
commentators.type: user