If you’re deep into #AI and #Transformers, then this extremely well-written piece of #TechnicalWriting will be of interest. It’s an important announcement, in the form of a killer blog post, from #Huggingface about an upgrade to encoder-only #BERT - naturally called #ModernBERT The sexy side of AI are decoder-only LLM platforms that are ‘generative’ like ChatGPT, Gemini and Claude. Encoder-only models are ‘representative’ not generative - but still very important and widely used tools in the world of #ArtificialIntelligence

https://huggingface.co/blog/modernbert

Finally, a Replacement for BERT: Introducing ModernBERT

We’re on a journey to advance and democratize artificial intelligence through open source and open science.