view article Article Finally, a Replacement for BERT: Introducing ModernBERT +13 bwarner, NohTow, bclavie, orionweller, ohallstrom, staghado, alexisgallagher, rbiswasfc, fladhak, tomaarsen, ncoop57, griffin, jph00, johnowhitaker, iacolippo • Dec 19, 2024 • 755
view post Post 152 tokenizers 0.23.3 is out!https://github.com/huggingface/tokenizers/releases/tag/v0.23.3The release is python-only and fixes a few very annoying issues See translation 🔥 1 1 + Reply
view post Post 261 I put together a Space to showcase tokenization-in-the-browser libs we maintain at HFLet me know what you think! sbrandeis/tokenizers-wasm-demo See translation 🔥 1 1 + Reply
Running Featured 647 Jev Decision Index 🔬 647 Benchmarks and news on various repros of TypeSafe's Jev
view article Article tokenizers v1: encode, decode and scaling, measured +2 ArthurZ, sbrandeis, mcpotato, lysandre • 23 days ago • 91
view article Article tokenizers v1: encode, decode and scaling, measured +2 ArthurZ, sbrandeis, mcpotato, lysandre • 23 days ago • 91
Running on Zero Agents 15 AI Weather Models with Earthmover Data 🌖 15 Run AI weather forecasts from selected models