Natural Language Processing before LLMs
📝
114
From n-gram counts to attention, learning by doing
HF Blogs
Blogs that needs to be read by EVERYONE
-
-
FineWeb: decanting the web for the finest text data at scale
🍷1.46kExplore the FineWeb dataset and its creation process
-
The Smol Training Playbook
📚3.34kThe secrets to building world-class LLMs
The Ultra-Scale Playbook
🌌4.1kThe ultimate guide to training LLM on large GPU Clusters
Note All things LLM^
The ultimate guide to RL environments: building and scaling them in the LLM era
📝270Building and scaling RL environments for LLM training
Note RL environments
Flow Matching for Image Generation
🌊99Visualize how noise transforms into images in your browser
Note diffusion and flow matching