K/D

Meta published a paper that might end the current LLM era. They proved that we can kill the "tokenizer" forever and it actually makes the models stronger. Every AI you use today (ChatGPT, Claude, Gemini) reads text the exact same way. It chops your words into arbitrary chunks called tokens. It relies on a massive, bloated vocabulary of around 100,000 specific chunks just to understand a sentence. We assumed this was the only way to build AI. We treated it as the fundamental speed limit of language models. Meta proved we were completely wrong. Their new paper, "Breaking the Token Ceiling," ditches tokens entirely. Instead, they forced the AI to process raw bytes. A vocabulary of just 256 values. The results rewrite the rules of model efficiency. By training on pure bytes and distilling the knowledge, these tiny models didn't just survive. They dominated. Meta's distilled 1B-parameter byte models asymptotically surpassed state-of-the-art token models like Llama 3.2-1B and Gemma-3-1B across downstream tasks. They use a fraction of the vocabulary. They require less data. They take up less storage. It forces the model to actually learn the fundamental relationships between raw data instead of relying on pre-packaged text chunks. This is a massive shift for anyone building, training, or deploying AI. We’ve spent the last five years obsessively optimizing how we chop up text to feed these models. It turns out, the bottleneck wasn't the intelligence of the model. It was the tokenizer.

Samsung open-sourced a method that shrinks 13B parameter LLM into less than 1 GB. It's called "LittleBit" Instead of storing AI weights as standard numbers, they used latent factorization to crush them down to extreme sub-1-bit levels. In some configurations, they hit 0.1 bits per weight. But here is where the architecture gets crazy. When you compress an AI this much, you can stop doing math. Instead of forcing the hardware to do heavy floating-point multiplication, LittleBit replaces the core computation with a bitwise XOR operation. It swaps complex matrix math for basic sign flips. The results rewrite the rules of model deployment: • Unlocks a massive 11.6x inference speedup relative to standard FP16 models. • Radically reduces memory footprint and loading bandwidth. • Maintains robustness in extreme sub-0.5 bit regimes where previous compression methods catastrophically fail. This is not a clever optimization. It is the blueprint for running massive, state-of-the-art AI locally on cheap, resource-constrained devices.