Google's TurboQuant: When Old Tricks Learn New

Google dropped a paper that allegedly moved semiconductor stock prices. TurboQuant, they called it—a method to run AI systems with dramatically less memory and faster processing speeds. The headlines screamed breakthrough. The hype cycle kicked into overdrive.

And Dr. Károly Zsolnai-Fehér, host of the academic YouTube channel Two Minute Papers, did something quietly radical: he waited.

"I did not want to publish an early video on the huge sensation," he explains in his latest analysis. "I really wanted to wait a bit, and find out whether it actually works in practice."

That patience reveals something more interesting than the initial claims. Not because TurboQuant doesn't work—it does, sort of—but because of what it actually is and what it isn't.

What TurboQuant Actually Does

TurboQuant targets something called the KV cache in large language models—essentially the short-term memory where an AI stores context about your current conversation. Feed an AI a massive PDF or an entire codebase, and those numbers pile up fast. More numbers mean more memory, more cost, slower processing.

The basic idea: compress those numbers by chopping off digits at the end. Except that's a terrible idea unless you're extremely careful. Chop carelessly and your neural network outputs garbage.

Here's where the method gets clever. Zsolnai-Fehér uses a vector analogy: imagine an arrow pointing mostly along one axis. "When you chop that information off, it snaps on to the grid, you basically lose everything except that one direction. That is not useful."

The solution? Rotate the arrow randomly before truncating it. Now the "energy" spreads evenly across all directions. When you round things off, you lose a little from everywhere instead of everything from most places. Add in a Johnson-Lindenstrauss transform (40-year-old compression math that preserves relative distances between data points), and you have TurboQuant.

"These are three age old ideas combined together to great effect," Zsolnai-Fehér notes. "Sometimes you don't need to invent grand new theories. Sometimes you need a smart combination of existing methods."

That might be the most honest thing about this announcement: Google didn't discover new physics. They assembled existing techniques with mathematical rigor.

The Reality Check

So does it work? Zsolnai-Fehér waited for independent reproductions and benchmarks. His video appeared days later than competitors covering the same paper, but with actual data from other researchers who'd coded up the technique and tested it.

The results: 30-40% reduction in memory usage for the KV cache. Already impressive. But then something weird happened—processing speeds also increased by roughly 40%.

"That is…my brain crashed," Zsolnai-Fehér admits. "We get faster AI assistants that need less memory at almost zero cost."

Except here's where media framing meets reality. Those spectacular initial claims—4 to 6 times less memory, 8 times faster computation—turn out to be best-case scenarios. Like the official battery life on your phone or the EPA mileage rating for your car: technically true under idealized conditions, not what you'll experience in practice.

"Based on the results, we cannot conclude that every AI machine suddenly needs 6 times less ram," he clarifies. The real-world benefit? A few gigabytes saved when processing very long contexts. Not revolutionary, but genuinely useful for people working with massive documents or codebases.

What strikes me about this gap between claim and reality isn't dishonesty—the math checks out for specific use cases. It's how breathlessly the tech press amplified those peak numbers without the caveats. Memory shortage meets solution narrative meets stock prices moving. The incentive structure practically writes itself.

The Academic Controversy

Not everyone celebrated. Some researchers flagged overlap with previous techniques, arguing the paper didn't adequately discuss those similarities. The paper was eventually accepted for publication, though as Zsolnai-Fehér notes, "not all researchers agree the concerns were fully addressed."

This is where things get interesting for anyone who cares about how knowledge actually advances. The criticism isn't that TurboQuant doesn't work—independent benchmarks confirm it does. The concern is about intellectual lineage, about properly crediting the conceptual groundwork that made this combination possible.

It's a tension as old as science itself: when does assembling existing pieces into a new configuration count as innovation? How thoroughly must you trace every tributary feeding your river?

I don't have a tidy answer. But I appreciate that Zsolnai-Fehér surfaces the controversy without trying to resolve it. The links to critical reviews sit in his video description alongside the reproduction attempts. You can follow the threads yourself.

Why This Matters Beyond the Hype

What makes this worth examining isn't whether TurboQuant deserves its hype (probably not at headline levels) or whether the academic criticism has merit (seems partially valid). It's what the entire episode reveals about how we process claims in a field moving this fast.

Zsolnai-Fehér's approach—waiting for reproductions, checking actual benchmarks, surfacing criticisms, tempering the most enthusiastic claims while acknowledging real benefits—feels almost quaint in 2025. The economic pressure to be first conflicts directly with the scientific pressure to be right.

"This is why we wait for more data and analyze experiments here," he says, "to get the highest quality information for you."

The real story isn't whether TurboQuant changes everything. It's that even in a field obsessed with revolutionary breakthroughs, sometimes the most useful advances come from combining old ideas with mathematical rigor. And that knowing the difference between peak performance and typical use cases might matter more than ever.

Because if a modest improvement in memory efficiency can move stock prices before anyone's verified it works, what does that tell us about how we're evaluating the next claim that comes along?

Nadia Marchetti is Buzzrag's Unexplained Phenomena Correspondent, covering the questions science won't touch—or in this case, the questions about how science itself gets communicated.