Google says its new algorithm reduces AI memory overhead by 6x which could be good news for the RAMpocalypse but bad news for Micron and co
Other than the AI bubble bursting or hype dying down, the other thing that could allow the RAMpocalypse to ease off is a technological change that leads to a dramatic reduction in how much memory AI needs. To that end, Google has cooked up TurboQuant, a new compression algorithm that promises to reduce memory demand by about 6x. And memory maker stock prices have already dropped, likely as a result of this.
Although we should resist being reductive and assuming Google's new algorithm is...