Reading up on Google Research

1 deep · digging since mar 26

Google's TurboQuant AI-compression algorithm can reduce LLM memory usage by 6x - Ars Technica
Google's TurboQuant compression algorithm reduces LLM memory usage by 6x and boosts speed 8x in early tests without sacrificing output quality.