Tether Brings AI Memory Compression To Consumer Devices

Tether’s TurboQuant enables useful and powerful local AI applications on consumer devices at much lower costs and without ...

Context compression finally works in production: new research cuts LLM input 16x without the accuracy hit

LCLMs compress LLM context before decode — 8.8x faster at 16x compression, beating every KV cache method tested. Open-sourced by NYU and Columbia.

This chip startup just raised $135M on a bet that AI’s biggest bottleneck isn’t compute — it’s memory

Information leaves memory, passes through a CPU for preprocessing, travels to a GPU for heavy computation, and then makes its ...
TechCrunch

Running AI models is turning into a memory game

When we talk about the cost of AI infrastructure, the focus is usually on Nvidia and GPUs — but memory is an increasingly important part of the picture. As hyperscalers prepare to build out billions ...
VentureBeat

3 emerging memory technologies that will change how you handle big data

This article is part of the Technology Insight series, made possible with funding from Intel. A couple of years back, IDC predicted that by 2025 the average person will interact with connected devices ...

XCENA raises $135M for its computational memory controller

XCENA Inc., a startup with a memory device designed to speed up artificial intelligence clusters, today announced that it has raised $135 million in funding. The Series B round was led by Korean funds ...