💻 **Grinder12: 0.96-Bit Lossless Streaming KV-Cache (16.55x VRAM Savings**

Article URL: https://github.com/ggml-org/llama.cpp/discussions/22891 Comments URL: https://news.ycombinator.com/item?id=48080800 Points: 2 # Comments: 0

🔗 https://github.com/ggml-org/llama.cpp/discussions/22891

#tech #news