Hacker Newsnew | past | comments | ask | show | jobs | submit | fromlogin
Reuse non-prefix KV Cache and speed up RAG by 3X with LMCache (github.com/lmcache)
5 points by lihanc111 8 months ago | past | 1 comment
Lossless LLM 3x Throughput Increase by LMCache (github.com/lmcache)
154 points by lihanc111 9 months ago | past | 53 comments
LMCache: Redis for LLMs (github.com/lmcache)
7 points by handfuloflight 9 months ago | past

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: