Key-Value Cache Compression for Memory-Efficient Large Language Model Inference

Research Area
AI Algorithms
RPI Principal Investigators
Mohammad Mohammadi Amiri
IBM Principal Investigators
Pin-Yu Chen, Tejaswini Pedapati, Subhajit Chaudhury
Project Year
2025
IBM and Rensselaer
Back to top