ResidualQuant

KV Cache Quantization for Looped Transformers with 2-Bit Residuals

Heejun Kim1Junyoung Lee2SangLyul Cho3Dongsu Han1Insu Han1Sehoon Kim1,†

1 KAIST · 2 Yonsei University · 3 Seoul National University

† Corresponding author

Abstract visualization placeholder for ResidualQuant

More details will be available soon.