"QAQ: Quality Adaptive Quantization for LLM KV Cache."

Shichen Dong et al. (2024)

Details and statistics

DOI: 10.48550/ARXIV.2403.04643

access: open

type: Informal or Other Publication

metadata version: 2024-10-06