"Self-attention Networks Localize When QK-eigenspectrum Concentrates."

Han Bao, Ryuichiro Hataya, Ryo Karakida (2024)

Details and statistics

DOI: 10.48550/ARXIV.2402.02098

access: open

type: Informal or Other Publication

metadata version: 2024-02-14