Memorization Capacity of Multi-Head Attention in Transformers

Sadegh Mahdavi, Renjie Liao, Christos Thrampoulidis
June 2023
PDF Code
Type
Conference paper
Publication
ICLR 2024, International Conference on Learning Representations. (Spotlight)