Memorization Capacity of Multi-Head Attention in Transformers

Sadegh Mahdavi, Renjie Liao, Christos Thrampoulidis
June 2023
PDF Code
Type
Preprint
Publication
ArXiv Preprint