Do transformers need three projections? Systematic study of QKV variants

Article URL: https://arxiv.org/abs/2606.04032 Comments URL: https://news.ycombinator.com/item?id=48405931 Points: 37 # Comments: 5