Scott, J. (CSE) – Mechanistic Specialization Does Not Guarantee Performance: Evidence from Dual AttentionTransformers
Virtual Event
Dual Attention Transformers (DATs) extend decoder-only Transformers with a dedicated relational-attention stream, making them a natural architecture for abstract identity rules such asABA and ABB. Surprisingly, we find that comparably […]
