7 events found.
Kembay, A. (ECE) – Sparse and Continual Foundations for Adaptive General Intelligence
Engineering 2 Engineering 2 1156 High Street, Santa Cruz
Hybrid Event
Week of Events
Monday, July 13, 2026
-
Virtual EventJuly 13, 2026Scott, J. (CSE) – Mechanistic Specialization Does Not Guarantee Performance: Evidence from Dual AttentionTransformers
-
Hybrid EventJuly 13, 2026Kembay, A. (ECE) – Sparse and Continual Foundations for Adaptive General Intelligence
Virtual Event
Scott, J. (CSE) – Mechanistic Specialization Does Not Guarantee Performance: Evidence from Dual AttentionTransformers
Dual Attention Transformers (DATs) extend decoder-only Transformers with a dedicated relational-attention stream, making them a natural architecture for abstract identity rules such asABA and ABB. Surprisingly, we find that comparably sized GPT-2 models outperform DATs on these tasks. We investigate this gap with two complementary mechanistic analyses. First, causal mediation analysis shows that DATs exhibit […]
Hybrid Event
Kembay, A. (ECE) – Sparse and Continual Foundations for Adaptive General Intelligence
While the human brain learns continually, mastering new tasks without forgetting the old and adapting to unfamiliar ones from context alone, modern neural networks still lack both. To bridge the gap between biological adaptivity and modern AI, we have established foundational work on sparsity as a computational principle at three levels of neural computation, through […]
Tuesday, July 14, 2026
No events on this day.
Wednesday, July 15, 2026
No events on this day.
Thursday, July 16, 2026
No events on this day.
Friday, July 17, 2026
No events on this day.
Saturday, July 18, 2026
No events on this day.
Sunday, July 19, 2026
No events on this day.