Campus Event Calendar: Danupon Nanongkai (05/22/2025 in E1 4/024)

Campus Event Calendar

Campus Event Calendar:
- All Upcoming:
  - only for D1
  - only for D2
  - only for INET
  - only for D4
  - only for D5
  - only for D6
  - only for RG1
  - Mailing Lists
  - by Speaker
  - by Type
  - by Category
  - by Title
  - Calendar
  - RSS Feed
- History of Events:

Event Entry

What and Who

On the Limitations of the Transformer Architecture (Brief Paper Presentation)

Danupon Nanongkai

Max-Planck-Institut für Informatik - D1

AG1 Mittagsseminar (own work)

AG 1

AG Audience

English

Note: We use this to send email in the morning.

Date, Time and Location

Thursday, 22 May 2025

13:00

30 Minutes

E1 4

024

Saarbrücken

Abstract

I will give a brief (and somewhat informal) presentation of the paper On the Limitations of the Transformer Architecture. The goal is to provide a mathematical definition of a transformer—more precisely, the self-attention mechanism—without focusing on its practical implementations. The paper connects this formalism to communication complexity to argue for inherent limitations of the architecture. The talk is expected to last 15–30 minutes, depending on the level of discussion.

Paper link: https://arxiv.org/abs/2402.08164