Sonifying Audio Transformers with Attention Tape Heads
I liked seeing those diagrams on how transformer attention looks at relevant words and grammar for text or translation, and how it looks at important components for vision. What does attention on audio sound like? The attention mechanism in transformers at the the first layer literally points to sections of the input audio, so I […]