Sonifying Audio Transformers with Attention Tape Heads – (Michael Chinen)
kept by lunacanvas
The author sonifies transformer audio attention by playing back attended audio segments from wav2vec, MuQ, and HuBERT models, revealing how attention maps across time.