art, analysis, audio
Exploring where signal processing and music share vocabulary.
Audio spectrograms have been around for a while, often with limited resolution (especially in the low register).|
A problem: if you can't distinguish a C from a C#, or identify a bass note, you can't do music theory.
I specialize in very high resolution audio images, which are beautiful and interesting.
whale song (detail)
With semitone or better resolution, mapping the color wheel to the octave reveals tonal relationships.
Wynton Marsalis, 'Blues' (detail)
Characteristic shapes recur, here's an intro.
Calculating the spectral auto-correlation matrix (following this paper [fxpal.com]) benefits from sharp spectrograms.|
Beatles, 'Here comes the Sun', auto-correlation matrix. Easy to spot the break.
More processing can produce a multi-resolution edge-detector:
Beatles, 'All my Loving', spectrogram with auto-correlation matrix and edge detection.
Which can be used for note and chord finding:
Music visualization videos can reveal subtle elements, and are fun to watch.
© 2000-2018 N. Resnikoff