A song unfolds over minutes. genSound turns it into a single image, so the whole piece can be seen at once.
It listens to a track in 250,000 overlapping moments, each a tenth of a second long, and measures three things in every one: the note being played, how loud it is, and its strongest frequency. Each moment becomes one point of color. By default the note picks the hue, loudness sets the saturation, and frequency sets the lightness; silence stays black. The lab shows the same analysis two ways: as rings that grow outward from the opening, and as a Hilbert curve that keeps nearby moments together. Change the palette and the color rules to see how each one changes the picture.
Loading…
Rings start at center, end at cornersHilbert nearby moments stay nearby
Hue key
Settings
Example tracks: Chopin, Nocturne Op. 9 No. 2, performed by Peter Johnston via Musopen (CC0). Beethoven, Symphony No. 8, iv. Allegro vivace, Musopen recording (public domain). "Hitman" by Kevin MacLeod (incompetech.com), licensed under CC BY 4.0. All from Wikimedia Commons.