SPECTRAL CROSSOVER (2015)
Haye Heerten is interested in creating a system for simultaneous video and sound synthesis. The system prototype doesn't visualize sound, it works the other way around by directly translating luminance distributions in images into audible oscillations. The images are improvised live from simple rectangles, basic filters (e.g. blur) and multiple feedback layers. Intricate visual patterns may emerge which define dark and bright parts of the image. Their complexity and harsh- or softness determine the wave shapes we hear. Multiple different patterns can influence each other and sound together because the image is separated into different color hues to give each of them its own voice.
Used material: iPad, computer, projector, stereo speakers; Lemur, Modul8 and Max 7 software