This looks like it might be an interesting idea behind an application. Sonified has arrived. Here’s what the app’s description:
Sonified translates what your video camera sees into sound in real time. Record onto QuickTime movies. The sonifying video camera for the iPhone and iPad.
Hear what your video camera sees
Sonified takes real time visual information from your iPhone/iPad video camera and uses it to mix 16 stereo tracks of CD quality music in real time, translating what your video camera sees into sound. A real time instrument, Sonified uses your iPhone/iPad’s video camera to translate qualities of light and color into music, a process called “sonification”. Using Sonified allows the iPhone and iPad user to connect vision and sound in new ways, creating video and soundtrack at the same time. Record Sonified QuickTime movies with CD quality audio and share with friends and other Sonified users.
Real time mixing of audio based off of brightness and or color values.
16 different ways to combine sounds and visual response.
4 Sonified “instruments”, each with its own unique way of mixing sound based off of visual information: mixing sound based off of brightness, based off of color, based off of both brightness and color simultaneously, or based off of brightness and color proportioned towards color.
A total of 64 stereo tracks of sound in four separate Sonified “scenes” all in 44.1 kHz 16-bit CD quality audio.
Extremely responsive, with close to zero-latency between what your camera sees and what you hear.
Record video and CD quality sound simultaneously onto QuickTime movies and save on your iPhone or iPad.
Intuitive, with an easy to use interface.
Designed for use with headphones.
The app is priced at $2.99.