Synthesized feedback converts visual arks into sound and vice-versa

We all are aware of musical notations that help a musician to formulate his or her composition. But, have you ever heard that a mere visual mark can also produce sound and vice-versa? The answer to this will be in negative. But, such a mechanism has been created by Robert Corish, a digital interactive and kinetic artist.

Synthesized Feedback

In his earlier experiments with sound synthesis, Robert noticed that it was possible to employ an interactive mechanism where sound can be triggered and generated. According to his self synthesis theory, a mark is capable of producing sound corresponding to it. Therefore, he thought that the same sound can also be used to create the visual mark, and thus complete the synthesis loop.

Picture Gallery

Synthesized Feedback

Synthesized Feedback by Robert Corish

To put his theory into effect, Robert designed the whole mechanism of synthesized feedback. The equipment mainly consists of a roll of paper, ink, speaker, a Max/MSP/jitter and a webcam. Using the ink nib marks created on the continuous roll of paper, these are then read by the webcam to pass the information on to Max/MSP/Jitter patch that converts these visual signals into digital sounds. The quality of the sound produced this way is based on the shape, angle and size of the mark.

The sound thus produced through the above mechanism enacts as a feedback causing the ink to make a mark corresponding to the sound. The whole mechanism also allows you to tweak the delay of the feedback process or rate at which the process occurs by adjusting the webcam distance or changing the motor speed of the equipment.

Via: Robert Corish