Abstract
This paper describes the technical and aesthetic approach utilised for the development of an interactive audiovisual performance system designed specifically for use by children with multiple learning difficulties, including deafness and autism. Sound is transformed in real-time through the implementation of a Fast Fourier Transform and translated into a moving image. This image is adapted so that relevant information can be understood and manipulated visually in real-time. Finally, the image is turned back into sound with only minimal delay. The translation process is based on research in computer music, neuroscience, perception and abstract film studies. The system is achieving a significant user base amongst the deaf and disabled community through projects involving the British Broadcasting Corporation and the London Philharmonic Orchestra. Alongside continuing collaboration with the Sonic Arts Network, the system has now been made freely available to the public, and is being developed as a speech therapy tool.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
