Rafał SZRAJBER | Radosław BEDNARSKI
(Institute of Information Technology, Lodz , University of Technology, Lodz, Poland)
Keywords: blindness, sound reconstruction, heritage for people with disabilities, kinect
Abstract:
Article presents the possibility of use of sound as a way to describe the images. This project was realized with students. The system is based on the use Kinect sensor to enable to „hear colours „by blind and sand-blind people. Solution such as , converting colors to sounds give unusual opportunity to experience in unexpected way different works of art – to hear heritage stored in the image.
In the project we used 32 colours to which we assigned sounds. Other sounds are generated by interpolation of basic sounds. Also we took into account the possibility of interference caused by the detection of more than one individual for Kinect sensor and reduced the distance for the detection of the person using the application. We will show how the systems works on real examples. An important aspect of this system is a possibility to experience the thrill of the analyzed picture ( viewing by the sound). Moreover it allows to compare other works experienced the same way. We also plan to develop applications in the direction of offering simultaneous reading of images in two places, which will allow for analysis of changes colors in an image by varying the sound for the left and right ear, corresponding to the left and right hand.