Acousto-optic sensorial substitution device

  1. Sergio Hernández 1
  2. Jesús M. Torres 1
  3. Jonay Toledo 1
  4. José Sigut 1
  5. Silvia Alayón 1
  1. 1 Dpto. de Física Fundamental y Experimental, Electrónica y Sistemas, Universidad de La Laguna
International Signal Processing Conference: ISPC (2003. Dallas)

Publisher: Global Technology Conferences

Year of publication: 2003

Type: Conference paper


This paper presents a sensorial substitution system. This system isdesigned to help people with hearing problems. The device getsrequired information from the acoustic environment thentransforms into visual representation. Finally, the system display itin real-time.The users can see the device output through an eyeglasses-mounted display with see-through optics. This optic allows theusers to see the graphics generated by the device without troublefor their eyesight. In the same glasses are mounted, around thehead, the microphones to acquire the mixtures to the signalprocessing subsystem.The signal processing subsystem gives the spatial localization andspectral analysis of every source. This acoustic information isencoded into visual elements, that is, the system uses the colour,the spatial localization and temporal localization. The device isbeing tested with a sample of five deaf subjects, and taken theiradvice to enhance the system.

Bibliographic References

  • The MicroOptical Corporation
  • Alexander Jourjine, Scott Rickard and Özgür Yilmaz in Proceedings of the 2000 IEEE Conference on Acoustics, Speech, and Signal Processing (ICASSP2000), Volume 5, Pages 2985-2988 (Istanbul, Turkey, June 2000)
  • Jie Huang, Noboru Ohnishi and Noboru Sugie, Modeling the precedence effect for sound localization in reverberant environment" in Proceedings. IEEE Instrum. Meas. Technol. Conf. (IMTC'96), pp.633-636, (Brussels, June 1996).
  • Scott Rickard, Radu Balan and Justinian Rosca. Real-time time-frecuency based blind source separation in Proceedings of ICA2001 Conference (San Diego CA, December 2001).