Deafsic: Desktop Application for Teaching Bowed String Instruments to Hearing Impaired Children.

Abstract

Deafness in children at an early age generates learning limitations. Music is appreciated through vibrations in the air that are captured by the ear; This is not the only process to interpret these vibrations. Work has been developed that relates musical teaching/learning to hearing impairment, but this topic has not been fully developed. Deafsic is a prototype that helps hearing-impaired children play bowed string instruments at an early stage, captures the notes played on the violin, translates them into vibratory and visual language, compares the performance with the score and shows errors in real time. The Kodaly methodology was used, which has a sign system for each note, and “sound-color” synesthesia. This work was developed in the “Manuel Piar” Special EU, located in the Unare Puerto Ordaz Parish, as a contribution to the achievement of UN SDG 10 on “Reducing inequality in countries”, Arduino technology, Transform algorithm, was used. Fast Fourier, Hamming Window, an algorithm was developed to compare the frequency spectra of the notes, the OpenSheetMusicDisplay libraries were adapted for viewing scores and OSMD Audio Player for playback.