Class confusability reduction in audio-visual speech recognition using random forests

SAD, GONZALO D.; GÓMEZ, JUAN C.; TERISSI, LUCAS D.

LECTURE NOTES IN COMPUTER SCIENCE

Springer Verlag

Lugar: Cham; Año: 2018 vol. 1657 p. 584 - 592

0302-9743

This paper presents an audio-visual speech classification system based on Random Forests classifiers, aiming to reduce the intra-class misclassification problems, which is a very usual situation, specially in speech recognition tasks. A novel training procedure is proposed, introducing the concept of Complementary Random Forests (CRF) classifiers. Experimental results over three audio-visual databases, show that a good performance is achieved with the proposed system for the different types of input information considered, viz., audio-only information, video-only information and fused audio-video information. In addition, these results also indicate that the proposed method performs satisfactorily over the three databases using the same configuration parameters.