Detecting nonnative speech using speaker recognition approaches

ELIZABETH SHRIBERG; LUCIANA FERRER; SACHIN S. KAJAREKAR; N. SCHEFFER; ANDREAS STOLCKE; M. AKBACAK

Stellenbosch

Workshop; Odyssey, the speaker and language recognition workshop; 2008

ISCA

Detecting whether a talker is speaking his native language is useful for speaker recognition, speech  recognition, and intelligence applications. We study the problem of detecting nonnative speakers of American English, using two standard speech corpora. We apply approaches effective in speaker verification to this task, including systems based on MLLR, phone N-gram, prosodic, and word Ngram features. Results show equal error rates between 12% and 20%, depending on the system, test data, and choice of training data. Asymmetries in performance are most likely explained by differences in native language distributions in the corpora. Model combination yields substantial improvements over individual models, with the best result being around 8.6% EER. While phone Ngrams are widely used in related tasks (e.g., language and dialect ID), we find that it is the least effective model in combination;MLLR, prosody, and word N-gramsystems play stronger roles. Overall, results suggest that individual systems and system combinations found useful for speaker ID also offer promise for nonnativeness detection, and that further efforts are warranted in this area.