RESEARCH ARTICLE

A computational model for assessment of speech intelligibility in informational masking

  • Xihong WU ,
  • Jing CHEN
Expand
  • Speech and Hearing Research Center, Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 100871, China

Received date: 10 Oct 2011

Accepted date: 15 Dec 2011

Published date: 05 Mar 2012

Copyright

2014 Higher Education Press and Springer-Verlag Berlin Heidelberg

Abstract

The existing auditory computational models for evaluating speech intelligibility can only account for energetic masking, and the effect of informational masking is rarely described in these models. This study was aimed to make a computational model considering the mechanism of informational masking. Several psychoacoustic experiments were conducted to test the effect of informational masking on speech intelligibility by manipulating the number of masking talker, speech rate, and the similarity of F0 contour between target and masker. The results showed that the speech reception threshold for the target increased as the F0 contours of the masker became more similar to that of the target, suggesting that the difficulty in segregating the target harmonics from the masker harmonics may underlie the informational masking effect. Based on these studies, a new auditory computational model was made by inducing the auditory function of harmonic extraction to the traditional model of speech intelligibility index (SII), named as harmonic extraction (HF) model. The predictions of the HF model are highly consistent with the experimental results.

Cite this article

Xihong WU , Jing CHEN . A computational model for assessment of speech intelligibility in informational masking[J]. Frontiers of Electrical and Electronic Engineering, 2012 , 7(1) : 107 -115 . DOI: 10.1007/s11460-012-0189-8

1
Geneva: International Organization for Standardization. ISO 9921, Ergonomics — Assessment of speech communication. 2003

2
Watson C S. Uncertainty, informational masking, and the capacity of immediate auditory memory. In: Yost W A, Watson C S, Eds. Auditory Processing of Complex Sounds. NJ: Lawrence Erlbaum Associates, 1987, 267-277

3
Freyman R L, Balakrishnan U, Helfer K S. Spatial release from informational masking in speech recognition. Journal of the Acoustical Society of America, 2001, 109(5): 2112-2122

DOI

4
Brungart D S, Simpson B D, Ericson M A, Scott K R. Informational and energetic masking effects in the perception of multiple simultaneous talkers. Journal of the Acoustical Society of America, 2001, 110(5): 2527-2538

DOI

5
Durlach N I, Mason C R, Kidd G Jr, Arbogast T L, Colburn H S, Shinn-Cunningham B G. Note on informational masking. Journal of the Acoustical Society of America, 2003, 113(6): 2984-2987

DOI

6
Wu X H, Wang C, Chen J, Qu H W, Li W R, Wu Y H, Schneider B A, Li L. The effect of perceived spatial separation on informational masking of Chinese speech. Hearing Research, 2005, 199(1-2): 1-10

DOI

7
Mattys S L, Brooks J, Cooke M. Recognizing speech under a processing load: Dissociating energetic from informational factors. Cognitive Psychology, 2009, 59(3): 203-243

DOI

8
Freyman R L, Balakrishnan U, Helfer K S. Effect of number of masking talkers and auditory priming on informational masking in speech recognition. Journal of the Acoustical Society of America, 2004, 115(5): 2246-2256

DOI

9
Simpson S A, Cooke M. Consonant identification in N-talker babble is a nonmonotonic function of N. Journal of the Acoustical Society of America, 2005, 118(5): 2775-2778

DOI

10
Rhebergen K S, Versfeld N J, Dreschler W A. Release from informational masking by time reversal of native and nonnative interfering speech. Journal of the Acoustical Society of America, 2005, 118(3): 1274-1277

DOI

11
French N R, Steinberg J C. Factors governing the intelligibility of speech sounds. Journal of the Acoustical Society of America, 1947, 19(1): 90-119

DOI

12
Fletcher H, Galt R H. The perception of speech and its relation to telephony. Journal of the Acoustical Society of America, 1950, 22(2): 89-151

DOI

13
ANSI. ANSI S3.5, Methods for the calculation of the articulation index. New York: American National Standards Institute, 1969

14
ANSI. ANSI S3.5-1997, Methods for the calculation of the speech intelligibility index. New York: American National Standards Institute, 1997

15
Zhang J L. Statistic relations on articulation index across different speech test materials. Acoustics, 1964, 1: 90-94 (in Chinese)

16
Zhang J L, Ma D Y. A new method for calculating articulation index. Acoustics, 1965, 2: 80-84 (in Chinese)

17
Zhang J L. The statistic relation on articulation index between syllable and phoneme. Physics, 1974, 23: 315-320 (in Chinese)

18
Houtgast T, Steeneken H J. A review of the MTF concept in room acoustics and its use for estimating speech intelligibility in auditoria. Journal of the Acoustical Society of America, 1985, 77(3): 1069-1077

DOI

19
Chi T, Gao Y, Guyton M C, Ru P, Shamma S. Spectrotemporal modulation transfer functions and speech intelligibility. Journal of the Acoustical Society of America, 1999, 106(5): 2719-2732

DOI

20
Elhilali M, Chi T, Shamma S A. A spectro-temporal modulation index (STMI) for assessment of speech intelligibility. Speech Communication, 2003, 41(2-3): 331-348

DOI

21
Chen J. Mechanism of informational masking and computational model for evaluating speech intelligibility. Dissertation for the Doctoral Degree. Beijing: Peking University, 2009 (in Chinese)

22
Li L, Daneman M, Qi J G, Schneider B A. Does the information content of an irrelevant source differentially affect spoken word recognition in younger and older adults? Journal of Experimental Psychology: Human Perception and Performance, 2004, 30(6): 1077-1091

DOI

23
Huang Y, Huang Q, Chen X, Qu T S, Wu X H, Li L. Perceptual integration between target speech and target-speech reflection reduces masking for target-speech recognition in younger adults and older adults. Hearing Research, 2008, 244(1-2): 51-65

DOI

24
Litovsky R Y, Colburn H S, Yost W A, Guzman S J. The precedence effect. Journal of the Acoustical Society of America, 1999, 106(4): 1633-1654

DOI

25
Wu X H, Chen J, Yang Z G, Huang Q, Wang M Y, Li L. Effect of number of masking talkers on speech-on-speech masking in Chinese. In: Proceedings of the 8th Annual Conference of the International Speech Communication Association (Interspeech2007). 2007, 390-393

26
Henja D, Musicus B. The solafs time-scale modification algorithm. Technical report. Bolt Beranek & Newman, 1991

27
Binns C, Culling J F. The role of fundamental frequency contours in the perception of speech against interfering speech. Journal of the Acoustical Society of America, 2007, 122(3): 1765-1776

DOI

28
Chen J, Li H H, Li L, Moore C J B, Wu X H. Informational masking of speech produced by speech-like sounds without linguistic content. Journal of Acoustic Society of America, 2011 (conditionally accepted)

29
Scheffers M T M. Sifting vowels: Auditory pitch analysis and sound segregation. Dissertation for the Doctoral Degree. Groningen, Netherlands: University of Groningen, 1983

30
Licklider J C R. A duplex theory of pitch perception. Experientia, 1951, 7(4): 128-134

DOI

31
Assmann P F, Summerfield Q. Modeling the perception of concurrent vowels: Vowels with the same fundamental frequency. Journal of the Acoustical Society of America, 1989, 85(1): 327-338

DOI

32
Meddis R, Hewitt M J. Modeling the identification of concurrent vowels with different fundamental frequencies. Journal of the Acoustical Society of America, 1992, 91(1): 233-245

DOI

33
de Cheveigné A. Concurrent vowel identification. III: A neural model of harmonic interference cancellation. Journal of the Acoustical Society of America, 1997, 101(5): 2857-2865

DOI

34
Cooke M, Ellis D P W. The auditory organization of speech and other sources in listeners and computational models. Speech Communication, 2001, 35(3-4): 141-177

DOI

35
Greenberg S, Ainsworth W. Speech processing in the auditory system: An overview. In: Greenberg S et al., Eds. Speech Processing in the Auditory System. Springer: Berlin, 2004, 20-22

DOI

36
Patterson R D, Allerhand M H, Gigu`ere C. Time-domain modeling of peripheral auditory processing: A modular architecture and a software platform. Journal of the Acoustical Society of America, 1995, 98(4): 1890-1894

DOI

37
Glasberg B R, Moore B C J. A model of loudness applicable to time-varying sounds. Journal of the Audio Engineering Society, 2002, 50(5): 331-342

38
Glasberg B R, Moore B C J. Derivation of auditory filter shapes from notched-noise data. Hearing Research, 1990, 47(1-2): 103-138

DOI

39
Wu M, Wang D, Brown G J. A multipitch tracking algorithm for noisy speech. IEEE Transactions on Speech and Audio Processing, 2003, 11(3): 229-241

DOI

40
Studebaker G A, Sherbecoe R L, Gilmore C. Frequencyimportance and transfer functions for the Auditec of St. Louis recordings of the NU-6 word test. Journal of Speech and Hearing Research, 1993, 36(4): 799-807

41
Rhebergen K S, Versfeld N J, Dreschler W A. Extended speech intelligibility index for the prediction of the speech reception threshold in fluctuating noise. Journal of the Acoustical Society of America, 2006, 120(6): 3988-3997

DOI

42
Huang Q. Frequency importance function of Mandarin Chinese speech and models for speech intelligibility evaluation. Dissertation for the Master’s Degree. Beijing: Peking University, 2007 (in Chinese)

43
Brokx J P L, Nooteboom S G. Intonation and the perceptual separation of simultaneous voices. Journal of Phonetics, 1982, 10(1): 23-36

44
Darwin C J, Brungart D S, Simpson B D. Effects of fundamental frequency and vocal-tract length changes on attention to one of two simultaneous talkers. Journal of the Acoustical Society of America, 2003, 114(5): 2913-2922

DOI

Outlines

/