An Improved Incremental Approach to Speech Corpus Selection

doi:10.7523/j.issn.2095-6134.2005.2.003

Abstract

Abstract:

In this paper, a novel incremental corpus selection approach is proposed, which can control the balance of phone units in the selected corpus more effectively through a process of erasing redundant sentences at each selection phrase.In our experiments, we employ a huge original data source consists of about 20 million sentences and 847-phone-contexts, while corpus generated from this data source has made up of 17865 sentences and has an coverage of 94.3 % according to phone-contexts which appearances frequency in the selected corpus are more than 10.In addition, it achieves a relatively low distribution variance of 0.18 ×10^-3.Experiment results show that our approach is much better than traditional algorithms not only in phonetic units coverage but in phonetic units distribution variances.Moreover, Our algorithm has low computation complexity and memory cost.

Key words: speech recognition, acoustic model, corpus selection

CLC Number:

TP391

NING Zhen-Jiang, DU Li-Min . An Improved Incremental Approach to Speech Corpus Selection[J]. , 2005, 22(2): 140-146.

References

[1] Wu SM, Liau JS.On the creation of mandarin phonetic balanced sentences.Telecommunication Journal, 1990, 19(1):79 ～ 87

[2] Jyh-Shing, Shyuu, Wang JF.An algorithm for automatic generation of mandarin phonetic balanced corpus.ICSLP'98, Sydney,Australia, 1998,7 :3175 ～ 3178

[3] Wang HM, Chang YC, Lee LS.Automatic selection of Chinese syllable-balanced sentences from Chinese text corpus.ROCLING-VI, 1993, 195～ 206

[4] Gao YQ, Hon HW, Lin ZW, et al.Tangerine :a large vocabulary mandarin di ctation system.ICASSP'95, Detroit, Michigan, USA, 1995, 1(1):77 ～ 80

[5] Li M, Jochen J, Yu TC.An incremental approach to selection of well balanced corpus.In :8th Aust.Int.Conf.Speech Sci.&Tech., 2000, 440～ 444

[6] Wu H, Xu B, Huang TY.Automatic corpus selecting algorithm based on triphone models.Journal of Software, 2000, 11(2):271 ～ 276 (in Chinese with English abstract)

[7] Donald EK.The Art of Computer Programming Volume 3.Sorting and Searching, Second Edition, Massachusetts :Addi son-Wesley, 1998

[8] Zhu DX.Lectures on Syntax.Beijing :Commercial Press, 1982 (in Chinese)

[9] Wang XF, Du LM.A method of sentence segment ation that check all overlapping ambiguity.Acta Electronica S inica, 2004, 32(1):50 ～ 54 (in Chinese with English abstract)

[10] Chen XH.Automatic Analysis of Contemporary Chinese Using Visual C++.Beijing :Bei jing Language and Culture University Press, 1999 (in Chinese)

[6] 吴华, 徐波, 黄泰翼.基于三音子模型的语料选择算法.软件学报, 2000.11(2):271 ～ 276

[8] 朱德熙.语法讲义.北京:商务印书馆,1982

[9] 王显芳, 杜利民.一种能够检测所有交叉歧义的汉语句子切分算法.电子学报, 2004, 32(1):50 ～ 54

[10] 陈小荷.现代汉语自动分析-Vi sual C++实现.北京:北京语言文化大学出版社, 1999