Lip Movement and Expression Database Construction for Chinese Sign Language Synthesis
-
摘要: 为提高手语合成的真实感和可懂度,分析了手语表达中唇动和表情运动的特点,基于MPEG-4的参数化表达模型,提出了兼容于MPEG-4的口型和表情库构建方法,并基于该库完成了包含手势、唇动和表情的虚拟人手语动画.实验结果表明,包含唇动和表情的合成手语的真实感得到增强,进而说明了口型和表情库的有效性.
-
关键词:
- 手语合成 /
- 多模式 /
- 人脸定义参数(FDP) /
- 人脸动画参数(FAP)
Abstract: To synthesize realistic and intelligible lip motion and expression for Chinese sign language,based on MPEG-4 parametric model,a kind of method for constructing lip motion and expression database was proposed.When the lip motion and expression database were used to synthesize Chinese sign language animation,compared with the previous synthesized result,the animation including gesture,lip motion and expression was more realistic and intelligible.Experimental results show that the method for constructing lip motion and expression is valid. -
-
[1] CHEN Yi-qiang,GAO Wen,WANG Zhao-qi.Text to avatar in multimodal human computer interface[C]∥Proceeding of the Fifth Asia Pacific Conference on Computer Human Interaction.Beijing:[s.n.],2002:636-643.
[2] SUMIHIRO K,TAKAO K.Facial and head movements of a sign interpreter and their application to Japanese sign animation[C]∥Proceedings of the 9th International Conference on Computers Helping People with Special Needs(ICCHP 2004).Berlin:Springer-Verlag,2004:1172-1177.
[3] YE Ke-jia,YIN Bao-cai,WANG Li-chun.CSLML:a markup language for expressive chinese sign language synthesis[J].The Journal of Computer Animation and Virtual Worlds,2009,20(2/3):237-245.
[4] HARTMANN B,MANCINI M,PELACHAUD C.Implementing expressive gesture synthesis for embodied conversational agents[C]∥Lecture Notes in Artificial Intelligence.Berlin:Springer-Verlag,2006,3881:188-199.
[5] 吴铃.汉语手语语法研究[J].中国特殊教育,2005(8):15-22.WU Ling.Research on Chinese sign language grammar[J].Chinese Journal of Special Education,2005(8):15-22.(in Chinese) [6] 王志明,蔡莲红.汉语语音视位的研究[J].应用声学,2002,21(3):29-34.WANG Zhi-ming,CAI Lian-hong.Study of Chinese viseme[J].Applied Acoustics,2002,21(3):29-34.(in Chinese) [7] 中国聋人协会.中国手语[M].北京:华夏出版社,2003:1-1176. [8] ISO/IEC.14496-2 Information technology-coding of audio-visual objects:part 2-visual[S].Switzerland:International Organization for Standardization,2001.
[9] ISO/IEC.JTCI/SC29/WG11 N2323 Overview of the MPEG-4 standard[S].Geneva:International Organization for Standardization,1998.
[10] 倪明田,吴良芝.计算机图形学[M].北京:北京大学出版社,2002:143-144. [11] 尹宝才,王恺,王立春.基于MPEG-4的融合多元素的三维人脸动画合成方法[J].北京工业大学学报,2011,37(2):266-271.YIN Bao-cai,WANG Kai,WANG Li-chun.A synthesis method of three-dimensional facial animation with multiple elements blending based on MPEG-4[J].Journal of Beijing University of Technology,2011,37(2):266-271.(in Chinese)
计量
- 文章访问数: 7
- HTML全文浏览量: 0
- PDF下载量: 5
下载:
