NDLI: Synthesizing speech animation by learning compact speech co-articulation models

Content Provider	IEEE Xplore Digital Library
Author	Deng, Z. Lewis, J.P. Neumann, U.
Copyright Year	2005
Description	Author affiliation: Dept. of Comput. Sci., Univ. of Southern California, Los Angeles, CA, USA (Deng, Z.; Lewis, J.P.; Neumann, U.)
Abstract	While speech animation fundamentally consists of a sequence of phonemes over time, sophisticated animation requires smooth interpolation and co-articulation effects, where the preceding and following phonemes influence the shape of a phoneme. Co-articulation has been approached in speech animation research in several ways, most often by simply smoothing the mouth geometry motion over time. Data-driven approaches tend to generate realistic speech animation, but they need to store a large facial motion database, which is not feasible for real time gaming and interactive applications on platforms such as PDAs and cell phones. In this paper we show that accurate speech co-articulation model with compact size can be learned from facial motion capture data. An initial phoneme sequence is generated automatically from text-to-speech (TTS) systems. Then, our learned co-articulation model is applied to the resulting phoneme sequence, producing natural and detailed motion. The contribution of this work is that speech co-articulation models "learned" from real human motion data can be used to generate natural-looking speech motion while simultaneously preserving the expressiveness of the animation via keyframing control. Simultaneously, this approach can be effectively applied to interactive applications due to its compact size.
Sponsorship	IEEE Comput. Soc. Visualization and Graphics Tech. Comm.
Starting Page	19
Ending Page	25
File Size	1348714
Page Count	7
File Format	PDF
ISBN	0780393309
ISSN	15301052
DOI	10.1109/CGI.2005.1500361
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2005-06-22
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Speech synthesis Interpolation Shape Smoothing methods Mouth Geometry Facial animation Spatial databases Personal digital assistants Cellular phones
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Libarray of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

ABSTRACT Synthesizing Speech Animation By Learning Compact Speech Co-Articulation Models

Facial animation system for embedded application

Video communication system using portrait animation

Speech synthesis for mobile phone

Speech driven facial animation using a hidden markov co-articulation model

Expressive Facial Animation Synthesis by Learning Speech Co-Articulation and Expression (2006)

Realistic facial animation of speech synchronization for Indonesian language

An acoustic model adaptation using HMM-based speech synthesis

Creating speech-synchronized animation

Synthesizing speech animation by learning compact speech co-articulation models

Similar Documents

ABSTRACT Synthesizing Speech Animation By Learning Compact Speech Co-Articulation Models

Facial animation system for embedded application

Video communication system using portrait animation

Speech synthesis for mobile phone

Speech driven facial animation using a hidden markov co-articulation model

Expressive Facial Animation Synthesis by Learning Speech Co-Articulation and Expression (2006)

Realistic facial animation of speech synchronization for Indonesian language

An acoustic model adaptation using HMM-based speech synthesis

Creating speech-synchronized animation

Synthesizing speech animation by learning compact speech co-articulation models