NDLI: Multimodal classification of dance movements using body joint trajectories and step sounds

Content Provider	IEEE Xplore Digital Library
Author	Masurelle, A. Essid, S. Richard, G.
Copyright Year	2013
Description	Author affiliation: Inst. Mines-Telecom, Telecom ParisTech., Paris, France (Masurelle, A.; Essid, S.; Richard, G.)
Abstract	We present a multimodal approach to recognize isolated complex human body movements, namely Salsa dance steps. Our system exploits motion features extracted from 3D sub-trajec-tories of dancers' body-joints (deduced from Kinect depth-map sequences) using principal component analysis (PCA). These sub-trajectories are obtained thanks to a footstep impact detection module (from recordings of piezoelectric sensors installed on the dance floor). Two alternative classifiers are tested with the resulting PCA features, namely Gaussian mixture models and hidden Markov models (HMM). Our experiments on a multimodal Salsa dataset show that our approach is superior to a more traditionnal method. Using HMM classifiers with three hidden states, our system achieves a classification performance of 74% in F-measure when recognizing gestures among six possible classes, which outperforms the reference method by 11 percentage points.
Starting Page	1
Ending Page	4
File Size	231998
Page Count	4
File Format	PDF
ISBN	9781479908332
ISSN	21585873
DOI	10.1109/WIAMIS.2013.6616151
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-07-03
Publisher Place	France
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Motion segmentation Hidden Markov models Gesture recognition Feature extraction Trajectory Joints Principal component analysis
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Libarray of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Multimodal classification of dance movements using body joint trajectories and step sounds.

Accelerometer-based gesture classification using principal component analysis

Multimodal analysis of speech prosody and upper body gestures using hidden semi-Markov models

Learning basis skills by autonomous segmentation of humanoid motion trajectories

A Kinect based gesture recognition algorithm using GMM and HMM

Gesture Recognition for Alphabets from Hand Motion Trajectory Using Hidden Markov Models

Gesture recognition using a NMF-based representation of motion-traces extracted from depth silhouettes

6D motion gesture recognition using spatio-temporal features

Multicamera audio-visual analysis of dance figures using segmented body model

Multimodal classification of dance movements using body joint trajectories and step sounds

Similar Documents

Multimodal classification of dance movements using body joint trajectories and step sounds.

Accelerometer-based gesture classification using principal component analysis

Multimodal analysis of speech prosody and upper body gestures using hidden semi-Markov models

Learning basis skills by autonomous segmentation of humanoid motion trajectories

A Kinect based gesture recognition algorithm using GMM and HMM

Gesture Recognition for Alphabets from Hand Motion Trajectory Using Hidden Markov Models

Gesture recognition using a NMF-based representation of motion-traces extracted from depth silhouettes

6D motion gesture recognition using spatio-temporal features

Multicamera audio-visual analysis of dance figures using segmented body model

Multimodal classification of dance movements using body joint trajectories and step sounds