Cover Page    Full-Text Download    
Subscribe Now
Recommend the Paper
Intelligent Multimedia Annotation and Interaction Using Semantic Musical Features: Encoding Human-Centric Music Intelligence for Musically Plausible Human-Media Interactions  
Gang Ren1,Zhe Wen2,Xuchen Yang3,Mark Bocko4,Dave Headlam5
*1, University of Rochester, Email : g.ren@rochester.edu
2, University of Rochester, Email : zhe.wen@rochester.edu
3, University of Rochester, Email : xuchenyang@rochester.edu
4, University of Rochester, Email : mark.bocko@rochester.edu
5, University of Rochester, Email : dheadlam@esm.rochester.edu
 
Abstract .Semantic musical features reflect in-depth understanding of the music, instead of the uninterpreted music content, and serve as idea choices for multimedia content annotations. The proposed semantic music features are based on human music interpretations and their computational implementations. When employed for multimedia applications, these features enable us to simulate human-music interactions. This musical relevance provides significant performance improvement over conventional score or audio based multimedia annotation systems. Two types of semantic musical features, including reductive music analysis and musical expressive features, are introduced. The details of their feature extraction algorithms and semantic interpretations are also illustrated.
 
Keywords : knowledge engineering ; multimedia annotation ; feature analysis ; human-computer interaction
 URL: http://dx.doi.org/10.7321/jscse.v3.n3.36  
 
 

Subscribe Now

Email :    
Subscribe to receive free TOC's JSCSE by email
Subscribe

Recommend To Friend

Email :     People