Somatosensory Interaction Using Motion Sensors Embedded in Mobile Phones

Cuixian Xuan; Xiubo Liang; Yongjian Gong
February 2012
International Journal of Digital Content Technology & its Applic;Feb2012, Vol. 6 Issue 3, p167
Academic Journal
Somatosensory interaction is one of the most popular ways of controlling avatars in video games, which adopts users' body movements directly as the input. In this paper, we presented a novel motion generation system for virtual characters with motion sensors embedded in mobile phones. Firstly, the motion signals of the users are collected as samples by a handheld mobile phone and sent to a computer through Bluetooth connection. After being preprocessed, the samples are employed for training and recognition with our machine learning models. Then, the recognition results are used to drive the generation of avatar's motions. At last, the motion is further adapted by our real-time inverse kinematics solver to satisfy the constraints in the environment. We achieve an average recognition rate of 90% on a test set of 20 gestures. The final results show that our system is intuitive, efficient and particularly suitable for avatar control in video games and VR applications.


Related Articles

  • Effects of High Stimulus Frequencies on SEPs of Patients with Neuro-Behcet's Disease. Turker, Hande; Cengiz, Nilgun; Akar, Handan; Onar, Musa K.; Us, Onder // Canadian Journal of Neurological Sciences;Nov2006, Vol. 33 Issue 4, p387 

    The article discusses the results of a study which examined the effects of high stimulus frequencies on the somatosensory evoked potentials and central conduction time (CCT) of patients with neuro-Behcet's (NB) disease. The results indicate that the onset CCT values of NB group were higher than...

  • Efficacy of Levobupivacaine Infiltration Anesthesia on the Oral Mucosa: Evaluation with Somatosensory Evoked Potentials following Tooth Pulp Electrical Stimulation in Rats.  // Anesthesia Progress;2004, Vol. 51 Issue 3, p106 

    Presents an abstract of the article "Efficacy of Levobupivacaine Infiltration Anesthesia on the Oral Mucosa: Evaluation With Somatosensory Evoked Potentials Following Tooth Pulp Electrical Stimulation in Rats," by T. Shibutani, H. Oda, K. Taniyama, K. Okawa, K. Himeno and I. Hirose.

  • Somatosensory evoked potentials and sensory involvement in multiple sclerosis: comparison with clinical findings and quantitative sensory tests. Leocani, Letizia; Martinelli, Vittorio; Natali-Sora, Maria Grazia; Rovaris, Marco; Comi, Giancarlo // Multiple Sclerosis (13524585);Jun2003, Vol. 9 Issue 3, p275 

    Sensory disturbances are one of the most common findings in patients with multiple sclerosis (MS). However, they are usually assessed at the standard neurological examination only. Quantitative Sensory Tests (QSTs) for temperature and vibratory sense allow a more objective evaluation. In a group...

  • Changes in the somatosensory N250 and P300 by the variation of reaction time. Kida, Tetsuo; Nishihira, Yoshiaki; Hatta, Arihiro; Wasaka, Toshiaki; Nakata, Hiroki; Sakamoto, Masanori; Nakajima, Tsuyoshi // European Journal of Applied Physiology;May2003, Vol. 89 Issue 3/4, p326 

    We investigated the relationship between somatosensory event-related potentials (ERP) and the variation of reaction time (RT). For this purpose, we recorded the ERPs (N250 and P300) in fast- and slow-reaction trials during a somatosensory discrimination task. Strong, standard, and weak target...

  • Somatosensory evoked potentials in children with severe head trauma. Schalamon, Johannes; Singer, Georg; Kurschel, Senta; Höllwarth, Michael E.; Höllwarth, Michael E // European Journal of Pediatrics;Jul2005, Vol. 164 Issue 7, p417 

    Unlabelled: We evaluated the predictive value of somatosensory evoked potentials (SEP) in a series of children with severe traumatic brain injury (TBI). The prospective clinical investigation was performed in a Level I paediatric trauma centre. We included 26 consecutive comatose...

  • Prognosis of conservatively treated patients with Pott's paraplegia: logistic regression analysis. Kalita, J.; Misra, U. K.; Mandal, S. K.; Srivastava, M. // Journal of Neurology, Neurosurgery & Psychiatry;Jun2005, Vol. 76 Issue 6, p866 

    Objective: To evaluate the prognostic significance of various clinical, radiological, and neurophysiological findings in conservatively treated patients with Pott's paraplegia, using multiple regression analysis.Methods: The study included 43 patients with Pott's...

  • Somatosensory paths proceeding to spinal cord and brain — centripetal and centrifugal control for human movement. Brooke, John D. // Canadian Journal of Physiology & Pharmacology;Aug2004, Vol. 82 Issue 8/9, p723 

    The flow of fast-conducting somatosensory information proceeding from the human leg, and entering sensorimotor control processes, is modulated according to the demands of limb movement. Both centripetal (proceeding in from sensory receptor discharge) and centrifugal (proceeding out from motor...

  • Novel Motor and Somatosensory Activity Is Associated With Increased Cerebral Cortical Blood Volume Measured by Near-Infrared Optical Topography. Peyton, Jeffrey L.; Bass, W. Thomas; Burke, Bonnie L.; Frank, L. Matthew // Journal of Child Neurology;Oct2005, Vol. 20 Issue 10, p817 

    Recent reports suggest that learning is enhanced by emotion, spontaneity, and play. The mechanisms of this enhancement are unclear and might involve increased cortical stimulation by the limbic system. Since neuronal activity is tightly coupled to changes in cerebral blood flow and volume, the...

  • Peripheral Neuropathy in a Child With Cree Leukodystrophy. Huntsman, R. J.; Seshia, S.; Lowry, N.; Lemire, E. G.; Harder, S. L. // Journal of Child Neurology;Jun2007, Vol. 22 Issue 6, p766 

    The authors describe peripheral nerve involvement in a 12-month-old boy with Cree leukodystrophy. Nerve conduction and genetic studies were performed during investigation of his leukodystrophy. Mutation analysis of the eukaryotic initiation factor 2B5 gene detected homozygosity of the R195...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics