Hand Gesture Recognition and Virtual Game Control Based on 3D Accelerometer and EMG Sensors

Comments

Jill

Summary

In Hand Gesture Recognition and Virtual Game Control Based on 3D Accelerometer and EMG Sensors, the researchers propose a new form of input for virtual games and other applications using the motion of the hand. While previous forms of input using the hand would use only the accelerometer or the EMG sensors, this project takes both forms of input and combines them together for a more accurate and reproducible input for games.

The accelerometer is used to determine the direction of large scale gestures, and is not accustomed to use with small gestures. It can also sense rotation as well as large movement. The EMG sensor, or electromagnetic sensor, senses the electrical currents that muscles make as they move within the body, thus giving the system the knowledge of when a user has moved. The problem with EMG is that it is hard to determine the exact movement that was made, but it can sense when even the tiniest of movements occurs. The accelerometer (ACC) and the EMG inputs are processed in real-time and converted to recognized gestures and inputs to control the game.

To test this new innovation, the researchers built a virtual Rubik's Cube game, and allowed those in the study to manipulate the cube in real time in 3D space using the gesture input system. After being outfitted with EMG sensors along their wrist, and an accelerometer on the top of their hand, they were able to manipulate the cube, and the system was able to recognize their gestures, 91.7% of the time. Future work would include making the system more robust, extending applications to mobile device control, and the design of smaller sensors for inclusion in a glove, for example.

Discussion

I thought this seemed pretty interesting because unlike newer game control input systems (like Project Natal, by Microsoft, which uses a camera to detect user movement, gestures, and motions, without a controller), they are getting the exact movement from the user. It seemed similar to the accelerometer that Nintendo uses in their Wii controllers, but it would have a higher sensitivity as it actually senses the electrical impulses to the muscles in the body. My question would be if this system was actually more useful than the Wii motion controller system, or was just a novel way to control input using the whole hand and fingers instead of using an external controller.