top of page

VR Gesture Upper Body Rehab Game

Game Demo Video

By using hands tracking and gesture recognition, we designed this VR gesture game for stroke patients to train their upper body movements, including finger and arm rehabilitation. 

Duration: 7 weeks
Team: 4 Team Members

My Role

UX Research / UX Designer

UI Designer

Game Concept Design

Design Process

We started with searching all existing VR gesture games and looking at publications related to VR game in physical therapy. Then we interviewed 3 therapiest to figure out the meaningful movements of stroke rehabilitation and patient's needs to define our clinical goal. Later, we started to design game prototype in unity, this process took us about 7 weeks. It's still under developing, and we hope we can test it out before the end of June, 2021.

Research & Interview

Based on our initial research and assumption, we designed a demo that includes basic play mode for patient experiencing. The goal of the interview is to identify the core information that is essential for the patient rehabilitation process, including evaluation process, meaningful recovery movement, common measurement metrics, recommended session time and play position, and doctor’s opinion towards traditional rehabilitation method & potential usages. We interviewed a doctor with Neurological Rehabilitation background in the early stage of game design. Our interview is semi-structured.

Interview Report PDF Download

Initial Concepts
Screen Shot 2021-05-28 at 9.40.35 AM.png

Image 01: The user flows of patients and therapists. After users finish their daily rehabilitation exercises, the movement data will be sent to therapists to make the next training plan for patients.

Screen Shot 2021-05-28 at 9.43.54 AM.png

Image 02: UI Design of the game. The first scene when users enter the game, and users need to push the button to start games.

Mantis_Stretch03.png
Scissors.png
Tiger_claw_excercise.png
KongFuGeture_Chop.JPG.jpg
CraneGesture_Shark_Alligator.JPG.jpg
IMG_0335.JPG.jpg

© 2020 by Shirley Qian

bottom of page