top of page

Virtual Reality (VR): Speech Therapy

VRbal is a virtual reality (VR) speech therapy app that uses AI and machine learning (ML) to help stutter patients practice speech and overcome anxiety.

vrbal 9 seconds.gif
<My Role>

In a team of 5, my main role was the Instructional Designer and UX Designer. I also actively participated in the end-to-end product development cycle as a UX Researcher, which included conducting generative research, prototype design, and usability testing.

<Achievements>

  • Microsoft Imagine Cup, US National Finalist

  • Adobe Design Achievement Awards, Semi-Finalist

  • Verizon Connected Futures III, Fellowship Award

<Project Background>

I worked with UX designers and engineers from NYU, SVA and Parsons in 2018 to design a VR experience that uses artificial intelligence to help stutter patients overcome social anxiety through exposure therapy techniques. We were awarded the Verizon Connected Futures III fellowship, selected as one of the twelve finalists of the US Microsoft Imagine Cup 2018, named as Semifinalist for Social Impact of the Adobe Design Achievement Awards in 2018, and received the Iron Award as part of the A’ Design and Award Competition in 2019.

My Design Process

*Below is a summary of the full product development cycle I project managed.

Step 1: Identify "The Problem & Target Audience"

VR Problem Background.001.jpeg
IMG_0880.jpg

Stuttering is an incurable communication disorder, but symptoms can be alleviated through exposure therapy and pretend-play (Applied Behavior Analysis) with speech language pathologists. 

 

However, each therapy sessions are not easily accessible and affordable.

Step 2: Ideation

<Concept>

With the combination of VR, AI and speech therapy, stutter patients are put in a safe environment to rehearse speech therapy exercises and to practice job interviews in a 360 degree simulation scene.

TECHNOLOGY & METHODOLOGY

IMG_0843.PNG
IMG_0844.jpg

ASSOCIATED LEARNING THEORIES

IMG_0845.jpg
IMG_0849.jpg

<General User Flow>

IMG_0850.jpg
IMG_0851.jpg
IMG_0852.jpg
VR Storyboard.001.jpeg
VR Sample Frames.001.jpeg

Step 3: Design Development

<VR Storyboard>

<Sample Frames of Different Scenes>

VR AI Flow.001.jpeg

<AI Training Process Flow>

Step 4: Prototype Development

<Prototype 1>

IMG_0875.jpg

<Prototype 2>

vrbal gif.gif

Step 5: Prototype User Test

Developed prototypes were tested with members of the National Stuttering Association, Chapter in New York.

IMG_0846.jpg
IMG_0848.jpg

Step 6: Revise User Flow

The user flow was revised based on feedback received from the usability testing study.

VR User Flow.001.jpeg
bottom of page