Visician VR Controllers

team

solo project
IDSA IDEA 2024

role

designer
developer

timeline

spring 2024
10 weeks

tools

autodesk maya
3D printing

Visician VR controllers reimagine the physical affordances of how users perform virtual procedures by emulating real-world tools for greater precision.

Background

Augmented and Virtual Reality are relatively new and fast-growing categories of immersive technology. Aside from gaming, their primary use is in education. This project explores how VR could impact medicine, a field reliant on extensive hands-on training and known for having extensive and complex education requirements.

Research

Research included scholarly articles, interviews with medical students and VR designers, and internship experience at Ghost Productions Medical Animation & VR Surgery.

Educational simulations are the second biggest application of VR behind gaming. VR surgery simulations in particular make up a large portion of that category. Currently, leading VR surgery companies like Ghost Productions use a combination of hand-tracking and household VR controllers like the Oculus Quest. While hand-tracking is becoming increasingly accurate and efficient, it cannot replicate the feeling of a tool in one’s hand, and bulky handheld devices with trigger-like controls are not conducive to an accurate simulation.

Digital tools that closely resemble their analog counterparts play a huge difference in tasks that require precision and manual dexterity, like art and design—and medicine.

An example of how this issue has been addressed in the art and design category is the development of stylus pen tools, for both a 2D screen (Wacom, Huion, Apple Pencil) and 3D VR space (Logitech VR Ink Pilot).

Problem

Medical students feel underprepared with the amount of practice they receive. Physical demonstrations of procedures have major limitations:

  • Cost: Cadavers, lab space and equipment, opportunity cost of practicing on real machines, and instructors cost money.
  • Accessibility: Demos occur at scheduled times and locations. Students cannot repeat demos to their own liking.
  • Accuracy: Practice scenarios feel unrealistic or lack nuance.
  • Diversity: Using a "default" patient makes it hard to prepare for different pathologies.

Simulating procedures in VR can alleviate many of these issues. However, the VR industry currently lacks physical affordances designed for accurate medical education.

Goals

Emulate the feeling of handheld medical instruments in VR controller design

Improve accuracy in VR simulations to increase its value to medical education

Make users more confident, experienced, and skilled healthcare professionals

Concept

To address this gap, I envisioned a concept for a set of VR controllers that would correspond to the main structural categories of surgical tools.

01 Stylus

  • Scalpel
  • Electrocautery pen
  • Curette
  • Syringe

02 Hinged

  • Cutters
  • Forceps
  • Axial laparospic handle

03 Ringed

  • Scissors
  • Clamps
  • Shank laparoscopic handle

The controllers are designed with the ergonomics of different ways each tool can be held. For example, the button on the stylus tool can be pressed with either the thumb in a scapel pencil grip or the index finger in a scalpel palm grip. The top button can be pressed like a syringe. The hinge tool can be held like tweezers, or reversed like an axial laparoscopic handle. The controllers have slanted top surfaces to contain the IR lights for a VR headset to read easily at multiple angles.

Prototyping

I created physical prototypes iteratively and made adjustments to the design after each one, focusing first on ergonomics and then on VR capabilities.

Version 1: Foam

Version 2: Wire and Clay

Production

I adjusted my design to include a third controller, then 3D modeled my final designs in Autodesk Maya for production.

The controllers were printed in white PLA. I encountered difficulties printing a living hinge with enough tension for the hinge controller, so I printed it as separate pieces which I then connected with a coiled 18-gauge wire coated in white foam clay.

Demi Hu © 2024