Vis

AR

Exciting Problem to Solve

VisAR is an augmented reality surgical navigation system that increases surgical accuracy and confidence. Think of it like a surgical GPS, VisAR enables physicians to find and reach their target destination more quickly.

As the UX/UI Designer, I needed to create a virtual menu where limited use of the user's hands would be involved after getting started. Without UI augmented reality (AR) standards set in stone, quite a bit of usability testing was needed...especially in a surgical setting.

Research & Discovery

I started off by doing some research and looked into Google, Apple, Microsoft, and other gaming companies. I decided to become certified and took Google's Introduction to Augmented Reality and ARCore.

Understanding the User

Personas

User Interviews

I interviewed surgeons to determine what their flows would be like for general surgery, how the information should be catalogued, and how they would prefer the information presented back to them (hearing vs. seeing).

Truly trying to understand the level of precision and focus with a new way to possible save a life.

Understanding the Problem

Information Architecture

Using the feedback from the interviews I started to document menu levels and followed up with additional interviews for accuracy.

Commands

Discovering that voice commands would be the primary function to navigate through the menu (during surgery), we compiled and fine tuned commands that were reviewed and ultimately changed the menu architecture.

Ideation & Design

Starting with crazy 8s and sketches, I worked with the team to narrow down ideas to create wireframes. Once we decided on a concept, I kicked off the style guide. When designing for augmented reality in a surgical room, it's important to consider the lighting (dark with very bright surgical lights) and how this will interact with the interface. The color scheme and typography were chosen carefully through internal testing to ensure that it complements the AR experience without overwhelming it.

Brainstorming & Inspiration

Brainstorm / Crazy 8s
Sketches
Wireframes
Hi Fidelity Mockup
Prototype
Worked with development to fine tune prior to cadaver labs

Wireframes

I worked with the product manager and subject matter experts on a voice command document and we categorized and made further edits to the information architecture. This was essential to creating the menu to determine how deep (parent/child) the architecture needed to go.

After multiple iterations, I received sign off and moved forward with high-fidelity mockups and prototypes. My design decisions were based on extensive research within AR and presenting to internal stakeholders (surgeons within Novarad) to ensure the possible user experience would be intuitive and easy to use.

I worked with the development team to get the VisAR menu (along with other features) to a point of production. Surgeons from across the United States were brought in to our recurring cadaver labs where we could conduct usability tests. I watched and recorded our successes and where the surgeons struggled.

Prototype

This prototype was used internally to show expected behaviors and discuss UI capabilities with development and stakeholders.

I worked with the development team and tested out the UI with the HoloLens glasses in surgical lighting - from there I kept iterating until we got it ready for cadaver labs.

Usability Testing

Through recurring cadaver labs, I conducted usability tests with surgeons. I watched and recorded where their struggles were with cognitive load, where they had assumptions, where key information was missing.

Lessons Learned

Having the ability to view iterations through the HoloLens in a surgical setting was a game changer, the UI and typography needed thick, light colored borders/thickness to easily be viewed.

With every usability test, our knowledge grew exponentially. What we did learn is that the new AR technology isn't easy to adopt for seasoned surgeons. Starting with tutorials is a must. Learning the voice commands and adding a search function was necessary until muscle memory was established. Audible feedback was a feature to be discussed and possibly added as MVP.