Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images
- 1School of Industrial Engineering, Purdue University, West Lafayette, Indiana, USA
- 2Departments of Basic Medical Sciences and Veterinary Clinical Sciences, College of Veterinary Medicine, Purdue University, West Lafayette, Indiana, USA
- Correspondence to Dr Juan Pablo Wachs, School of Industrial Engineering, Purdue University, 315 N Grant Street, West Lafayette, IN 47907, USA; jpwachs{at}purdue.edu
- Received 13 July 2012
- Revised 3 September 2012
- Accepted 21 November 2012
- Published Online First 18 December 2012
Abstract
This paper presents a method to improve the navigation and manipulation of radiological images through a sterile hand gesture recognition interface based on attentional contextual cues. Computer vision algorithms were developed to extract intention and attention cues from the surgeon's behavior and combine them with sensory data from a commodity depth camera. The developed interface was tested in a usability experiment to assess the effectiveness of the new interface. An image navigation and manipulation task was performed, and the gesture recognition accuracy, false positives and task completion times were computed to evaluate system performance. Experimental results show that gesture interaction and surgeon behavior analysis can be used to accurately navigate, manipulate and access MRI images, and therefore this modality could replace the use of keyboard and mice-based interfaces.
