Multi-modal Controller for Image Manipulation in the Operating Room

Contact   Mudry Pierre-André
Title   Multi-modal Controller for Image Manipulation in the Operating Room
Author(s)   Sierro A., Mudry P.-A.
References   Posters proceedings of the 24th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision 2016 (WSCG 2016), May 30 - June 3, 2016, Plzeň, Czech Republic, pp. 9-12
Abstract   In the domain of orthopedics, surgeons often rely on radiology images during operations. In this context, manipulating the images displayed on a computer screen is an issue as their hands have to remain sterile. In this article, we present a multi-modal controller (foot and voice) coupled with an existing state-of-the-art radiology display and analysis software used in operating rooms. The controller itself consists of a battery-operated wireless embedded system integrated into a shoe that provides multiple foot pressure-points as well as an absolute orientation sensors. In addition, a wireless microphone is used to acquire voice commands. To demonstrate the validity of our approach, we present a randomized user study conducted on ten subjects that had to perform image manipulation tasks using the controller.
HES-SO Valais-Wallis • Route du Rawyl 47 • CP • 1950 Sion 2
+41 27 606 85 11 • •