Sonic FlashlightTM - Robotics Institute Carnegie Mellon University
Graphical depiction of the Sonic FlashlightTM project
Sonic FlashlightTM
Project Head: George D. Stetten

VIA Lab website.

Our objective is to permit in situ visualization of ultrasound images so that direct hand-eye coordination can be employed during invasive procedures. A method is presented that merges the visual outer surface of a patient with a simultaneous ultrasound scan of the patient’s interior. The method combines a flat-panel monitor with a half-silvered mirror such that the image on the monitor is reflected precisely at the proper location within the patient. The ultrasound image is superimposed in real time on the patient merging with the operator’s hands and any invasive tools in the field of view. Instead of looking away from the patient at an ultrasound monitor, the operator sees through skin and underlying tissue as if it were translucent.

Two working prototypes have been constructed, demonstrating independence of viewer location and requiring no special apparatus to be worn by the operator. The method could enable needles and scalpels to be manipulated with direct hand-eye coordination under ultrasound guidance. Invasive tools would be visible up to where they enter the skin, permitting natural visual extrapolation into the ultrasound slice. Biopsy needles would no longer be restricted to lie in the plane of the ultrasound scan, but could instead intersect it. These advances could lead to increased safety, ease, and reliability in certain invasive procedures.

You may peruse the complete list of Sonic FlashlightTM publications at the official Sonic FlashlightTM website under the “our Publications” section.

The Sonic FlashlightTM is patented under U.S. No. 6,599,247.

Displaying 31 Publications

2007
Bing Wu, Roberta Klatzky, Damion Michael Shelton, and George D. Stetten
Conference Paper, Proceedings of Vision Sciences Society Meeting, May, 2007
David C. Wang, N.B. Amesur, Roberta Klatzky, A. Bayless, B. Mandella, C. Banks, Gaurav Shukla, and George D. Stetten
Conference Paper, Proceedings of Clinical and Translational Science Day, May, 2007
Damion Michael Shelton, Bing Wu, Roberta Klatzky, and George D. Stetten
Conference Paper, Proceedings of 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI '07), pp. 956 - 959, April, 2007
PhD Thesis, Tech. Report, CMU-RI-TR-07-14, Robotics Institute, Carnegie Mellon University, March, 2007
2006
David C. Wang, Roberta Klatzky, N. Amesur, and George D. Stetten
Conference Paper, Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '06), pp. 654 - 661, October, 2006
Bing Wu, Roberta Klatzky, Damion Michael Shelton, and George D. Stetten
Journal Article, Journal of Vision: Vision Sciences Society Meeting abstract, Vol. 6, No. 6, June, 2006
Samuel Clanton, David C. Wang, V. Chib, Yoky Matsuoka, and George D. Stetten
Journal Article, IEEE Transactions on Visualization and Computer Graphics, Vol. 12, No. 2, pp. 277 - 285, March, 2006
2005
Wilson Chang, N. Amesur, David C. Wang, A. Zajko, and George D. Stetten
Conference Paper, Proceedings of Radiological Society of North America Scientific Assembly and Annual Meeting, November, 2005
Bing Wu, Roberta Klatzky, Damion Michael Shelton, and George D. Stetten
Journal Article, IEEE Transactions on Visualization and Computer Graphics: Special Issue on Haptics, Virtual and Augmented Reality, Vol. 11, No. 6, pp. 684 - 693, November, 2005
David C. Wang, Bing Wu, and George D. Stetten
Conference Paper, Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '05), pp. 647 - 653, October, 2005

current head

current contact

past staff

  • Wilson Chang
  • Roberta Klatzky
  • Gaurav Shukla
  • David C Wang
  • Bing Wu