Predicting finger joint angle using ultrasound images of the forearm
Tech. Report, CMU-RI-TR-23-30, July, 2023
Abstract
Identifying the pose of fingers is used for basic research on the human hand and analyzing dexterous movements. Joint angles can be extracted from instrumented gloves or by tracking markers with video cameras. Such methods are cumbersome, however, and can even impede complex manipulatory tasks as in surgery. We propose a novel solution, using ultrasound images of the muscles in the forearm to determine finger pose. We calibrate its use for monitoring the contraction and relaxation of the flexor digitorum superficialis muscles in the index finger, relative to marker-based tracking, and demonstrate machine classification of finger angle from ultrasound.
Notes
Video available at http://www.vialab.org/main/Images/Movies/CNN_output_unfiltered_29Hz_short.mov
Video available at http://www.vialab.org/main/Images/Movies/CNN_output_unfiltered_29Hz_short.mov
BibTeX
@techreport{Michael Gidaro-2023-136839,author = {Michael Gidaro and Linghai Wang and Roberta L. Klatzky and George Stetten},
title = {Predicting finger joint angle using ultrasound images of the forearm},
year = {2023},
month = {July},
institute = {Carnegie Mellon University},
address = {Pittsburgh, PA},
number = {CMU-RI-TR-23-30},
keywords = {hand, finger, joint angle, manipulation, ultrasound, forearm, machine learning},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.