Predicting finger joint angle using ultrasound images of the forearm - Robotics Institute Carnegie Mellon University

Predicting finger joint angle using ultrasound images of the forearm

Michael Gidaro, Linghai Wang, Roberta L. Klatzky, and George Stetten
Tech. Report, CMU-RI-TR-23-30, July, 2023

Abstract

Identifying the pose of fingers is used for basic research on the human hand and analyzing dexterous movements. Joint angles can be extracted from instrumented gloves or by tracking markers with video cameras. Such methods are cumbersome, however, and can even impede complex manipulatory tasks as in surgery. We propose a novel solution, using ultrasound images of the muscles in the forearm to determine finger pose. We calibrate its use for monitoring the contraction and relaxation of the flexor digitorum superficialis muscles in the index finger, relative to marker-based tracking, and demonstrate machine classification of finger angle from ultrasound.

Notes
Video available at http://www.vialab.org/main/Images/Movies/CNN_output_unfiltered_29Hz_short.mov

BibTeX

@techreport{Michael Gidaro-2023-136839,
author = {Michael Gidaro and Linghai Wang and Roberta L. Klatzky and George Stetten},
title = {Predicting finger joint angle using ultrasound images of the forearm},
year = {2023},
month = {July},
institute = {Carnegie Mellon University},
address = {Pittsburgh, PA},
number = {CMU-RI-TR-23-30},
keywords = {hand, finger, joint angle, manipulation, ultrasound, forearm, machine learning},
}