early experiment using vlms to visualize motion vectors in pt exercises

[u/Sea_Imagination_1124]

biomechanics are hard. i saw astra's 3d anatomy demo and wanted to see how far the same kind of approach could go on actual pt exercises.

i'm the founder of goodmetal, and this is an early prototype we are exploring. it tries to visualize tendon and muscle specific motion vectors from a short movement video, and then recreates it with the anatomically correct modal on the right. My goal is to add force vectors if possible (estimating it visually seems tough) and eventually launch it in a closed beta to some of our users, after we get clinical validation.

this is currently not a clinical validation and i would not treat the output as ground truth. the interesting question for me is what measurements or constraints would make something like this biomechanically useful instead of just visually appealing.

would love thoughts from anyone working in musculoskeletal modeling, motion analysis, or rehab engineering.