For my Final project in CSCE 450, I looked into implementing Mixamo Motion Capture Animation Data onto an SMPL OBJ Model. Specifically, the project focused on properly mapping local rotations from picked bones in the Mixamo rig to the bones in the SMPL rig. 3 different Mixamo files were extracted and tested on the rig to target and understand what type of motions work best in mapping. Image credits to: Ertug Sagman on Medium
As mentioned above, the mapping of certain bones from the Mixamo rig to the SMPL rig was done. The image included here demonstrates each of the bones/joints chosen to map to each respective part. Additionally, the Mixamo Rig chosen was the rig of "Pete" as it had the closest amount of bones and position locations to that of the SMPL model. Then, the generation of the SMPL OBJ's are done based on A3B's tasks. After this, the local translations of the picked joints from the Mixamo Motion Capture Animation Data would be applied as the input animation data that the SMPL model would use. Below are 3 examples of the produced animations on the SMPL model with a comparison of the original Mixamo data. (Note: The SMPL data is moving at a slower frame rate as to show the joint movement.)
Silly Dance:
Salute:
Hurricane Kick (for Fun):
While there are present issues with certain joints not moving as intended (mainly with the arms & legs), other joints are moving in line with the original Mixamo animation. Specifically, the main parent pelvis translation is being applied correctly, as well as, the translations for the hands. Demonstrating that the translation of Mixamo Animation Data can be feasible to apply towards SMPL OBJ models. There needs to be further work over which joints may be better than others to map to; as the root of the movement's issue typically relates to the joint it was mapped to. Additionally, the final presentation video is included below for further reference.
Credits & Sources: 1. Input motion data was downloaded from mixamo.com 2. SMPL Model was downloaded from smpl.is.tue.mpg.de @article{SMPL:2015, author = {Loper, Matthew and Mahmood, Naureen and Romero, Javier and Pons-Moll, Gerard and Black, Michael J.}, title = {{SMPL}: A Skinned Multi-Person Linear Model}, journal = {ACM Trans. Graphics (Proc. SIGGRAPH Asia)}, month = oct, number = {6}, pages = {248:1--248:16}, publisher = {ACM}, volume = {34}, year = {2015} } 3. Boilerplate code was utilized from various CSCE 450 Assignments (A2, fbx-extract, A3B) 4. Made utilizing C++ & OpenGL. 5. Blender for additional viewing of the models/OBJ's.