Minimum set of parameters needed to reconstruct the mesh?

[Stardust122]

Thank you for the great work — really appreciate it!

I have a question regarding the output dictionary. Among all the fields (e.g., pred_keypoints_3d, pred_vertices, etc.), which ones are absolutely required to fully recover the mesh later? If I save the entire output dict, the files become quite large.

Could you clarify the minimal subset of parameters I need to store so that I can reconstruct the mesh without any loss?

Thanks!

[JinlongYANG]

Hi @Stardust122,

Thank you very much for your interest in our work and SAM3D-Body! Sorry for the late reply. We just recently updated the SAM3D-Body and MHR code base to better answer your question.

In general, if you want to reconstruct an MHR body mesh, you need to store identity_coeffs, model_parameters, and face_expr_coeffs as indicated in the forward function of MHR.

Yet specifically to your question, what fields from SAM3D-Body outputs are needed to reconstruct the MHR meshes, you need:

1. "mhr_model_params" (which is "model_parameters" in MHR.forward()),
2. "shape_params" (which is "identity_coeffs" in MHR.forward()),
3. "expr_params" (which is "face_expr_coeffs" in MHR.forward()),
4. "pred_vertices" (which is global translation considering the camera frame coordinate).
   There is a newly added method in the MHR/tools/mhr_smpl_conversion/conversion.py Conversion.convert_sam3d_output_to_smpl() to convert the above information into SMPL(X) meshes. You can of course stop at line 512 to obtain the MHR meshes.