Synthface

[seymayucer]

Thank you for sharing your study, Where can we find the Synthface dataset?

[MarekKowalski]

Hi! Unfortunately the synthface dataset is not publicly available at the moment.

[seymayucer]

Thank you,no problem, can you at least give an example of json files to show how you give your labels/parameters of synthetic images?

[MarekKowalski]

You can see an example json file with metadata here.

[seymayucer]

Thank you, I have one more question, How could we calculate bone rotations using openface? Are the given gaze directions in the csv file related to the bone rotation parameters in the json file?

[MarekKowalski]

Unfortunately, I have never used OpenFace's eye gaze estimation, so it's hard for me to comment on this. If OpenFace returns the gaze as angles, then it should be possible to use it to drive ConfigNet's eye gaze, however a conversion might be required, for example if the axes are oriented differently in OpenFace.

[seymayucer]

Would you clarify ConfigNet's eye gaze estimation, so I can convert it. Since Syntface is private, and not enough information about the required supervision for the additional loss term in the first stage training, I am struggling to generate labels. Thank you.

[MarekKowalski]

Not sure if I understand your question. Are you asking about what format the gaze is specified in?
The gaze is specified as euler angles where:

• first angle corresponds to looking up and down
• second angle would correspond to the eye rolling around an axis going through the iris - it does nothing
• third angle corresponds to looking left and right

You can see an example of eye gaze control in the demo. The way the angles are generated is specified in lines 96-114 in basic_ui.py.

Let me know if that helps.

Marek

[uzomac7]

Thank you for sharing your study, Where can we find the Synthface dataset?