How to handle inconsistent data frame counts within a batch

[leanhson45826-cell]

Thank you for your excellent work!

I noticed that when using the RoboTwin dataset you released for post-training, setting the batch size to greater than 1 results in an error indicating inconsistent frame counts.

I would like to ask how you handle this situation.

Thank you again!

[pangym666]

Have you ever solved this issue? I encounter the same problem this days and have no idea how to deal with it

[liyizhep]

I encountered the same problem. Is there no way to boost the batch size without just relying on gradient accumulation? It feels like the GPU memory isn't being fully utilized.

[255isWhite]

Same questions here.

[armanakbari]

I am also stuck with the same problem. If anyone has solved this, please let us know. Thanks