Skip to content

Optimise dataframe_to_mds for Large-Scale Datasets via intermediate Aggressive Disk Cleanup and Distributed Metadata Handling#971

Open
AbhishekKumarSingh wants to merge 1 commit intomosaicml:mainfrom
AbhishekKumarSingh:converter_fix
Open

Optimise dataframe_to_mds for Large-Scale Datasets via intermediate Aggressive Disk Cleanup and Distributed Metadata Handling#971
AbhishekKumarSingh wants to merge 1 commit intomosaicml:mainfrom
AbhishekKumarSingh:converter_fix

Commits