File Input/Output is not an issue with small libraries with hundreds of files and local SSD disks.
But when we move to a cluster/supercomputer like mesocentre that becomes an important bottleneck.
Not only reading and writing but our CHECKPOINTS are very I/O demanding. Notice we frequently check if some files exists to contine.
File Input/Output is not an issue with small libraries with hundreds of files and local SSD disks.
But when we move to a cluster/supercomputer like mesocentre that becomes an important bottleneck.
Not only reading and writing but our CHECKPOINTS are very I/O demanding. Notice we frequently check if some files exists to contine.