A temporary folder is created by the OsfContentProvider and deleted when the provider is no longer being used. During deletion, the files in the folder cannot be deleted. The problem was not happening when running the unit tests in debug mode. Perhaps the code that creates the files is not closing them?