Skip to content

Add an optional limit to downloaded files  #113

@ju-gu

Description

@ju-gu

User Story
The current implementation of download files (which is already really nice to have) always downloads a whole corpus. Though sometimes one wants to download just a smaller sample of the corpus to do experiments with. Therefore it would be nice to have the option to set a maximum amount of files to download.

Behaviour:
CLI:

deepset-cloud download --limit 100

SDK

download(limit=100) 

to download just a subset of files

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions