Attempting to fetch too many images from the archive leads to an error

[LTDakin]

Recreate: try to do a median operation with 100s of inputs, need to think of a way to process operations that need all input at once/better manage operations that only need one input at a time

[2024-10-04 19:00:52,507] [PID 97990] [Thread-4] [root] [INFO] Executing stacking operation on 13 files
[2024-10-04 19:06:09,689] [PID 97990] [Thread-4] [root] [ERROR] <urlopen error retrieval incomplete: got only 39927378 out of 67115520 bytes>
Traceback (most recent call last):
  File "/Users/ldakin/Desktop/PTR_dev/ptr_datalab/datalab/datalab_session/tasks.py", line 23, in execute_data_operation
    operation_class(input_data).operate()
  File "/Users/ldakin/Desktop/PTR_dev/ptr_datalab/datalab/datalab_session/data_operations/stacking.py", line 52, in operate
    image_data_list = self.get_fits_npdata(input_files)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ldakin/Desktop/PTR_dev/ptr_datalab/datalab/datalab_session/data_operations/data_operation.py", line 109, in get_fits_npdata
    fits_path = get_fits(file_info['basename'], file_info['source'])
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ldakin/Desktop/PTR_dev/ptr_datalab/datalab/datalab_session/s3_utils.py", line 138, in get_fits
    urllib.request.urlretrieve(fits_url, basename_file_path)
  File "/opt/homebrew/Cellar/python@3.11/3.11.9_1/Frameworks/Python.framework/Versions/3.11/lib/python3.11/urllib/request.py", line 280, in urlretrieve
    raise ContentTooShortError(
urllib.error.ContentTooShortError: <urlopen error retrieval incomplete: got only 39927378 out of 67115520 bytes>