Unable to run on Sentinel-1

[mortewle]

I get error messages when running openeo on Sentinel-1 data. I loop through a grid of 5000x5000 meter cells covering Norway, and download the processed data. Similar code runs fine on Sentinel-2 data, with the same spatial and temporal extents.

openeo version: 0.47.0

Code to reproduce:

import openeo
from shapely.wkt import loads

connection = openeo.connect("https://openeo.dataspace.copernicus.eu").authenticate_oidc()

bbox = loads(
    "POLYGON ((4.531758045514695 60.97213579571653, 4.622608305523141 60.97923698443944, 4.6080328573096505 61.02339093710543, 4.517060710670594 61.016276895844896, 4.531758045514695 60.97213579571653))"
)
cubes = []
for year in range(2017, 2025):
    cube = connection.load_collection(
        collection_id="SENTINEL1_GRD",
        temporal_extent=[f"{year}-06-01", f"{year}-08-31"],
        spatial_extent=bbox,
        bands=["VV", "VH"],
        properties=[
            openeo.collection_property("sat:orbit_state") == "DESCENDING",
        ],
    )
    cubes.append(cube)

cube = cubes[0]
for cube2 in cubes[1:]:
    cube = cube.merge_cubes(cube2, overlap_resolver="max")
cube = cube.sar_backscatter(coefficient="sigma0-ellipsoid")
cube.download(".../cube.nc")

I get different error messages on the same code, but most often it is the first of the following.

openeo.rest.OpenEoApiError: [500] Internal: Server error: Python exception while evaluating processing graph: FileNotFoundError: [Errno 2] No such file or directory: '/eodata/auxdata/SRTMGL1/dem/N61E004.SRTMGL1.hgt.zip' (ref: r-26021307164041b993b69bf89cf42cb3)

openeo.rest.OpenEoApiError: [500] Internal: Server error: Exception during Spark execution: org.apache.spark.SparkException: Job aborted due to stage failure: A shuffle map stage with indeterminate output was failed and retried. However, Spark cannot rollback the ResultStage 32947 to re-process the input data, and has to fail this job. Please eliminate the indeterminacy by checkpointing the RDD before repartition and try again. (ref: r-2602100759274518a5f510c258342493)

<class 'openeo.rest.OpenEoApiError'>: [500] Internal: Unexpected error during 'load_collection': Exception during Spark execution: org.apache.spark.SparkException: Job 1640 cancelled because SparkContext was shut down. The process had these arguments: {'bands': ['VV', 'VH'], 'id': 'SENTINEL1_GRD', 'properties': {'sat:orbit_state': {'process_graph': {'eq7': {'process_id': 'eq', 'arguments': {'x': {'from_parameter': 'value'}, 'y': 'DESCENDING'}, 'result': True}}}}, 'spatial_extent': {'type': 'Polygon', 'coordinates': [[[4.531758045514695, 60.97213579571653], [4.622608305523141, 60.97923698443944], [4.6080328573096505, 61.02339093710543], [4.517060710670594, 61.016276895844896], [4.531758045514695, 60.97213579571653]]]}, 'temporal_extent': ['2023-06-01', '2023-08-31']}  (ref: r-260209193225424da854fce237054af5)

Full traceback of the first, most common error:

Traceback (most recent call last):
  File "/home/onyxia/work/arealregnskap/src/functions/streaming/s1_openeo.py", line 37, in <module>
    cube.download(out_path)
  File "/home/onyxia/work/arealregnskap/.venv/lib/python3.12/site-packages/openeo/rest/datacube.py", line 2479, in download
    return self._connection.download(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/onyxia/work/arealregnskap/.venv/lib/python3.12/site-packages/openeo/rest/connection.py", line 1719, in download
    response = self.post(
               ^^^^^^^^^^
  File "/home/onyxia/work/arealregnskap/.venv/lib/python3.12/site-packages/openeo/rest/_connection.py", line 232, in post
    return self.request("post", path=path, json=json, allow_redirects=False, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/onyxia/work/arealregnskap/.venv/lib/python3.12/site-packages/openeo/rest/connection.py", line 732, in request
    return _request()
           ^^^^^^^^^^
  File "/home/onyxia/work/arealregnskap/.venv/lib/python3.12/site-packages/openeo/rest/connection.py", line 725, in _request
    return super(Connection, self).request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/onyxia/work/arealregnskap/.venv/lib/python3.12/site-packages/openeo/rest/_connection.py", line 141, in request
    self._raise_api_error(resp)
  File "/home/onyxia/work/arealregnskap/.venv/lib/python3.12/site-packages/openeo/rest/_connection.py", line 163, in _raise_api_error
    raise OpenEoApiError(
openeo.rest.OpenEoApiError: [500] Internal: Server error: Python exception while evaluating processing graph: FileNotFoundError: [Errno 2] No such file or directory: '/eodata/auxdata/SRTMGL1/dem/N61E004.SRTMGL1.hgt.zip' (ref: r-26021307164041b993b69bf89cf42cb3)