".ExternalAerodynamicsDatasetValidator" locating error

[kk98kk]

I wanted to preprocess the DrivAerML dataset for the DOMINO Architekture and by running the configured code but I only get this error:
Error locating target 'examples.external_aerodynamics.dataset_validator.ExternalAerodynamicsDatasetValidator', set env var HYDRA_FULL_ERROR=1 to see chained exception. full_key: etl.validator

[saikrishnanc-nv]

Hi @kk98kk - Did you export the PYTHONPATH to include the examples directory? Instructions are available here:
https://github.com/NVIDIA/physicsnemo-curator/blob/main/examples/external_aerodynamics/README.md#running-the-curator. Also pasting the command here for easy reference. If you did do that and you're still seeing this, can you share the full printed log? It should show me the config as well, so it'll be easier to debug.

export PYTHONPATH=$PYTHONPATH:examples &&
physicsnemo-curator-etl                         \
    --config-dir=examples/config                \
    --config-name=external_aero_etl_drivaerml   \
    etl.source.input_dir=/data/drivaerml/       \
    etl.sink.output_dir=/data/drivaerml.processed.surface \
    etl.common.model_type=surface

[kk98kk]

Thats´s my script I am using (it worked finde with the previous version by the way):

set -euo pipefail

CONFIG_DIR="/work/u33l96/project/physicsnemo-curator/examples/config"
EXAMPLES_DIR="/work/u33l96/project/physicsnemo-curator/examples"

INPUT_DIR="/proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML"
OUTPUT_DIR="/proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML.processed.surface2"

export PYTHONPATH="${PYTHONPATH:-}:${EXAMPLES_DIR}" 

physicsnemo-curator-etl                         \
    --config-dir="${CONFIG_DIR}"              \
    --config-name=external_aero_etl_drivaerml   \
    etl.source.input_dir="${INPUT_DIR}"       \
    etl.sink.output_dir="${OUTPUT_DIR}"       \
    etl.common.model_type=surface         \
    serialization_format=numpy  \ 

and the error I get:

[2025-10-19 11:13:17,136][physicsnemo_curator.utils.utils][INFO] - Starting ETL pipeline
[2025-10-19 11:13:17,139][physicsnemo_curator.utils.utils][INFO] - Config summary:
etl:
  common:
    kind: drivaerml
    model_type: surface
  processing:
    args: {}
    num_processes: 12
  sink:
    _convert_: all
    _target_: examples.external_aerodynamics.data_sources.ExternalAerodynamicsDataSource
    kind: ${etl.common.kind}
    output_dir: /proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML.processed.surface2
    overwrite_existing: true
    serialization_method: ${serialization_format.serialization_method}
  source:
    _convert_: all
    _target_: examples.external_aerodynamics.data_sources.ExternalAerodynamicsDataSource
    input_dir: /proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML
    kind: ${etl.common.kind}
    model_type: ${etl.common.model_type}
  transformations:
    stl_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsSTLTransformation
      geometry_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_geometry_data_processors.update_geometry_data_to_float32
    surface_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsSurfaceTransformation
      surface_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.decimate_mesh
        algo: decimate_pro
        preserve_topology: false
        reduction: 0.0
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.normalize_surface_normals
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.non_dimensionalize_surface_fields
        air_density: 1.205
        stream_velocity: 30.0
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.update_surface_data_to_float32
      surface_variables:
        pMeanTrim: scalar
        wallShearStressMeanTrim: vector
    volume_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsVolumeTransformation
      volume_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.non_dimensionalize_volume_fields
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.update_volume_data_to_float32
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.shuffle_volume_data
      volume_variables:
        UMeanTrim: vector
        nutMeanTrim: scalar
        pMeanTrim: scalar
    write_ready_transformation: ${override_transformations.write_ready_transformation}
  validator:
    _convert_: all
    _target_: examples.external_aerodynamics.dataset_validator.ExternalAerodynamicsDatasetValidator
    validation_level: fields
override_transformations:
  write_ready_transformation:
    _convert_: all
    _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsNumpyTransformation
serialization_format:
  serialization_method: numpy

Error executing job with overrides: ['etl.source.input_dir=/proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML', 'etl.sink.output_dir=/proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML.processed.surface2', 'etl.common.model_type=surface', 'serialization_format=numpy']
Error locating target 'examples.external_aerodynamics.dataset_validator.ExternalAerodynamicsDatasetValidator', set env var HYDRA_FULL_ERROR=1 to see chained exception.
full_key: etl.validator

Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.

[saikrishnanc-nv]

Hi @kk98kk - Sorry what do you mean by this? What version worked fine?

it worked finde with the previous version by the way

As far as I can tell, your config/environment looks okay to me.
I'm assuming you're running it inside a Docker container/venv?
The only suggestion I have is to also do this in your script: export HYDRA_FULL_ERROR=1

[kk98kk]

I was using the latest version from September 18th, 2025 (I cloned the repo on that date) and I'm running it inside a conda environment.

My full log looks like this:

[2025-10-29 14:01:22,938][physicsnemo_curator.utils.utils][INFO] - Starting ETL pipeline
[2025-10-29 14:01:22,941][physicsnemo_curator.utils.utils][INFO] - Config summary:
etl:
  common:
    kind: drivaerml
    model_type: surface
  processing:
    args: {}
    num_processes: 12
  sink:
    _convert_: all
    _target_: examples.external_aerodynamics.data_sources.ExternalAerodynamicsDataSource
    kind: ${etl.common.kind}
    output_dir: /proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML.processed.surface2
    overwrite_existing: true
    serialization_method: ${serialization_format.serialization_method}
  source:
    _convert_: all
    _target_: examples.external_aerodynamics.data_sources.ExternalAerodynamicsDataSource
    input_dir: /proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML
    kind: ${etl.common.kind}
    model_type: ${etl.common.model_type}
  transformations:
    stl_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsSTLTransformation
      geometry_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_geometry_data_processors.update_geometry_data_to_float32
    surface_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsSurfaceTransformation
      surface_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.decimate_mesh
        algo: decimate_pro
        preserve_topology: false
        reduction: 0.0
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.normalize_surface_normals
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.non_dimensionalize_surface_fields
        air_density: 1.205
        stream_velocity: 30.0
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.update_surface_data_to_float32
      surface_variables:
        pMeanTrim: scalar
        wallShearStressMeanTrim: vector
    volume_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsVolumeTransformation
      volume_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.non_dimensionalize_volume_fields
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.update_volume_data_to_float32
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.shuffle_volume_data
      volume_variables:
        UMeanTrim: vector
        nutMeanTrim: scalar
        pMeanTrim: scalar
    write_ready_transformation: ${override_transformations.write_ready_transformation}
  validator:
    _convert_: all
    _target_: examples.external_aerodynamics.dataset_validator.ExternalAerodynamicsDatasetValidator
    validation_level: fields
override_transformations:
  write_ready_transformation:
    _convert_: all
    _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsNumpyTransformation
serialization_format:
  serialization_method: numpy

Error executing job with overrides: ['etl.source.input_dir=/proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML', 'etl.sink.output_dir=/proj/u33l96/DAC8001/2804-data_science_and_machine_/v02-Deep_Learning_in_CFD_Simulation/j00-Data/DrivAerML.processed.surface2', 'etl.common.model_type=surface', 'serialization_format=numpy']
Traceback (most recent call last):
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/utils.py", line 635, in _locate
    obj = import_module(part0)
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'examples'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 134, in _resolve_target
    target = _locate(target)
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/utils.py", line 637, in _locate
    raise ImportError(
ImportError: Error loading 'examples.external_aerodynamics.dataset_validator.ExternalAerodynamicsDatasetValidator':
ModuleNotFoundError("No module named 'examples'")
Are you sure that module 'examples' is installed?

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/work/u33l96/miniforge3/envs/curatorV2/bin/physicsnemo-curator-etl", line 7, in <module>
    sys.exit(run_etl.main())
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/main.py", line 94, in decorated_main
    _run_hydra(
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/utils.py", line 394, in _run_hydra
    _run_app(
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/utils.py", line 457, in _run_app
    run_and_report(
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/utils.py", line 223, in run_and_report
    raise ex
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/utils.py", line 220, in run_and_report
    return func()
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/utils.py", line 458, in <lambda>
    lambda: hydra.run(
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/hydra.py", line 132, in run
    _ = ret.return_value
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/core/utils.py", line 260, in return_value
    raise self._return_value
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/core/utils.py", line 186, in run_job
    ret.return_value = task_function(task_cfg)
  File "/work/u33l96/project/physicsnemo-curator/physicsnemo_curator/run_etl.py", line 62, in main
    validator = instantiate(
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 226, in instantiate
    return instantiate_node(
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 333, in instantiate_node
    _target_ = _resolve_target(node.get(_Keys.TARGET), full_key)
  File "/work/u33l96/miniforge3/envs/curatorV2/lib/python3.10/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 139, in _resolve_target
    raise InstantiationException(msg) from e
hydra.errors.InstantiationException: Error locating target 'examples.external_aerodynamics.dataset_validator.ExternalAerodynamicsDatasetValidator', set env var HYDRA_FULL_ERROR=1 to see chained exception.
full_key: etl.validator

Let me know if you need any more informations.

[saikrishnanc-nv]

@kk98kk This is very strange, and I'm not able to repro this locally. I ran your exact command on the latest pull, and it is working for me.
The only differences are that I ran it in the PhysicsNeMo:25.08 docker container (docker pull nvcr.io/nvidia/physicsnemo/physicsnemo:25.06), and my paths are different of course.

Just sanity checking this - Are your paths valid? I see that you're setting them in your script, but are there any issues in the paths?

[kk98kk]

Interesting. My paths should be correct.
I also tried updating to the latest version, but I get the same error.

[kk98kk]

Forget it. This was an user handling error. Your code works fine.

But I am missing some values in my .zattrs-Files and .zarray-Files (e.g. air_density = null instead of 1.0 and so on). Is this also an user handling error? Here is e.g my complete .zattrs-file :

{
    "air_density": null,
    "dataset_type": "combined",
    "decimation_algo": null,
    "decimation_reduction": null,
    "filename": "run_1",
    "num_faces": 2259702,
    "num_points": 376531,
    "stream_velocity": null,
    "x_bound": [
        -0.7651960253715515,
        3.9384799003601074
    ],
    "y_bound": [
        -1.0102499723434448,
        1.0102499723434448
    ],
    "z_bound": [
        -0.31964099407196045,
        1.1951099634170532
    ]
}

And the log from the currator:

[2025-11-18 08:25:21,890][physicsnemo_curator.utils.utils][INFO] - Starting ETL pipeline
[2025-11-18 08:25:21,892][physicsnemo_curator.utils.utils][INFO] - Config summary:
etl:
  common:
    kind: drivaerml
    model_type: combined
  processing:
    args: {}
    num_processes: 12
  sink:
    _convert_: all
    _target_: examples.external_aerodynamics.data_sources.ExternalAerodynamicsDataSource
    kind: ${etl.common.kind}
    output_dir: /j00-Data/DrivAerML.processed.zarrV2
    overwrite_existing: true
    serialization_method: ${serialization_format.serialization_method}
  source:
    _convert_: all
    _target_: examples.external_aerodynamics.data_sources.ExternalAerodynamicsDataSource
    input_dir: /j00-Data/DrivAerML
    kind: ${etl.common.kind}
    model_type: ${etl.common.model_type}
  transformations:
    stl_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsSTLTransformation
      geometry_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_geometry_data_processors.update_geometry_data_to_float32
    surface_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsSurfaceTransformation
      surface_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.decimate_mesh
        algo: decimate_pro
        preserve_topology: false
        reduction: 0.0
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.normalize_surface_normals
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.non_dimensionalize_surface_fields
        air_density: 1.0
        stream_velocity: 38.889
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.update_surface_data_to_float32
      surface_variables:
        pMeanTrim: scalar
        wallShearStressMeanTrim: vector
    volume_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsVolumeTransformation
      volume_processors:
      - _partial_: true
  _target_: examples.external_aerodynamics.external_aero_volume_data_processors.non_dimensionalize_volume_fields
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.update_volume_data_to_float32
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.shuffle_volume_data
      volume_variables:
        UMeanTrim: vector
        nutMeanTrim: scalar
        pMeanTrim: scalar
    write_ready_transformation: ${override_transformations.write_ready_transformation}
  validator:
    _convert_: all
    _target_: examples.external_aerodynamics.dataset_validator.ExternalAerodynamicsDatasetValidator
    validation_level: fields
override_transformations:
  write_ready_transformation:
    _convert_: all
    _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsZarrTransformation
    chunk_size_mb: 1.0
    compression_level: 5
    compression_method: zstd
serialization_format:
  serialization_method: zarr

[2025-11-18 08:25:22,233][ExternalAerodynamicsDatasetValidator][INFO] - Starting External Aerodynamics dataset validation (level: fields)
[2025-11-18 08:25:22,337][ExternalAerodynamicsDatasetValidator][INFO] - Found 484 case directories to validate
[2025-11-18 08:25:24,998][ExternalAerodynamicsDatasetValidator][INFO] - Validation completed successfully
[2025-11-18 08:25:25,077][examples.external_aerodynamics.data_transformations][INFO] - Initializing ExternalAerodynamicsSurfaceTransformation with surface_variables: {'pMeanTrim': 'scalar', 'wallShearStressMeanTrim': 'vector'} and surface_processors: [functools.partial(<function decimate_mesh at 0x14683a6f71a0>, algo='decimate_pro', reduction=0.0, preserve_topology=False), functools.partial(<function normalize_surface_normals at 0x14683a6f6f20>), functools.partial(<function non_dimensionalize_surface_fields at 0x14683a6f6fc0>, air_density=1.0, stream_velocity=38.889), functools.partial(<function update_surface_data_to_float32 at 0x14683a6f7060>)]
[2025-11-18 08:25:25,077][examples.external_aerodynamics.data_transformations][INFO] - This will only be processed if the model_type is surface/combined.
[2025-11-18 08:25:25,078][examples.external_aerodynamics.data_transformations][INFO] - Initializing ExternalAerodynamicsVolumeTransformation with volume_variables: {'UMeanTrim': 'vector', 'pMeanTrim': 'scalar', 'nutMeanTrim': 'scalar'} and volume_processors: [functools.partial(<function non_dimensionalize_volume_fields at 0x14683a6f74c0>), functools.partial(<function update_volume_data_to_float32 at 0x14683a6f7560>), functools.partial(<function shuffle_volume_data at 0x14683a6f76a0>)]
[2025-11-18 08:25:25,078][examples.external_aerodynamics.data_transformations][INFO] - This will only be processed if the model_type is volume/combined.
Processing files:   0%|                                                                                                                                                                  | 0/484 [00:00<?, ?file/s]2025-11-18 08:25:25 - Process 2085630 - INFO - Worker 8 starting
2025-11-18 08:25:25 - Process 2085614 - INFO - Worker 0 starting
2025-11-18 08:25:25 - Process 2085621 - INFO - Worker 4 starting
2025-11-18 08:25:25 - Process 2085617 - INFO - Worker 2 starting
2025-11-18 08:25:25 - Process 2085620 - INFO - Worker 3 starting
2025-11-18 08:25:25 - Process 2085627 - INFO - Worker 7 starting
2025-11-18 08:25:25 - Process 2085615 - INFO - Worker 1 starting
2025-11-18 08:25:25 - Process 2085632 - INFO - Worker 9 starting
2025-11-18 08:25:25 - Process 2085634 - INFO - Worker 10 starting
2025-11-18 08:25:25 - Process 2085626 - INFO - Worker 6 starting
2025-11-18 08:25:25 - Process 2085624 - INFO - Worker 5 starting
2025-11-18 08:25:25 - Process 2085636 - INFO - Worker 11 starting
Processing files:   0%|                                              

``

[saikrishnanc-nv]

@kk98kk Good catch, this was a bug on our end. I merged a new PR: #37.
Can you please try again?

[kk98kk]

Thanks.
I tried again and this didn’t fully fix the issue. Values for stream_velocity and air_density are now present, but they are still incorrect (see curator log).
The correct values should be stream_velocity: 38.889 and air_density: 1.0, as shown in the log.

Additionally, the fields decimation_algo and decimation_reduction still show null, as do the entries under filters. I'm not entirely sure whether the field filters is supposed to contain values, but I wanted to mention it in case this is also unexpected.

.zattrs:

{
    "air_density": 1.205,
    "dataset_type": "combined",
    "decimation_algo": null,
    "decimation_reduction": null,
    "filename": "run_1",
    "num_faces": 2259702,
    "num_points": 376531,
    "stream_velocity": 30.0,
    "x_bound": [
        -0.7651960253715515,
        3.9384799003601074
    ],
    "y_bound": [
        -1.0102499723434448,
        1.0102499723434448
    ],
    "z_bound": [
        -0.31964099407196045,
        1.1951099634170532
    ]
}

.zarray:

{
    "chunks": [
        52428,
        5
    ],
    "compressor": {
        "blocksize": 0,
        "clevel": 5,
        "cname": "zstd",
        "id": "blosc",
        "shuffle": 1
    },
    "dtype": "<f4",
    "fill_value": 0.0,
    "filters": null,
    "order": "C",
    "shape": [
        165769088,
        5
    ],
    "zarr_format": 2
}

curator-log:

[2025-11-18 21:21:26,116][physicsnemo_curator.utils.utils][INFO] - Starting ETL pipeline
[2025-11-18 21:21:26,119][physicsnemo_curator.utils.utils][INFO] - Config summary:
etl:
  common:
    kind: drivaerml
    model_type: combined
  processing:
    args: {}
    num_processes: 2
  sink:
    _convert_: all
    _target_: examples.external_aerodynamics.data_sources.ExternalAerodynamicsDataSource
    kind: ${etl.common.kind}
    output_dir: /DrivAerML.processed.zarrV2
    overwrite_existing: true
    serialization_method: ${serialization_format.serialization_method}
  source:
    _convert_: all
    _target_: examples.external_aerodynamics.data_sources.ExternalAerodynamicsDataSource
    input_dir: /DrivAerML
    kind: ${etl.common.kind}
    model_type: ${etl.common.model_type}
  transformations:
    stl_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsSTLTransformation
      geometry_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_geometry_data_processors.update_geometry_data_to_float32
    surface_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsSurfaceTransformation
      surface_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.decimate_mesh
        algo: decimate_pro
        preserve_topology: false
        reduction: 0.0
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.normalize_surface_normals
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.non_dimensionalize_surface_fields
        air_density: 1.0
        stream_velocity: 38.889
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_surface_data_processors.update_surface_data_to_float32
      surface_variables:
        pMeanTrim: scalar
        wallShearStressMeanTrim: vector
    volume_preprocessing:
      _convert_: all
      _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsVolumeTransformation
      volume_processors:
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.non_dimensionalize_volume_fields
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.update_volume_data_to_float32
      - _partial_: true
        _target_: examples.external_aerodynamics.external_aero_volume_data_processors.shuffle_volume_data
      volume_variables:
        UMeanTrim: vector
        nutMeanTrim: scalar
        pMeanTrim: scalar
    write_ready_transformation: ${override_transformations.write_ready_transformation}
  validator:
    _convert_: all
    _target_: examples.external_aerodynamics.dataset_validator.ExternalAerodynamicsDatasetValidator
    validation_level: fields
override_transformations:
  write_ready_transformation:
    _convert_: all
    _target_: examples.external_aerodynamics.data_transformations.ExternalAerodynamicsZarrTransformation
    chunk_size_mb: 1.0
    compression_level: 5
    compression_method: zstd
serialization_format:
  serialization_method: zarr

[2025-11-18 21:21:26,463][ExternalAerodynamicsDatasetValidator][INFO] - Starting External Aerodynamics dataset validation (level: fields)
[2025-11-18 21:21:26,505][ExternalAerodynamicsDatasetValidator][INFO] - Found 484 case directories to validate
[2025-11-18 21:21:30,248][ExternalAerodynamicsDatasetValidator][INFO] - Validation completed successfully