[TO_REVIEW] New Script for Retrieving Cross-Validation Results from Benchopt Outputs

[YanisLalou]

Overview

This PR introduces a new script retrieve_cv_results_from_benchopt_outputs.py and updates the existing utility functions to support robust extraction and processing of cross-validation results from Benchopt output files.

Changes

• Added a new script retrieve_cv_results_from_benchopt_outputs.py to:

  • Process cross-validation results from Benchopt output files
  • Extract and organize CV splits information
  • Clean and structure data
  • Export results to a CSV file

• Updated visualize/_utils.py:

  • Added new function retrieve_cv() to extract cross-validation results
  • Enhanced process_files_in_directory() to support multiple processing types
  • Improved data extraction and transformation logic

• Updated visualize/convert_benchopt_output_to_readable_csv.py:

  • Modified to use the new processing function with processing_type='extract_benchopt'

Usage Example

python retrieve_cv_results_from_benchopt_outputs.py \
    --directory ../outputs \
    --output ./cleaned_outputs \
    --file_name cv_results