Skip to content

Request: Script to generate example_output.json with category, answer, and vlm_answer fields #2

@GuangtaoLyu

Description

@GuangtaoLyu

Hi maintainers,

Thank you for sharing this dataset and the evaluation framework!

I'm currently generating predictions for this dataset and noticed that the expected output format follows example/example_output.json. Each QA pair in the output should contain the following fields:

  • category
  • answer
  • vlm_answer

Could you please provide a simple script or code snippet demonstrating how to process the dataset and export the results into this specific JSON structure? A minimal working example would be greatly appreciated to ensure full compatibility with your evaluation pipeline.

Thanks in advance for your time and support!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions