Skip to content

Questions about optimal/sub-optimal/recovery trajectories and optimal_steps mismatch #4

@Mars-xyx

Description

@Mars-xyx

Hi, thanks for releasing ColorBench.

I have two questions:

  1. In the paper, ColorBench is described as covering optimal, sub-optimal, and recovery paths.

    • Did you release any official trajectory annotations for these (e.g., per-task optimal trajectory / sub-optimal trajectory / recovery trajectory)?
    • Or are users expected to reconstruct them from graph.json and milestones?
  2. I reconstructed task-conditioned trajectories from data/graph.json + data/tasks.json, and found that for some tasks, the shortest feasible path is mismatch with optimal_steps in tasks.json.

    • For example, task_id 127 can reach the milestone-defined goal in about 5 steps, while optimal_steps is larger.
    • Is this expected? If yes, what is the intended meaning of optimal_steps (strict ground-truth optimum vs approximate reference length)?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions