Conversation
| name: NYU_franka_play | ||
| tags: [unitree, humanoid, folding, clothes, manipulation] | ||
| tags: [franka, kitchen, play, cooking, manipulation] | ||
| description: "This dataset contains images and sensor data collected from the LeRobot Unitree H1 robot while performing fold clothes tasks in an indoor environment." |
There was a problem hiding this comment.
please update the description
| - name: panda_joint8 | ||
| index: 7 | ||
| - name: panda_hand_joint | ||
| index: 7 | ||
| - name: panda_hand_tcp_joint | ||
| index: 7 | ||
| - name: panda_finger_joint1 | ||
| index: 7 | ||
| - name: panda_finger_joint2 | ||
| index: 7 |
There was a problem hiding this comment.
should these be visual joints?
There was a problem hiding this comment.
this dataset works out the box with the URDF so is it necessary?
There was a problem hiding this comment.
there is no gripper data at all so not sure how to proceed? as there is no way to hook up the grippers?
There was a problem hiding this comment.
I think unless we want to train on the finger joint values, its better to put it in visual joints.
You can leave visual_joint_type empty which will default to "CUSTOM" and you can log them like how you log joint positions.
On another note, perhaps we need functionality to go from joint position to gripper open amount in a separate PR.
from robot.py:
def gripper_open_width_to_open_amount(
self, gripper_open_width: float, gripper_joint_names: list[str]
) -> float:
"""Convert gripper joint positions to open amount.
Args:
gripper_joint_names: List of gripper joint names
gripper_joint_positions: Dictionary mapping gripper
joint names to position values
Returns:
Amount to open gripper (0-1)
"""
joint_name = gripper_joint_names[0] # Assume joints are symmetric
min_pos, max_pos = self.joint_limits[joint_name]
joint_pos = np.clip(gripper_open_width / 2.0, min_pos, max_pos)
assert min_pos <= joint_pos <= max_pos, "Gripper joint position out of range"
open_amount = (joint_pos - min_pos) / (max_pos - min_pos)
assert 0.0 <= open_amount <= 1.0, "Gripper open amount out of range"
return open_amount
There was a problem hiding this comment.
agreed we should make this a seperate PR would be good to have
ee2cfc4 to
82ece5b
Compare
82ece5b to
d3c89d8
Compare
Features
Missing gripper values so the gripper visualization does not work.