• rebeccazhang0707's avatar
    Adds galbot stack cube tasks, with left_arm_gripper and right_arm_suction,... · bc7e5d7b
    rebeccazhang0707 authored
    Adds galbot stack cube tasks, with left_arm_gripper and right_arm_suction, using RMPFlow controller (#3210)
    
    # Description
    
    <!--
    Thank you for your interest in sending a pull request. Please make sure
    to check the contribution guidelines.
    
    Link:
    https://isaac-sim.github.io/IsaacLab/main/source/refs/contributing.html
    -->
    
    Adds galbot_stack_cube tasks and mimic tasks, using RMPFlow controller:
    - add galbot robot config and .usd asset
    - add RMPFlowAction and RMPFlowActionCfg
    - add motion_policy_configs and .urdf for both 'galbot_left_arm_gripper'
    and 'galbot_right_arm_suction'
    - add new task: galbot stack_rmp_rel_env_cfg
    - add new mimic task: galbot_stack_rmp_abs/rel_mimic_env
    - add mdp.observations/terminations/events for galbot: support
    gripper_state checking for both suction_cup and parallel_gripper, get
    obs_in_base_frame
    - add gripper_configs (gripper_joint_names, gripper_open_val,
    gripper_threshold) in galbot/franka tasks: to make mdp functions
    universal to varied robots
    - fix a bug (eef_name) in franka_stack_ik_rel_mimic_env.py
    - add new device_name in se3_spacemouse.py
    
    Notes: This PR relies on PR
    (https://github.com/isaac-sim/IsaacLab/pull/3174) for surface gripper
    support in manager-based workflow.
    
    You can test the whole gr00t-mimic workflow by:
    1. record demos:
    `./isaaclab.sh -p scripts/tools/record_demos.py --task
    Isaac-Stack-Cube-Galbot-Left-Arm-Gripper-RmpFlow-v0 --teleop_device
    spacemouse --num_demos 1 --device cpu --dataset_file
    datasets/recorded_demos_galbot_suction_rel.hdf5`
    2. replay demos:
    `./isaaclab.sh -p scripts/tools/replay_demos.py --task
    Isaac-Stack-Cube-Galbot-Left-Arm-Gripper-RmpFlow-v0 --num_envs 1
    --device cpu --dataset_file
    datasets/recorded_demos_galbot_suction_rel.hdf5`
    3. annotate demos:
    `./isaaclab.sh -p
    scripts/imitation_learning/isaaclab_mimic/annotate_demos.py --task
    Isaac-Stack-Cube-Galbot-Left-Arm-Gripper-RmpFlow-Rel-Mimic-v0 --auto
    --device cpu --input_file
    datasets/recorded_demos_galbot_suction_rel.hdf5 --output_file
    datasets/annotated_demos_galbot_suction_rel.hdf5`
    4. generate dataset:
    `./isaaclab.sh -p
    scripts/imitation_learning/isaaclab_mimic/generate_dataset.py --task
    Isaac-Stack-Cube-Galbot-Left-Arm-Gripper-RmpFlow-Rel-Mimic-v0 --num_envs
    16 --device cpu --generation_num_trials 10 --input_file
    datasets/annotated_demos_galbot_suction_rel.hdf5 --output_file
    datasets/generated_demos_galbot_suction_rel.hdf5`
    
    <!-- As a practice, it is recommended to open an issue to have
    discussions on the proposed pull request.
    This makes it easier for the community to keep track of what is being
    developed or added, and if a given feature
    is demanded by more than one party. -->
    
    ## Type of change
    
    <!-- As you go through the list, delete the ones that are not
    applicable. -->
    
    - Bug fix (non-breaking change which fixes an issue)
    - New feature (non-breaking change which adds functionality)
    
    ## Screenshot
    <img width="1428" height="281" alt="environments_galbot"
    src="https://github.com/user-attachments/assets/b603bc60-7ff3-44e8-bf41-ab8126a753ec"
    />
    
    
    ## Checklist
    
    - [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with
    `./isaaclab.sh --format`
    - [ ] I have made corresponding changes to the documentation
    - [x] My changes generate no new warnings
    - [ ] I have added tests that prove my fix is effective or that my
    feature works
    - [ ] I have updated the changelog and the corresponding version in the
    extension's `config/extension.toml` file
    - [ ] I have added my name to the `CONTRIBUTORS.md` or my name already
    exists there
    
    <!--
    As you go through the checklist above, you can mark something as done by
    putting an x character in it
    
    For example,
    - [x] I have done this task
    - [ ] I have not done this task
    -->
    
    ---------
    Signed-off-by: 's avatarrebeccazhang0707 <168459200+rebeccazhang0707@users.noreply.github.com>
    Signed-off-by: 's avatarKelly Guo <kellyg@nvidia.com>
    Co-authored-by: 's avatarKelly Guo <kellyg@nvidia.com>
    bc7e5d7b
Name
Last commit
Last update
..
actuator-group Loading commit data...
benchmarks Loading commit data...
css Loading commit data...
demos Loading commit data...
how-to Loading commit data...
multi-gpu-rl Loading commit data...
overview/sensors Loading commit data...
policy_deployment Loading commit data...
reference-architecture Loading commit data...
setup Loading commit data...
task-workflows Loading commit data...
tasks Loading commit data...
terrains Loading commit data...
tutorials Loading commit data...
NVIDIA-logo-black.png Loading commit data...
NVIDIA-logo-white.png Loading commit data...
favicon.ico Loading commit data...
isaaclab.jpg Loading commit data...
refs.bib Loading commit data...
tasks.jpg Loading commit data...
vscode_tasks.png Loading commit data...