Commit bb3f19a9 authored by peterd-NV's avatar peterd-NV Committed by Kelly Guo

Adds clarification diagrams to Mimic docs (#371)

# Description

<!--
Thank you for your interest in sending a pull request. Please make sure
to check the contribution guidelines.

Link:
https://isaac-sim.github.io/IsaacLab/main/source/refs/contributing.html
-->

1. Updates the Mimic docs and adds a diagram to show correct annotation
for the GR1 pick place task.
2. Move the pick place task gif so that users can reference it when
collecting demos.

## Type of change

<!-- As you go through the list, delete the ones that are not
applicable. -->

- Documentation update

## Screenshots

Please attach before and after screenshots of the change if applicable.

<!--
Example:

| Before | After |
| ------ | ----- |
| _gif/png before_ | _gif/png after_ |

To upload images to a PR -- simply drag and drop an image while in edit
mode and it should upload the image directly. You can then paste that
source into the above before/after sections.
-->

## Checklist

- [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with
`./isaaclab.sh --format`
- [x] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] I have updated the changelog and the corresponding version in the
extension's `config/extension.toml` file
- [x] I have added my name to the `CONTRIBUTORS.md` or my name already
exists there

<!--
As you go through the checklist above, you can mark something as done by
putting an x character in it

For example,
- [x] I have done this task
- [ ] I have not done this task
-->

---------
Signed-off-by: 's avatarKelly Guo <kellyguo123@hotmail.com>
Co-authored-by: 's avatarKelly Guo <kellyg@nvidia.com>
parent bd219022
...@@ -310,11 +310,6 @@ By inferencing using the generated model, we can visualize the results of the po ...@@ -310,11 +310,6 @@ By inferencing using the generated model, we can visualize the results of the po
Demo: Data Generation and Policy Training for a Humanoid Robot Demo: Data Generation and Policy Training for a Humanoid Robot
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
.. figure:: ../_static/tasks/manipulation/gr-1_pick_place.gif
:width: 100%
:align: center
:alt: GR-1 humanoid robot performing a pick and place task
Isaac Lab Mimic supports data generation for robots with multiple end effectors. In the following demonstration, we will show how to generate data Isaac Lab Mimic supports data generation for robots with multiple end effectors. In the following demonstration, we will show how to generate data
to train a Fourier GR-1 humanoid robot to perform a pick and place task. to train a Fourier GR-1 humanoid robot to perform a pick and place task.
...@@ -346,7 +341,14 @@ The Isaac Lab Mimic Env GR-1 humanoid robot is set up such that the left hand ha ...@@ -346,7 +341,14 @@ The Isaac Lab Mimic Env GR-1 humanoid robot is set up such that the left hand ha
The first subtask involves the right hand remaining idle while the left hand picks up and moves the object to the position where the right hand will grasp it. The first subtask involves the right hand remaining idle while the left hand picks up and moves the object to the position where the right hand will grasp it.
This setup allows Isaac Lab Mimic to interpolate the right hand's trajectory accurately by using the object's pose, especially when poses are randomized during data generation. This setup allows Isaac Lab Mimic to interpolate the right hand's trajectory accurately by using the object's pose, especially when poses are randomized during data generation.
Therefore, avoid moving the right hand while the left hand picks up the object and brings it to a stable position. Therefore, avoid moving the right hand while the left hand picks up the object and brings it to a stable position.
We recommend 10 successful demonstrations for good data generation results. We recommend 10 successful demonstrations for good data generation results. An example of a successful demonstration is shown below:
.. figure:: ../_static/tasks/manipulation/gr-1_pick_place.gif
:width: 100%
:align: center
:alt: GR-1 humanoid robot performing a pick and place task
Collect demonstrations by running the following command:
.. code:: bash .. code:: bash
...@@ -393,7 +395,13 @@ You can replay the collected demonstrations by running the following command: ...@@ -393,7 +395,13 @@ You can replay the collected demonstrations by running the following command:
Unlike the prior Franka stacking task, the GR-1 pick and place task uses manual annotation to define subtasks. Unlike the prior Franka stacking task, the GR-1 pick and place task uses manual annotation to define subtasks.
Each demo requires a single annotation between the first and second subtask of the right arm. This annotation ("S" button press) should be done when the right robot arm finishes the "idle" subtask and begins to Each demo requires a single annotation between the first and second subtask of the right arm. This annotation ("S" button press) should be done when the right robot arm finishes the "idle" subtask and begins to
move towards the target object. Annotate the demonstrations by running the following command: move towards the target object. An example of a correct annotation is shown below:
.. figure:: ../_static/tasks/manipulation/gr-1_pick_place_annotation.jpg
:width: 100%
:align: center
Annotate the demonstrations by running the following command:
.. code:: bash .. code:: bash
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment