Commit eef56910 authored by shauryadNv's avatar shauryadNv Committed by Kelly Guo

Fixes rendering settings for Mimic Cosmos pipeline (#511)

# Description

Reverting the pipeline to use "performance" rendering mode but with
necessary changes to the rendering settings done in the custom env.

## Type of change

- Bug fix (non-breaking change which fixes an issue)
- This change requires a documentation update

## Checklist

- [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with
`./isaaclab.sh --format`
- [x] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [x] I have updated the changelog and the corresponding version in the
extension's `config/extension.toml` file
- [x] I have added my name to the `CONTRIBUTORS.md` or my name already
exists there
parent 4f65225d
...@@ -24,7 +24,7 @@ In the following example, we will show you how to use Isaac Lab Mimic to generat ...@@ -24,7 +24,7 @@ In the following example, we will show you how to use Isaac Lab Mimic to generat
--device cpu --enable_cameras --headless --num_envs 10 --generation_num_trials 1000 \ --device cpu --enable_cameras --headless --num_envs 10 --generation_num_trials 1000 \
--input_file ./datasets/annotated_dataset.hdf5 --output_file ./datasets/mimic_dataset_1k.hdf5 \ --input_file ./datasets/annotated_dataset.hdf5 --output_file ./datasets/mimic_dataset_1k.hdf5 \
--task Isaac-Stack-Cube-Franka-IK-Rel-Visuomotor-Cosmos-Mimic-v0 \ --task Isaac-Stack-Cube-Franka-IK-Rel-Visuomotor-Cosmos-Mimic-v0 \
--rendering_mode balanced --rendering_mode performance
The number of demonstrations can be increased or decreased, 1000 demonstrations have been shown to provide good training results for this task. The number of demonstrations can be increased or decreased, 1000 demonstrations have been shown to provide good training results for this task.
...@@ -386,7 +386,7 @@ Example usage for the cube stacking task: ...@@ -386,7 +386,7 @@ Example usage for the cube stacking task:
--enable_cameras \ --enable_cameras \
--seeds 0 \ --seeds 0 \
--num_rollouts 15 \ --num_rollouts 15 \
--rendering_mode balanced --rendering_mode performance
We use the above script to compare models trained with 1000 Mimic-generated demonstrations, 2000 Mimic-generated demonstrations and 2000 Cosmos-Mimic-generated demonstrations (1000 original mimic + 1000 Cosmos augmented) respectively. We use the same seeds (0, 1000 and 5000) for all three models and provide the metrics (averaged across best checkpoints for each seed) below: We use the above script to compare models trained with 1000 Mimic-generated demonstrations, 2000 Mimic-generated demonstrations and 2000 Cosmos-Mimic-generated demonstrations (1000 original mimic + 1000 Cosmos augmented) respectively. We use the same seeds (0, 1000 and 5000) for all three models and provide the metrics (averaged across best checkpoints for each seed) below:
......
[package] [package]
# Note: Semantic Versioning is used: https://semver.org/ # Note: Semantic Versioning is used: https://semver.org/
version = "0.10.40" version = "0.10.41"
# Description # Description
title = "Isaac Lab Environments" title = "Isaac Lab Environments"
......
Changelog Changelog
--------- ---------
0.10.41 (2025-07-01)
~~~~~~~~~~~~~~~~~~~~
Fixed
^^^^^
* Fixed the rendering settings used for the Mimic-Cosmos pipeline.
0.10.40 (2025-06-26) 0.10.40 (2025-06-26)
~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~
......
...@@ -105,6 +105,12 @@ class FrankaCubeStackVisuomotorCosmosEnvCfg(stack_ik_rel_visuomotor_env_cfg.Fran ...@@ -105,6 +105,12 @@ class FrankaCubeStackVisuomotorCosmosEnvCfg(stack_ik_rel_visuomotor_env_cfg.Fran
# post init of parent # post init of parent
super().__post_init__() super().__post_init__()
import carb
from isaacsim.core.utils.carb import set_carb_setting
carb_setting = carb.settings.get_settings()
set_carb_setting(carb_setting, "/rtx/domeLight/upperLowerStrategy", 4)
SEMANTIC_MAPPING = { SEMANTIC_MAPPING = {
"class:cube_1": (120, 230, 255, 255), "class:cube_1": (120, 230, 255, 255),
"class:cube_2": (255, 36, 66, 255), "class:cube_2": (255, 36, 66, 255),
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment