feat(hil): add bi_so_follower and bi_so_leader support for HIL data collection#3352
Open
wy-zong wants to merge 12 commits intohuggingface:mainfrom
Open
feat(hil): add bi_so_follower and bi_so_leader support for HIL data collection#3352wy-zong wants to merge 12 commits intohuggingface:mainfrom
wy-zong wants to merge 12 commits intohuggingface:mainfrom
Conversation
…ollection Register BiSOFollowerConfig and BiSOLeaderConfig in the HIL script so that bimanual SO-ARM100 robots can be used with hil_data_collection.py. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
pkooij
previously approved these changes
Apr 14, 2026
Signed-off-by: wy-zong <wuc120@gmail.com>
Signed-off-by: wy-zong <wuc120@gmail.com>
Signed-off-by: wy-zong <wuc120@gmail.com>
Signed-off-by: wy-zong <wuc120@gmail.com>
Signed-off-by: wy-zong <wuc120@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Type / Scope
Summary / Motivation
The HIL data collection script (
examples/hil/hil_data_collection.py) currently only registers a limited set of robot andteleoperator types. Bimanual SO-ARM100 users (
bi_so_follower/bi_so_leader) cannot use the HIL workflow because thecorresponding config classes are not imported, causing draccus to reject the
--robot.type=bi_so_followerargument.This PR adds the missing imports so that
bi_so_followerandbi_so_leaderare registered as valid choices.Related issues
What changed
BiSOFollowerConfigimport inexamples/hil/hil_data_collection.py(registersbi_so_followerrobot type)BiSOLeaderConfigimport inexamples/hil/hil_data_collection.py(registersbi_so_leaderteleoperator type)How was this tested (or how to run locally)
--robot.type=bi_so_followeris accepted by draccus argument parser after the change.python /hil_data_collection.py
--robot.type=bi_so_follower--robot.left_arm_config.port=COM5
--robot.right_arm_config.port=COM8--robot.id=bimanual_follower
--teleop.type=bi_so_leader--teleop.left_arm_config.port=COM4
--teleop.right_arm_config.port=COM9--teleop.id=bimanual_leader
--robot.left_arm_config.cameras='{"camera1": {"type": "opencv", "index_or_path": 0, "width": 640, "height": 480, "fps": 30}, "camera3": {"type": "opencv", "index_or_path": 1, "width": 640, "height": 480, "fps": 30}}'--robot.right_arm_config.cameras='{"camera2": {"type": "opencv", "index_or_path": 2, "width": 640, "height": 480, "fps": 30}}'
--policy.path=wuc1/bi_so101_flatten-and-fold-the-rag-0401-model--dataset.repo_id=local/hil-rtc-dataset-PR
--dataset.single_task="flatten and fold the rag"--dataset.fps=30
--dataset.episode_time_s=1000--dataset.num_episodes=50
--dataset.rename_map='{"observation.images.left_camera1": "observation.images.camera1", "observation.images.left_camera3": "observation.images.camera3", "observation.images.right_camera2": "observation.images.camera2"}'--interpolation_multiplier=3 `
--dataset.push_to_hub=false
Checklist (required before merge)
pre-commit run -a)pytest)Reviewer notes