π VR-based robot teleoperation in simulation using Meta Quest (Oculus) VR joystick, integrated with NVIDIA Isaac Lab.
Built for researchers and developers who want to control simulated robots using natural hand movements and joystick inputs via a VR headset.
- β Teleoperate mobile manipulators in Isaac Lab simulation
- β Use Meta Quest (Oculus) VR joystick for control
- β Real-time pose streaming and control commands
- β
Supports dual-arm manipulation and mobile base movement
(v0: fixed bimanual / v1: mobile bimanual / v2: VR rendering) - β Easy to customize and extend
- Python 3.8+
- NVIDIA Isaac Lab set up (latest version)
- OpenVR or pyovr for Oculus streaming
- Meta Quest / Oculus headset + link cable or Air Link
- Conda (recommended)
Every information where to locate files are all in the tutorial video.
LinkedIn: https://www.linkedin.com/in/kyoungin-baik/
Website: https://youngwoon.github.io/