Connecting an Xbox Controller for Teleoperation

[morganchendev]

Hello,

I've been trying to follow the Teleoperation and Imitation Learning tutorial and have had success with going through the steps with my keyboard as my input device but would like to use an Xbox controller instead. However, I'm experiencing difficulties in getting the arm to respond to the inputs from the Xbox controller (no response at all).

I have a Wired Controller For Xbox Series X|S. I'm running Isaac Lab 2.2.0 inside Docker on a computer running Ubuntu 24.04. I know to run with the "--teleop-device" parameter set to "gamepad", have tested to make sure that the controller and its inputs are recognized inside the container environment (ls /dev/input/js*), and have tried changing the index of the gamepad = app_window.get_gamepad(0) line in the se3_gamepad.py file.

Has anyone been able to connect and use the gamepad device as input for this tutorial? Thank you.