At outreach events, we often let kids drive the robot while we control the other joystick. An idea could be to have a separate Xbox Controller just for them to use but the controls to that XboxController are overwritten by the joysticks and the XboxController is only active while a specific button is held on the joysticks themselves.