Supervised Autonomy Interface with Integrated Perception and Motion Planning for Telemanipulation Tasks

Supervised Autonomy Interface with Integrated Perception and Motion Planning for Telemanipulation Tasks

The 15th International Conference on Control, Automation, Robotics and Vision (ICARCV 2018)

10.1109/ICARCV.2018.8581374

https://doi.org/10.1109/ICARCV.2018.8581374

Jeffrey Chee Yong Fong, Minh Khang Pham, Anil Kurkcu, Jun LI, Keng Peng Tee

human-robot interface, telemanipulation, supervised autonomy

18 November 2018

J. C. Yong Fong, M. K. Pham, A. Kürkcü, J. Li and K. P. Tee, "Supervised Autonomy Interface with Integrated Perception and Motion Planning for Telemanipulation Tasks," 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), Singapore, 2018, pp. 1596-1601. doi: 10.1109/ICARCV.2018.8581374

In scenarios where the environment and task are known and certain, autonomous robotic manipulation can be performed. However, when an unforeseen situation arises where prior information is unknown, timely human assistance becomes very useful in accomplishing the task. In this paper, we propose a supervisory autonomy system that allows a user to assist the robot in uncertain task scenarios by specifying, through an intuitive user interface, the discrete actions (e.g. grasping) to be performed on the selected objects. The robot has partial knowledge of the environment in that it is able to segment and localize objects. This information is shared with the user to allow easy object and action specification, after which the robot executes the action on the object autonomously while avoiding obstacles. We investigated the system using live perception of real objects with simulated robot and environment.

PublisherCopyrights

(c) 2018 IEEE.

https://oar.a-star.edu.sg/communities-collections/articles/14460

978-1-5386-9582-1
978-1-5386-9581-4
978-1-5386-9583-8

Institute for Infocomm Research