M. Ramanthan, L. Luo, JK. Er, M.J. Foo, C.H. Chiam, L. Li, W.Y. Yau and W.T. Ang. Visual Environment perception for obstacle detection and crossing of lower-limb exoskeletons. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2022)
Abstract:
Lower limb exoskeletons offer support for patients suffering from mobility disorders due to injury, stroke, etc. But these devices are not used in day-to-day life and environments due to their limited human-computer interface to perceive and handle different terrains and tasks. In this paper, we introduce a simple vision-based environment perception pipeline for lowerlimb exoskeletons for obstacle crossing tasks. The proposed
pipeline consists of three stages, namely, ground plane and obstacle detection, estimating obstacle location and dimensions, and obstacle tracking. To reduce noisy artifacts and reliably detect obstacles, we propose a similarity metric based on color, gradient orientation, and 2D surface normal. Depth map of the detected obstacle region is utilized for estimating the obstacle location and dimensions. Also, we consider two obstacle tracking modes for obstacle crossing, visual tracking using a RGB-D camera and positional tracking using a SLAM camera. The proposed vision-based perception pipeline is integrated with an exoskeleton, where we propose a control scheme that can vary step length adaptively to successfully cross detected
obstacles. We conduct offline and online experiments to validate the proposed perception pipeline and provide insights on the same. Our experiments show that the proposed pipeline allows exoskeletons to understand their environment and successfully cross obstacles.
License type:
Publisher Copyright
Funding Info:
This research / project is supported by the National Robotics Programme Singapore - National Robotics Programme
Grant Reference no. : W1925d0046