A framework for tool cognition in robots without prior tool learning or observation

Page view(s)
66
Checked on Dec 28, 2022
A framework for tool cognition in robots without prior tool learning or observation
Title:
A framework for tool cognition in robots without prior tool learning or observation
Other Titles:
Nature Machine Intelligence
Publication Date:
23 June 2022
Citation:
Tee, K. P., Cheong, S., Li, J., & Ganesh, G. (2022). A framework for tool cognition in robots without prior tool learning or observation. Nature Machine Intelligence, 4(6), 533–543. https://doi.org/10.1038/s42256-022-00500-9
Abstract:
Human tool use prowess distinguishes us from other animals. In many scenarios, a human is able to recognize objects seen for the first time as potential tools for a task and use them without requiring any learning. Here we propose a framework to enable similar abilities in robots. We first characterized human tools to identify a special category of tools that humans are able to use immediately through a process of skill transfer from their limbs, rather than tool learning. Motivated by the tool characteriza- tion and our neuroscientific studies on human tool use and embodiment, we then developed a tool cognition framework that enables a robot to recognize a previously unseen object as a tool for a task and plan how to grasp and wield the tool in the face of constraints and obstacles, before finally performing the task with the tool. Furthermore, the framework allows for flexibility in tool use, where the same tool can be adapted for different tasks, and different tools for the same task, all without any prior learning or observation of tool use. We demonstrate the possibilities offered by our tool cognition framework in several robot experiments with both toy and real objects as tools.
License type:
Publisher Copyright
Funding Info:
There was no specific funding for the research done
Description:
This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: http://dx.doi.org//10.1038/s42256-022-00500-9
ISSN:
2522-5839
Files uploaded:

File Size Format Action
towards-tool-cognition.pdf 33.21 MB PDF Open