Automatic semantic maps generation from lexical annotations

The generation of semantic environment representations is still an open problem in robotics. Most of the current proposals are based on metric representations, and incorporate semantic information in a supervised fashion. The purpose of the robot is key in the generation of these representations, wh...

Full description

Saved in:
Bibliographic Details
Main Author: Rangel, José Carlos (author)
Other Authors: Cazorla, Miguel (author), García Varea, Ismael (author), Romero González, Cristina (author), Martínez Gómez, Jesus (author)
Format: article
Language:English
Published: 2020
Subjects:
Online Access:https://link.springer.com/article/10.1007/s10514-018-9723-8
https://ridda2.utp.ac.pa/handle/123456789/9442
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The generation of semantic environment representations is still an open problem in robotics. Most of the current proposals are based on metric representations, and incorporate semantic information in a supervised fashion. The purpose of the robot is key in the generation of these representations, which has traditionally reduced the inter-usability of the maps created for different applications. We propose the use of information provided by lexical annotations to generate general-purpose semantic maps from RGB-D images. We exploit the availability of deep learning models suitable for describing any input image by means of lexical labels. Lexical annotations are more appropriate for computing the semantic similarity between images than the state-of-the-art visual descriptors. From these annotations, we perform a bottom-up clustering approach that associates each image with a different category. The use of RGB-D images allows the robot pose associated with each acquisition to be obtained, thus complementing the semantic with the metric information.