Please use this identifier to cite or link to this item: https://hdl.handle.net/11147/12088
Title: Long-term image-based vehicle localization improved with learnt semantic descriptors
Authors: Çınaroğlu, İbrahim
Baştanlar, Yalın
Izmir Institute of Technology
Izmir Institute of Technology
Keywords: Autonomous driving
Image matching
Image-based localization
Issue Date: Nov-2022
Publisher: Elsevier
Abstract: Vision based solutions for the localization of vehicles have become popular recently. In this study, we employ an image retrieval based visual localization approach, in which database images are kept with GPS coordinates and the location of the retrieved database image serves as the position estimate of the query image in a city scale driving scenario. Regarding this approach, most existing studies only use descriptors extracted from RGB images and do not exploit semantic content. We show that localization can be improved via descriptors extracted from semantically segmented images, especially when the environment is subjected to severe illumination, seasonal or other long-term changes. We worked on two separate visual localization datasets, one of which (Malaga Streetview Challenge) has been generated by us and made publicly available. Following the extraction of semantic labels in images, we trained a CNN model for localization in a weakly-supervised fashion with triplet ranking loss. The optimized semantic descriptor can be used on its own for localization or preferably it can be used together with a state-of-the-art RGB image based descriptor in hybrid fashion to improve accuracy. Our experiments reveal that the proposed hybrid method is able to increase the localization performance of the standard (RGB image based) approach up to 7.7% regarding Top-1 Recall values.
Description: This work was supported by the Scientific and Technological Research Council of Turkey (Grant No.120E500). We also acknowledge the support of NVIDIA Corporation with the donation of Titan Xp GPU used for this research.
URI: https://doi.org/10.1016/j.jestch.2022.101098
https://hdl.handle.net/11147/12088
Appears in Collections:Computer Engineering / Bilgisayar Mühendisliği
Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection
WoS İndeksli Yayınlar Koleksiyonu / WoS Indexed Publications Collection

Files in This Item:
File Description SizeFormat 
1-s2.0-S2215098622000064-main.pdfArticle4.3 MBAdobe PDFView/Open
Show full item record

CORE Recommender

Google ScholarTM

Check

Altmetric


Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.