Type of Publication

Journal Articles

Date:

5 /

2022

Status

Published

DOI:

10.1109/ACCESS.2022.3175195

Reducing Overconfidence Predictions in Autonomous Driving Perception

Featured in:

IEEE Access, vol. 10, pp. 54805-54821, 2022

Authors:

Gledson Melotti, Cristiano Premebida, Jordan J. Bird, Diego R. Faria and Nuno Gonçalves

Abstract

In state-of-the-art deep learning for object recognition, Softmax and Sigmoid layers are most commonly employed as the predictor outputs. Such layers often produce overconfidence predictions rather than proper probabilistic scores, which can thus harm the decision-making of ‘critical’ perception systems applied in autonomous driving and robotics. Given this, we propose a probabilistic approach based on distributions calculated out of the Logit layer scores of pre-trained networks which are then used to constitute new decision layers based on Maximum Likelihood ( ML ) and Maximum a-Posteriori (MAP) inference. We demonstrate that the hereafter called ML and MAP layers are more suitable for probabilistic interpretations than Softmax and Sigmoid-based predictions for object recognition. We explore distinct sensor modalities via RGB images and LiDARs (RV: range-view) data from the KITTI and Lyft Level-5 datasets, where our approach shows promising performance compared to the usual Softmax and Sigmoid layers, with the benefit of enabling interpretable probabilistic predictions. Another advantage of the approach introduced in this paper is that the so-called ML and MAP layers can be implemented in existing trained networks, that is, the approach benefits from the output of the Logit layer of pre-trained networks. Thus, there is no need to carry out a new training phase since the ML and MAP layers are used in the test/prediction phase. The Classification results are presented using reliability diagrams, while detection results are illustrated using precision-recall curves.

Citation
Gledson Melotti, Cristiano Premebida, Jordan J. Bird, Diego R. Faria and Nuno Gonçalves (2022). Reducing overconfidence predictions in autonomous driving perception. IEEE Access, 10, 54805-54821. DOI: 10.1109/ACCESS.2022.3175195

Related Content

Researcher Coordinator, VIS TEAM Leader
PhD Student
No tagged content to show
No tagged content to show
No tagged content to show

RECENT PUBLICATIONS

Using Benford’s Law for Deepfake Detection

Authors: Miguel Leão; Nuno Gonçalves
Featured in: RECPAD - 30th Portuguese Conference on Pattern Recognition. 2024, Covilhã, Portugal

Proceedings of the 12th Iberian Conference on Pattern Recognition and Image Analysis Part I

Authors: Nuno Gonçalves; Hélder P. Oliveira; Joan Andreu Sánchez
Featured in: 12th Iberian Conference on Pattern Recognition and Image Analysis (IbPRIA 2025)

Proceedings of the 12th Iberian Conference on Pattern Recognition and Image Analysis Part II

Authors: Nuno Gonçalves; Hélder P. Oliveira; Joan Andreu Sánchez
Featured in: 12th Iberian Conference on Pattern Recognition and Image Analysis (IbPRIA 2025)

suggested news

Paper accepted to IJCB 2025
Prof. Nuno and VIS Team successfully organizes IbPRIA...
Four papers presented @ IbPRIA 2025

RECENT PROJECTS

FACING2 – Face Image Understanding
VISUAL-ID – Unique Visual Identities in Graphics, Images and Faces
UniqueMark

Institute of Systems and Robotics Department of Electrical and Computers Engineering University of Coimbra