Politecnico di Torino (logo)

Relational Reasoning for Out Of Distribution detection without fine-tuning

Lorenzo Li Lu

Relational Reasoning for Out Of Distribution detection without fine-tuning.

Rel. Tatiana Tommasi, Francesco Cappio Borlino. Politecnico di Torino, Corso di laurea magistrale in Ingegneria Informatica (Computer Engineering), 2023


Despite the remarkable results achieved across multiple fields, modern Deep Neural Networks can still prove to be extremely untrustworthy when operating with data coming from a different distribution compared to the one they were trained on. Such a limitation constitutes a major issue in safety-critical applications, where the reliability of a model is a particularly important factor. The Out Of Distribution (OOD) detection task tackles the aforementioned problem by recognizing whether test-time data samples come from a known or an unknown distribution. In order to obtain acceptable performance, traditional methods usually require a training or fine-tuning stage of the network on the known data, but this may be impractical or even infeasible in many deployment scenarios (e.g. because of data privacy or computational constraints). This thesis focuses on the semantic aspect of OOD detection (i.e., identifying data samples belonging to unknown categories) and, more specifically, it studies how to avoid any new learning effort on the in-distribution data by exploiting pre-trained models based on relational reasoning. Rather than focusing on standard image classification, a relational reasoning model is trained by comparing pairs of samples. This task can be formulated in various ways depending on the choice of the exact optimization objective. In this work, several loss functions are considered and their impact is analyzed by studying the behaviour of the obtained models. Moreover, other competing approaches are presented in order to draw a comparison and help better delineate the current landscape for OOD detection methods.

Relators: Tatiana Tommasi, Francesco Cappio Borlino
Academic year: 2022/23
Publication type: Electronic
Number of Pages: 65
Additional Information: Tesi secretata. Fulltext non presente
Corso di laurea: Corso di laurea magistrale in Ingegneria Informatica (Computer Engineering)
Classe di laurea: New organization > Master science > LM-32 - COMPUTER SYSTEMS ENGINEERING
Aziende collaboratrici: Politecnico di Torino
URI: http://webthesis.biblio.polito.it/id/eprint/26823
Modify record (reserved for operators) Modify record (reserved for operators)