Unsupervised Out-of-Distribution Detection Using Few in-Distribution Samples

Page view(s)
21
Checked on Apr 17, 2024
Unsupervised Out-of-Distribution Detection Using Few in-Distribution Samples
Title:
Unsupervised Out-of-Distribution Detection Using Few in-Distribution Samples
Journal Title:
ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Keywords:
Publication Date:
05 May 2023
Citation:
Gautam, C., Kane, A., Ramasamy, S., & Sundaram, S. (2023). Unsupervised Out-of-Distribution Detection Using Few in-Distribution Samples. ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp49357.2023.10096482
Abstract:
This paper tackles the out-of-distribution (OOD) detection problem for natural language classifiers. While the previous OOD detection methods require large-scale in-distribution (ID) training data, we attack this problem from the few-shot perspective in an unsupervised manner where the training relies on only a few samples from ID data. First, we develop various baselines for Few-shot OOD (FSOOD) detection in text classification based on the three well-known few-shot learning approaches (well-explored in the vision domain), i.e., meta-learning, metric learning, and data augmentation (DA). Then, we introduce the concept of demonstration-based data augmentation with meta and metric-learning approaches to reap the combined benefit of both approaches. A pre-trained transformer is fine-tuned on a few available ID samples in all developed methods. In tandem with this fine-tuning, an OOD detector is fitted over the ID training samples to reject the data from the unknown classes using two kinds of distance metrics, namely Mahalanobis distance and Cosine similarity. At last, we present an extensive evaluation of three ID datasets and three OOD datasets. We also perform an ablation study to analyze the impact of various components of our method.
License type:
Publisher Copyright
Funding Info:
This research / project is supported by the AI Singapore Programme - AISG
Grant Reference no. : AISG2-RP-2021-027

Wipro and IISC (Grant No-99325T).
Description:
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
ISBN:
978-1-7281-6327-7
Files uploaded:

File Size Format Action
fs-ood-icassp-camera-ready-final.pdf 580.92 KB PDF Request a copy