Open-Set Likelihood Maximization for Few-Shot Learning

Archive ouverte

Boudiaf, Malik | Bennequin, Etienne | Tami, Myriam | Toubhans, Antoine | Piantanida, Pablo | Hudelot, Céline | Ben Ayed, Ismail

Edité par CCSD -

International audience. We tackle the Few-Shot Open-Set Recognition (FSOSR) problem, i.e. classifying instances among a set of classes for which we only have a few labeled samples, while simultaneously detecting instances that do not belong to any known class. We explore the popular transductive setting, which leverages the unlabelled query instances at inference. Motivated by the observation that existing transductive methods perform poorly in open-set scenarios, we propose a generalization of the maximum likelihood principle, in which latent scores down-weighing the influence of potential outliers are introduced alongside the usual parametric model. Our formulation embeds supervision constraints from the support set and additional penalties discouraging overconfident predictions on the query set. We proceed with a blockcoordinate descent, with the latent scores and parametric model co-optimized alternately, thereby benefiting from each other. We call our resulting formulation Open-Set Likelihood Optimization (OSLO). OSLO is interpretable and fully modular; it can be applied on top of any pre-trained model seamlessly. Through extensive experiments, we show that our method surpasses existing inductive and transductive methods on both aspects of open-set recognition, namely inlier classification and outlier detection. Code is available at https://github.com/ebennequin/fewshot-open-set.

Suggestions

Du même auteur

Bridging Few-Shot Learning and Adaptation: New Challenges of Support-Query Shift

Archive ouverte | Bennequin, Etienne | CCSD

International audience. Few-Shot Learning (FSL) algorithms have made substantial progress in learning novel concepts with just a handful of labelled data. To classify query instances from novel classes encountered a...

Transductive Learning for Textual Few-Shot Classification in API-based Embedding Models

Archive ouverte | Colombo, Pierre | CCSD

International audience. Proprietary and closed APIs are becoming increasingly common to process natural language, and are impacting the practical applications of natural language processing, including fewshot classi...

Spatial Contrastive Learning for Few-Shot Classification

Archive ouverte | Ouali, Yassine | CCSD

International audience. In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer ...

Chargement des enrichissements...