Confidence measures for deep learning in domain adaptation

TY - JOUR

T1 - Confidence measures for deep learning in domain adaptation

AU - Bonechi, Simone

AU - Andreini, Paolo

AU - Bianchini, Monica

AU - Pai, Akshay

AU - Scarselli, Franco

PY - 2019

Y1 - 2019

N2 - In recent years, Deep Neural Networks (DNNs) have led to impressive results in a wide variety of machine learning tasks, typically relying on the existence of a huge amount of supervised data. However, in many applications (e.g., bio-medical image analysis), gathering large sets of labeled data can be very difficult and costly. Unsupervised domain adaptation exploits data from a source domain, where annotations are available, to train a model able to generalize also to a target domain, where labels are unavailable. Recent research has shown that Generative Adversarial Networks (GANs) can be successfully employed for domain adaptation, although deciding when to stop learning is a major concern for GANs. In this work, we propose some confidence measures that can be used to early stop the GAN training, also showing how such measures can be employed to predict the reliability of the network output. The effectiveness of the proposed approach has been tested in two domain adaptation tasks, with very promising results.

AB - In recent years, Deep Neural Networks (DNNs) have led to impressive results in a wide variety of machine learning tasks, typically relying on the existence of a huge amount of supervised data. However, in many applications (e.g., bio-medical image analysis), gathering large sets of labeled data can be very difficult and costly. Unsupervised domain adaptation exploits data from a source domain, where annotations are available, to train a model able to generalize also to a target domain, where labels are unavailable. Recent research has shown that Generative Adversarial Networks (GANs) can be successfully employed for domain adaptation, although deciding when to stop learning is a major concern for GANs. In this work, we propose some confidence measures that can be used to early stop the GAN training, also showing how such measures can be employed to predict the reliability of the network output. The effectiveness of the proposed approach has been tested in two domain adaptation tasks, with very promising results.

KW - Confidence measures

KW - Generative Adversarial Networks

KW - Uncertainty estimation

KW - Unsupervised domain adaptation

UR - http://www.scopus.com/inward/record.url?scp=85067242027&partnerID=8YFLogxK

U2 - 10.3390/app9112192

DO - 10.3390/app9112192

M3 - Journal article

AN - SCOPUS:85067242027

SN - 2076-3417

VL - 9

JO - Applied Sciences (Switzerland)

JF - Applied Sciences (Switzerland)

IS - 11

M1 - 2192

ER -