Type of Publication

Journal Articles

Date:

6 /

2020

Status

Published

DOI:

10.1109/ACCESS.2020.3005687

Deep Facial Diagnosis: Deep Transfer Learning From Face Recognition to Facial Diagnosis

Featured in:

IEEE Access, 2020

Authors:

Bo Jin, Leandro Cruz and Nuno Gonçalves

Abstract

The relationship between face and disease has been discussed from thousands years ago, whichleads to the occurrence of facial diagnosis. The objective here is to explore the possibility of identifyingdiseases from uncontrolled 2D face images by deep learning techniques. In this paper, we propose usingdeep transfer learning from face recognition to perform the computer-aided facial diagnosis on variousdiseases. In the experiments, we perform the computer-aided facial diagnosis on single (beta-thalassemia)and multiple diseases (beta-thalassemia, hyperthyroidism, Down syndrome, and leprosy) with a relativelysmall dataset. The overall top-1 accuracy by deep transfer learning from face recognition can reach over90% which outperforms the performance of both traditional machine learning methods and clinicians in theexperiments. In practical, collecting disease-specific face images is complex, expensive and time consuming,and imposes ethical limitations due to personal data treatment. Therefore, the datasets of facial diagnosisrelated researches are private and generally small comparing with the ones of other machine learningapplication areas. The success of deep transfer learning applications in the facial diagnosis with a smalldataset could provide a low-cost and noninvasive way for disease screening and detection.

Citation
Bo Jin, Leandro Cruz and Nuno Gonçalves. Deep facial diagnosis: deep transfer learning from face recognition to facial diagnosis. IEEE Access, 8, 123649-123661. DOI: 10.1109/ACCESS.2020.3005687

Related Content

Researcher Coordinator, VIS TEAM Leader
Post-Doc Researcher
Post-Doc Researcher
No tagged content to show
No tagged content to show
No tagged content to show

RECENT PUBLICATIONS

VOIDFace: Towards an Effective Face Training Data Storage and Protection with Right to be Forgotten Property

Authors: Ajnas Muhammed; Iurii Medvedev; Nuno Gonçalves
Featured in: IEEE International Joint Conference on Biometrics (IJCB 2025)

Análise de marcadores biométricos e sinais vitais através de visão artificial: Ritmo Cardíaco

Authors: Rodrigo Rosado Gonçalves
Featured in: Bsc Thesis

How to Evaluate a Biometric Facial Image

Authors: Diana Gonçalves D’Amil
Featured in: Bsc Thesis

suggested news

Paper accepted to IJCB 2025
Prof. Nuno and VIS Team successfully organizes IbPRIA...
Four papers presented @ IbPRIA 2025

RECENT PROJECTS

FACING2 – Face Image Understanding
VISUAL-ID – Unique Visual Identities in Graphics, Images and Faces
UniqueMark

Institute of Systems and Robotics Department of Electrical and Computers Engineering University of Coimbra