Fast 3D Face Reconstruction from a Single Image Using Different Deep Learning Approaches for Facial Palsy Patients

Archive ouverte

Nguyen, Duc-Phong | Nguyen, Tan-Nhu | Dakpé, Stéphanie | Ho Ba Tho, Marie-Christine | Dao, Tien-Tuan

Edité par CCSD ; MDPI -

International audience. The 3D reconstruction of an accurate face model is essential for delivering reliable feedback for clinical decision support. Medical imaging and specific depth sensors are accurate but not suitable for an easy-to-use and portable tool. The recent development of deep learning (DL) models opens new challenges for 3D shape reconstruction from a single image. However, the 3D face shape reconstruction of facial palsy patients is still a challenge, and this has not been investigated. The contribution of the present study is to apply these state-of-the-art methods to reconstruct the 3D face shape models of facial palsy patients in natural and mimic postures from one single image. Three different methods (3D Basel Morphable model and two 3D Deep Pre-trained models) were applied to the dataset of two healthy subjects and two facial palsy patients. The reconstructed outcomes were compared to the 3D shapes reconstructed using Kinect-driven and MRI-based information. As a result, the best mean error of the reconstructed face according to the Kinect-driven reconstructed shape is 1.5±1.1 mm. The best error range is 1.9±1.4 mm when compared to the MRI-based shapes. Before using the procedure to reconstruct the 3D faces of patients with facial palsy or other facial disorders, several ideas for increasing the accuracy of the reconstruction can be discussed based on the results. This present study opens new avenues for the fast reconstruction of the 3D face shapes of facial palsy patients from a single image. As perspectives, the best DL method will be implemented into our computer-aided decision support system for facial disorders.

Suggestions

Du même auteur

Enhanced facial behavior recognition and rehabilitation using 3D biomechanical features and deep learning approaches. Reconnaissance des comportements et rééducation fonctionnelle du visage à partir des descripteurs biomécaniques 3D et l'apprentissage profond

Archive ouverte | Nguyen, Duc-Phong | CCSD

Facial palsy patients or patients under facial transplantation have facial dysfunctionalities and abnormal facial motion. This is due to the altered facial nerve and facial muscle systems. Current traditional facial rehabilitation...

Enhanced facial expression recognition using 3D point sets and geometric deep learning

Archive ouverte | Nguyen, Duc-Phong | CCSD

International audience

Reinforcement Learning coupled with Finite Element Modeling for Facial Motion Learning

Archive ouverte | Nguyen, Duc-Phong | CCSD

International audience

Chargement des enrichissements...