Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Images

Archive ouverte

He, Yuting | Li, Tiantian | Yang, Guanyu | Kong, Youyong | Chen, Yang | Shu, Huazhong | Coatrieux, Jean-Louis | Dillenseger, Jean-Louis | Li, Shuo

Edité par CCSD ; Lecture Notes in Computer Science(), vol 12363. Springer, Cham. -

International audience. Deep learning-based medical image registration and segmentation joint models utilize the complementarity (augmentation data or weakly supervised data from registration, region constraints from segmentation) to bring mutual improvement in complex scene and few-shot situation. However, further adoption of the joint models are hindered: 1) the diversity of augmentation data is reduced limiting the further enhancement of segmentation, 2) misaligned regions in weakly supervised data disturb the training process, 3) lack of label-based region constraints in few-shot situation limits the registration performance. We propose a novel Deep Complementary Joint Model (DeepRS) for complex scene registration and few-shot segmentation. We embed a perturbation factor in the registration to increase the activity of deformation thus maintaining the augmentation data diversity. We take a pixel-wise discriminator to extract alignment confidence maps which highlight aligned regions in weakly supervised data so the misaligned regions’ disturbance will be suppressed via weighting. The outputs from segmentation model are utilized to implement deep-based region constraints thus relieving the label requirements and bringing fine registration. Extensive experiments on the CT dataset of MM-WHS 2017 Challenge [42] show great advantages of our DeepRS that outperforms the existing state-of-the-art models.

Suggestions

Du même auteur

Dense biased networks with deep priori anatomy and hard region adaptation: Semi-supervised learning for fine renal artery segmentation

Archive ouverte | He, Yuting | CCSD

International audience. Fine renal artery segmentation on abdominal CT angiography (CTA) image is one of the most important tasks for kidney disease diagnosis and pre-operative planning. It will help clinicians loca...

DPA-DenseBiasNet: Semi-supervised 3D Fine Renal Artery Segmentation with Dense Biased Network and Deep Priori Anatomy

Archive ouverte | He, Yuting | CCSD

International audience. 3D fine renal artery segmentation on abdominal CTA image targets on the segmentation of the complete renal artery tree which will help clinicians locate the interlobar artery's corresponding ...

Meta Grayscale Adaptive Network for 3D Integrated Renal Structures Segmentation

Archive ouverte | He, Yuting | CCSD

International audience. Three-dimensional (3D) integrated renal structures (IRS) segmentation targets segmenting the kidneys, renal tumors, arteries, and veins in one inference. Clinicians will benefit from the 3D I...

Chargement des enrichissements...