A deep learning model to predict RNA-Seq expression of tumours from whole slide images

Archive ouverte

Schmauch, Benoît | Romagnoni, Alberto | Pronier, Elodie | Saillard, Charlie | Maillé, Pascale | Calderaro, Julien | Kamoun, Aurélie | Sefta, Meriem | Toldo, Sylvain | Zaslavskiy, Mikhail | Clozel, Thomas | Moarii, Matahi | Courtiol, Pierre | Wainrib, Gilles

Edité par CCSD ; Nature Publishing Group -

International audience. Deep learning methods for digital pathology analysis are an effective way to address multiple clinical questions, from diagnosis to prediction of treatment outcomes. These methods have also been used to predict gene mutations from pathology images, but no comprehensive evaluation of their potential for extracting molecular features from histology slides has yet been performed. We show that HE2RNA, a model based on the integration of multiple data modes, can be trained to systematically predict RNA-Seq profiles from whole-slide images alone, without expert annotation. Through its interpretable design, HE2RNA provides virtual spatialization of gene expression, as validated by CD3- and CD20-staining on an independent dataset. The transcriptomic representation learned by HE2RNA can also be transferred on other datasets, even of small size, to increase prediction performance for specific molecular phenotypes. We illustrate the use of this approach in clinical diagnosis purposes such as the identification of tumors with microsatellite instability.

Suggestions

Du même auteur

AI-based multi-modal integration (ScanCov scores) of clinical characteristics, lab tests and chest CTs improves COVID-19 outcome prediction of hospitalized patients

Archive ouverte | Lassau, Nathalie | CCSD

The SARS-COV-2 pandemic has put pressure on Intensive Care Units, and made theidentification of early predictors of disease severity a priority. We collected clinical,biological, chest CT scan data, and radiology reports from 1,00...

Comprehensive Molecular and Pathologic Evaluation of Transitional Mesothelioma Assisted by Deep Learning Approach: A Multi-Institutional Study of the International Mesothelioma Panel from the MESOPATH Reference Center

Archive ouverte | Galateau Salle, Francoise | CCSD

International audience. AbstractIntroductionHistologic subtypes of malignant pleural mesothelioma are a major prognostic indicator and decision denominator for all therapeutic strategies. In an ambiguous case, a rar...

Pacpaint: a histology-based deep learning model uncovers the extensive intratumor molecular heterogeneity of pancreatic adenocarcinoma

Archive ouverte | Saillard, Charlie | CCSD

International audience. Two tumor (Classical/Basal) and stroma (Inactive/active) subtypes of Pancreatic adenocarcinoma (PDAC) with prognostic and theragnostic implications have been described. These molecular subtyp...

Chargement des enrichissements...