Checklist Strategies to Improve the Reproducibility of Deep Learning Experiments with an Illustration

Archive ouverte

Ben Abbess, Ali | Meneguzzi, Leonardo | Corrêa, Pedro Pizzigatti | Mouillot, David | David, Romain | Subsol, Gérard | Vellenich, Danton Ferreira | Devillers, Rodolphe | Stall, Shelley | Mouquet, Nicolas | Chaumont, Marc | Berti-Équille, Laure | Specht, Alison

Edité par CCSD -

Poster to be presented during RDA 19th Plenary Meeting, Part Of International Data Week, 20–23 June 2022, Seoul, South Korea. International audience. We report a review of the reproducibility of three publications for Poverty estimation using DL and Remote sensing imagery. For each experiment, we identified the methods and workflows used, if the experiments were not fully reproducible. Although the three use cases were proposed for a specific task (poverty estimation), we believe that the evaluation methods could be applied to more general Deep Learning tasks, where difficulties might include (a) a lack of dataset specificity (and the metadata related with it), (b) inadequate description of the DL methodology, (c) the implementation methodology, and the infrastructure used. We also feel that these recommendations can be extended to other domains such as medical, climatic, biodiversity, industrial, military, etc.

Suggestions

Du même auteur

Mitigation Strategies to Improve Reproducibility of Poverty Estimations From Remote Sensing Images Using Deep Learning

Archive ouverte | Machicao, Jeaneth | CCSD

International audience. The challenges of Reproducibility and Replicability (R & R) in computer science experiments have become a focus of attention in the last decade, as efforts to adhere to good research practice...

Reproducing Deep Learning experiments: common challenges and recommendations for improvement

Archive ouverte | Machicao, Jeaneth | CCSD

IDW 2022 was hosted in Seoul, the Republic of Korea, by the Korea Institute of Science and Technology Information (KISTI), committed by the Ministry of Science and ICT, Seoul Metropolitan Government, National Library of Korea, and...

Data dictionary cookbook for research data and software interoperability at global scale

Archive ouverte | David, Romain | CCSD

International audience. We are now facing profound changes (biodiversity, climate, pandemic, etc.). Human impacts and their mitigation will depend on our ability to mobilize research at the global level. The sustain...

Chargement des enrichissements...