New directions for deep learning in cancer research through concept explainability and virtual experimentation.

HORIZON.1.1HORIZON-ERCID: 101114631
EC Contribution
€14,988
Consortium Size
1 orgs
Summary

Deep learning (DL) is rapidly transforming cancer research and oncology. DL can extract subtle visual features from preclinical and clinical image data. In my junior research group, I have developed end-to-end DL methods to predict molecular biomarkers and clinical outcomes directly from histopathology slides. Because histopathology slides are ubiquitously available for any patient with a solid tumor, DL is a broad tool for translational studies, enabling researchers to extract molecular information and make predictions about clinical outcome.However, the potential of DL in cancer research is fundamentally limited because it is purely descriptive and, in many cases, a black-box system. Also, DL is currently disjoint from the vast amount of biological mechanistic knowledge in cancer research, and from the world of experimentation. In NADIR, I will close this gap. My hypothesis is that DL models can not only make predictions but can be used to verifyexisting biological knowledge and to make new mechanistic discoveries. The main tools that allow me to address this are concept explainability and counterfactual virtual experimentation. For both, there exists a nonmedical proof of concept, but no systematic biomedical application yet. I approach this problem as a biomedical cancer researcher with training in programming, medical image analysis, and biomedical engineering. As such, I will develop DL systems that can extract biological concepts, can elucidate biological mechanisms, and can be used to create, and answer, mechanistic hypotheses. NADIR’s tools will be synergistic with and can be used together with other biological high-throughput experimentation pipelines such as transgenic animal experiments or tumor organoid cultures. The main use case of NADIR is focused on tumor-immune interaction in colorectal and gastric cancer, and through the educational and outreach program in NADIR, it will be made available as a general tool for cancer researchers in biomedicine.

Consortium (1)

Project Results (8)

Source: CORDIS, the EU research results database.

Publications (8)
Artificial intelligence-based biomarkers for treatment decisions in oncology
Trends in Cancer· 2025DOI
Marta Ligero, Omar S.M. El Nahhas, Mihaela Aldea, Jakob Nikolas Kather
Artificial intelligence-based biomarkers for treatment decisions in oncology
Trends in Cancer· 2025DOI
Marta Ligero, Omar S.M. El Nahhas, Mihaela Aldea, Jakob Nikolas Kather
Artificial Intelligence for Contrast-Enhanced Ultrasound of the Liver: A Systematic Review
Digestion· 2024DOI
James A. Brooks, Michael Kallenbach, Iuliana-Pompilia Radu, Annalisa Berzigotti, Christoph F. Dietrich, Jakob N. Kather, Tom Luedde, Tobias P. Seraphin
Detection of suicidality from medical text using privacy-preserving large language models
The British Journal of Psychiatry· 2024DOI
Isabella Catharina Wiest, Falk Gerrik Verhees, Dyke Ferber, Jiefu Zhu, Michael Bauer, Ute Lewitzka, Andrea Pfennig, Pavol Mikolas, Jakob Nikolas Kather
Large language models as a diagnostic support tool in neuropathology
The Journal of Pathology: Clinical Research· 2024DOI
Katherine J Hewitt, Isabella C Wiest, Zunamys I Carrero, Laura Bejan, Thomas O Millner, Sebastian Brandner, Jakob Nikolas Kather
Large language models could make natural language again the universal interface of healthcare
Nature Medicine· 2024DOI
Jakob Nikolas Kather, Dyke Ferber, Isabella C. Wiest, Stephen Gilbert, Daniel Truhn
Medical large language models are susceptible to targeted misinformation attacks
npj Digital Medicine· 2024DOI
Tianyu Han, Sven Nebelung, Firas Khader, Tianci Wang, Gustav Müller-Franzes, Christiane Kuhl, Sebastian Försch, Jens Kleesiek, Christoph Haarburger, Keno K. Bressem, Jakob Nikolas Kather, Daniel Truhn
The age of foundation models
Nature Reviews Clinical Oncology· 2024DOI
Jana Lipkova, Jakob Nikolas Kather