Understanding metric-related pitfalls in image analysis validation

Annika Reinke, Minu D. Tizabi, Michael Baumgartner, Matthias Eisenmann, Doreen Heckmann-Nötzel, A. Emre Kavur, Tim Rädsch, Carole H. Sudre, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Arriel Benis, Florian Buettner, M. Jorge Cardoso, Veronika Cheplygina, Jianxu Chen, Evangelia Christodoulou, Beth A. Cimini, Keyvan Farahani, Luciana Ferrer, Adrian Galdran, Bram van Ginneken, Ben Glocker, Patrick Godau, Daniel A. Hashimoto, Michael M. Hoffman, Merel Huisman, Fabian Isensee, Pierre Jannin, Charles E. Kahn, Dagmar Kainmueller, Bernhard Kainz, Alexandros Karargyris, Jens Kleesiek, Florian Kofler, Thijs Kooi, Annette Kopp-Schneider, Michal Kozubek, Anna Kreshuk, Tahsin Kurc, Bennett A. Landman, Geert Litjens, Amin Madani, Klaus Maier-Hein, Anne L. Martel, Erik Meijering, Bjoern Menze, Karel G. M. Moons, Henning Müller, Brennan Nichyporuk, Felix Nickel, Jens Petersen, Susanne M. Rafelski, Nasir Rajpoot, Mauricio Reyes, Michael A. Riegler, Nicola Rieke, Julio Saez-Rodriguez, Clara I. Sánchez, Shravya Shetty, Ronald M. Summers, Abdel A. Taha, Aleksei Tiulpin, Sotirios A. Tsaftaris, Ben Van Calster, Gaël Varoquaux, Ziv R. Yaniv, Paul F. Jäger, Lena Maier-Hein

Open source

DOI
10.1038/s41592-023-02150-0
Published
2024-02
Container
Nature Methods
Publisher
Springer Science and Business Media LLC
Open access
unknown

Credibility signals

uncertain Score 64/100 under policy 1.0.0. This is a metadata assessment, not a judgment of the paper's conclusions.

Show all credibility signals

Cite this work

BibTeX

@article{allodium:10.1038/s41592-023-02150-0,
  title = {Understanding metric-related pitfalls in image analysis validation},
  author = {Annika Reinke and Minu D. Tizabi and Michael Baumgartner and Matthias Eisenmann and Doreen Heckmann-Nötzel and A. Emre Kavur and Tim Rädsch and Carole H. Sudre and Laura Acion and Michela Antonelli and Tal Arbel and Spyridon Bakas and Arriel Benis and Florian Buettner and M. Jorge Cardoso and Veronika Cheplygina and Jianxu Chen and Evangelia Christodoulou and Beth A. Cimini and Keyvan Farahani and Luciana Ferrer and Adrian Galdran and Bram van Ginneken and Ben Glocker and Patrick Godau and Daniel A. Hashimoto and Michael M. Hoffman and Merel Huisman and Fabian Isensee and Pierre Jannin and Charles E. Kahn and Dagmar Kainmueller and Bernhard Kainz and Alexandros Karargyris and Jens Kleesiek and Florian Kofler and Thijs Kooi and Annette Kopp-Schneider and Michal Kozubek and Anna Kreshuk and Tahsin Kurc and Bennett A. Landman and Geert Litjens and Amin Madani and Klaus Maier-Hein and Anne L. Martel and Erik Meijering and Bjoern Menze and Karel G. M. Moons and Henning Müller and Brennan Nichyporuk and Felix Nickel and Jens Petersen and Susanne M. Rafelski and Nasir Rajpoot and Mauricio Reyes and Michael A. Riegler and Nicola Rieke and Julio Saez-Rodriguez and Clara I. Sánchez and Shravya Shetty and Ronald M. Summers and Abdel A. Taha and Aleksei Tiulpin and Sotirios A. Tsaftaris and Ben Van Calster and Gaël Varoquaux and Ziv R. Yaniv and Paul F. Jäger and Lena Maier-Hein},
  year = {2024},
  journal = {Nature Methods},
  doi = {10.1038/s41592-023-02150-0},
  url = {https://doi.org/10.1038/s41592-023-02150-0}
}

RIS

TY  - JOUR
TI  - Understanding metric-related pitfalls in image analysis validation
AU  - Annika Reinke
AU  - Minu D. Tizabi
AU  - Michael Baumgartner
AU  - Matthias Eisenmann
AU  - Doreen Heckmann-Nötzel
AU  - A. Emre Kavur
AU  - Tim Rädsch
AU  - Carole H. Sudre
AU  - Laura Acion
AU  - Michela Antonelli
AU  - Tal Arbel
AU  - Spyridon Bakas
AU  - Arriel Benis
AU  - Florian Buettner
AU  - M. Jorge Cardoso
AU  - Veronika Cheplygina
AU  - Jianxu Chen
AU  - Evangelia Christodoulou
AU  - Beth A. Cimini
AU  - Keyvan Farahani
AU  - Luciana Ferrer
AU  - Adrian Galdran
AU  - Bram van Ginneken
AU  - Ben Glocker
AU  - Patrick Godau
AU  - Daniel A. Hashimoto
AU  - Michael M. Hoffman
AU  - Merel Huisman
AU  - Fabian Isensee
AU  - Pierre Jannin
AU  - Charles E. Kahn
AU  - Dagmar Kainmueller
AU  - Bernhard Kainz
AU  - Alexandros Karargyris
AU  - Jens Kleesiek
AU  - Florian Kofler
AU  - Thijs Kooi
AU  - Annette Kopp-Schneider
AU  - Michal Kozubek
AU  - Anna Kreshuk
AU  - Tahsin Kurc
AU  - Bennett A. Landman
AU  - Geert Litjens
AU  - Amin Madani
AU  - Klaus Maier-Hein
AU  - Anne L. Martel
AU  - Erik Meijering
AU  - Bjoern Menze
AU  - Karel G. M. Moons
AU  - Henning Müller
AU  - Brennan Nichyporuk
AU  - Felix Nickel
AU  - Jens Petersen
AU  - Susanne M. Rafelski
AU  - Nasir Rajpoot
AU  - Mauricio Reyes
AU  - Michael A. Riegler
AU  - Nicola Rieke
AU  - Julio Saez-Rodriguez
AU  - Clara I. Sánchez
AU  - Shravya Shetty
AU  - Ronald M. Summers
AU  - Abdel A. Taha
AU  - Aleksei Tiulpin
AU  - Sotirios A. Tsaftaris
AU  - Ben Van Calster
AU  - Gaël Varoquaux
AU  - Ziv R. Yaniv
AU  - Paul F. Jäger
AU  - Lena Maier-Hein
PY  - 2024
JO  - Nature Methods
DO  - 10.1038/s41592-023-02150-0
UR  - https://doi.org/10.1038/s41592-023-02150-0
ER  -

APA

Reinke, A., Tizabi, M. D., Baumgartner, M., Eisenmann, M., Heckmann-Nötzel, D., Kavur, A. E., Rädsch, T., Sudre, C. H., Acion, L., Antonelli, M., Arbel, T., Bakas, S., Benis, A., Buettner, F., Cardoso, M. J., Cheplygina, V., Chen, J., Christodoulou, E., Cimini, B. A., Farahani, K., Ferrer, L., Galdran, A., Ginneken, B. V., Glocker, B., Godau, P., Hashimoto, D. A., Hoffman, M. M., Huisman, M., Isensee, F., Jannin, P., Kahn, C. E., Kainmueller, D., Kainz, B., Karargyris, A., Kleesiek, J., Kofler, F., Kooi, T., Kopp-Schneider, A., Kozubek, M., Kreshuk, A., Kurc, T., Landman, B. A., Litjens, G., Madani, A., Maier-Hein, K., Martel, A. L., Meijering, E., Menze, B., Moons, K. G. M., Müller, H., Nichyporuk, B., Nickel, F., Petersen, J., Rafelski, S. M., Rajpoot, N., Reyes, M., Riegler, M. A., Rieke, N., Saez-Rodriguez, J., Sánchez, C. I., Shetty, S., Summers, R. M., Taha, A. A., Tiulpin, A., Tsaftaris, S. A., Calster, B. V., Varoquaux, G., Yaniv, Z. R., Jäger, P. F., & Maier-Hein, L. (2024). Understanding metric-related pitfalls in image analysis validation. Nature Methods. https://doi.org/10.1038/s41592-023-02150-0

Source records