Metrics reloaded: recommendations for image analysis validation.

Maier-Hein L, Reinke A, Godau P, Tizabi MD, Buettner F, Christodoulou E, Glocker B, Isensee F, Kleesiek J, Kozubek M, Reyes M, Riegler MA, Wiesenfarth M, Kavur AE, Sudre CH, Baumgartner M, Eisenmann M, Heckmann-Nötzel D, Rädsch T, Acion L, Antonelli M, Arbel T, Bakas S, Benis A, Blaschko MB, Cardoso MJ, Cheplygina V, Cimini BA, Collins GS, Farahani K, Ferrer L, Galdran A, van Ginneken B, Haase R, Hashimoto DA, Hoffman MM, Huisman M, Jannin P, Kahn CE, Kainmueller D, Kainz B, Karargyris A, Karthikesalingam A, Kofler F, Kopp-Schneider A, Kreshuk A, Kurc T, Landman BA, Litjens G, Madani A, Maier-Hein K, Martel AL, Mattson P, Meijering E, Menze B, Moons KGM, Müller H, Nichyporuk B, Nickel F, Petersen J, Rajpoot N, Rieke N, Saez-Rodriguez J, Sánchez CI, Shetty S, van Smeden M, Summers RM, Taha AA, Tiulpin A, Tsaftaris SA, Van Calster B, Varoquaux G, Jäger PF

Open source

DOI: 10.1038/s41592-023-02151-z
Published: 2024 Feb
Container: Nature methods
Publisher: Not recorded
Open access: yes

Credibility signals

limited evidence Score 45/100 under policy 1.0.0. This is a metadata assessment, not a judgment of the paper's conclusions.

Show all credibility signals

cautionDOI registered: No matching Crossref record was present in this response. Source: Crossref; license: CC0 metadata
cautionDOI resolves: No matching Crossref record was present in this response. Source: Crossref; license: CC0 metadata
not scoredDirectory of Open Access Journals: No matching DOAJ record was present in this response. No allow-list match; this is not evidence of low credibility. Source: DOAJ; license: CC0
not scoredMEDLINE indexed: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredOpenAlex core source: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredKnown publisher allow-list: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredROR affiliation: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredRetraction Watch retraction: No retraction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch expression of concern: No expression of concern notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch correction: No correction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch reinstatement: No reinstatement notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
supportingOpen access status: Normalized open-access status: open. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer
not scoredPublication license: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredPublication version: A publication version was supplied but is not scored. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer
cautionMetadata completeness: 5 of 6 scored descriptive metadata groups are present; missing fields increase uncertainty. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer

Cite this work

BibTeX

@article{allodium:10.1038/s41592-023-02151-z,
  title = {Metrics reloaded: recommendations for image analysis validation.},
  author = {Maier-Hein L and Reinke A and Godau P and Tizabi MD and Buettner F and Christodoulou E and Glocker B and Isensee F and Kleesiek J and Kozubek M and Reyes M and Riegler MA and Wiesenfarth M and Kavur AE and Sudre CH and Baumgartner M and Eisenmann M and Heckmann-Nötzel D and Rädsch T and Acion L and Antonelli M and Arbel T and Bakas S and Benis A and Blaschko MB and Cardoso MJ and Cheplygina V and Cimini BA and Collins GS and Farahani K and Ferrer L and Galdran A and van Ginneken B and Haase R and Hashimoto DA and Hoffman MM and Huisman M and Jannin P and Kahn CE and Kainmueller D and Kainz B and Karargyris A and Karthikesalingam A and Kofler F and Kopp-Schneider A and Kreshuk A and Kurc T and Landman BA and Litjens G and Madani A and Maier-Hein K and Martel AL and Mattson P and Meijering E and Menze B and Moons KGM and Müller H and Nichyporuk B and Nickel F and Petersen J and Rajpoot N and Rieke N and Saez-Rodriguez J and Sánchez CI and Shetty S and van Smeden M and Summers RM and Taha AA and Tiulpin A and Tsaftaris SA and Van Calster B and Varoquaux G and Jäger PF},
  year = {2024},
  journal = {Nature methods},
  doi = {10.1038/s41592-023-02151-z},
  url = {https://doi.org/10.1038/s41592-023-02151-z}
}

RIS

TY  - JOUR
TI  - Metrics reloaded: recommendations for image analysis validation.
AU  - Maier-Hein L
AU  - Reinke A
AU  - Godau P
AU  - Tizabi MD
AU  - Buettner F
AU  - Christodoulou E
AU  - Glocker B
AU  - Isensee F
AU  - Kleesiek J
AU  - Kozubek M
AU  - Reyes M
AU  - Riegler MA
AU  - Wiesenfarth M
AU  - Kavur AE
AU  - Sudre CH
AU  - Baumgartner M
AU  - Eisenmann M
AU  - Heckmann-Nötzel D
AU  - Rädsch T
AU  - Acion L
AU  - Antonelli M
AU  - Arbel T
AU  - Bakas S
AU  - Benis A
AU  - Blaschko MB
AU  - Cardoso MJ
AU  - Cheplygina V
AU  - Cimini BA
AU  - Collins GS
AU  - Farahani K
AU  - Ferrer L
AU  - Galdran A
AU  - van Ginneken B
AU  - Haase R
AU  - Hashimoto DA
AU  - Hoffman MM
AU  - Huisman M
AU  - Jannin P
AU  - Kahn CE
AU  - Kainmueller D
AU  - Kainz B
AU  - Karargyris A
AU  - Karthikesalingam A
AU  - Kofler F
AU  - Kopp-Schneider A
AU  - Kreshuk A
AU  - Kurc T
AU  - Landman BA
AU  - Litjens G
AU  - Madani A
AU  - Maier-Hein K
AU  - Martel AL
AU  - Mattson P
AU  - Meijering E
AU  - Menze B
AU  - Moons KGM
AU  - Müller H
AU  - Nichyporuk B
AU  - Nickel F
AU  - Petersen J
AU  - Rajpoot N
AU  - Rieke N
AU  - Saez-Rodriguez J
AU  - Sánchez CI
AU  - Shetty S
AU  - van Smeden M
AU  - Summers RM
AU  - Taha AA
AU  - Tiulpin A
AU  - Tsaftaris SA
AU  - Van Calster B
AU  - Varoquaux G
AU  - Jäger PF
PY  - 2024
JO  - Nature methods
DO  - 10.1038/s41592-023-02151-z
UR  - https://doi.org/10.1038/s41592-023-02151-z
ER  -

APA

L, M., A, R., P, G., MD, T., F, B., E, C., B, G., F, I., J, K., M, K., M, R., MA, R., M, W., AE, K., CH, S., M, B., M, E., D, H., T, R., L, A., M, A., T, A., S, B., A, B., MB, B., MJ, C., V, C., BA, C., GS, C., K, F., L, F., A, G., B, V. G., R, H., DA, H., MM, H., M, H., P, J., CE, K., D, K., B, K., A, K., A, K., F, K., A, K., A, K., T, K., BA, L., G, L., A, M., K, M., AL, M., P, M., E, M., B, M., KGM, M., H, M., B, N., F, N., J, P., N, R., N, R., J, S., CI, S., S, S., M, V. S., RM, S., AA, T., A, T., SA, T., B, V. C., G, V., & PF, J. (2024). Metrics reloaded: recommendations for image analysis validation.. Nature methods. https://doi.org/10.1038/s41592-023-02151-z

Source records

pubmed · retrieved 2026-09-26T06:17:50.565Z