A statistical framework for evaluating the repeatability and reproducibility of large language models
- DOI
- 10.1093/jamia/ocag186
- Published
- 2026-11-05
- Container
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Open access
- unknown
Credibility signals
uncertain Score 64/100 under policy 1.0.0. This is a metadata assessment, not a judgment of the paper's conclusions.
Show all credibility signals
- supportingDOI registered: A matching record was returned by Crossref.
- supportingDOI resolves: A matching record was returned by Crossref.
- not scoredDirectory of Open Access Journals: No matching DOAJ record was present in this response. No allow-list match; this is not evidence of low credibility.
- not scoredMEDLINE indexed: Not checked or no result supplied; no credibility inference made.
- not scoredOpenAlex core source: Not checked or no result supplied; no credibility inference made.
- not scoredKnown publisher allow-list: Not checked or no result supplied; no credibility inference made.
- not scoredROR affiliation: Not checked or no result supplied; no credibility inference made.
- not scoredRetraction Watch retraction: No retraction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete.
- not scoredRetraction Watch expression of concern: No expression of concern notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete.
- not scoredRetraction Watch correction: No correction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete.
- not scoredRetraction Watch reinstatement: No reinstatement notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete.
- not scoredOpen access status: Not checked or no result supplied; no credibility inference made.
- not scoredPublication license: Not checked or no result supplied; no credibility inference made.
- not scoredPublication version: A publication version was supplied but is not scored.
- supportingMetadata completeness: All 6 scored descriptive metadata groups are present.
Cite this work
BibTeX
@article{allodium:10.1093/jamia/ocag186,
title = {A statistical framework for evaluating the repeatability and reproducibility of large language models},
author = {Cathy Shyr and Boyu Ren and Chih-Yuan Hsu and Minh-Ha Nguyen and Mike Enger and Chao Yan and Rory J Tinker and Thomas A Cassini and Rizwan Hamid and Adam Wright and Lisa Bastarache and Josh F Peterson and Bradley A Malin and Hua Xu and Unknown},
year = {2026},
journal = {Journal of the American Medical Informatics Association},
doi = {10.1093/jamia/ocag186},
url = {https://doi.org/10.1093/jamia/ocag186}
}RIS
TY - JOUR TI - A statistical framework for evaluating the repeatability and reproducibility of large language models AU - Cathy Shyr AU - Boyu Ren AU - Chih-Yuan Hsu AU - Minh-Ha Nguyen AU - Mike Enger AU - Chao Yan AU - Rory J Tinker AU - Thomas A Cassini AU - Rizwan Hamid AU - Adam Wright AU - Lisa Bastarache AU - Josh F Peterson AU - Bradley A Malin AU - Hua Xu AU - Unknown PY - 2026 JO - Journal of the American Medical Informatics Association DO - 10.1093/jamia/ocag186 UR - https://doi.org/10.1093/jamia/ocag186 ER -
APA
Shyr, C., Ren, B., Hsu, C., Nguyen, M., Enger, M., Yan, C., Tinker, R. J., Cassini, T. A., Hamid, R., Wright, A., Bastarache, L., Peterson, J. F., Malin, B. A., Xu, H., & Unknown (2026). A statistical framework for evaluating the repeatability and reproducibility of large language models. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocag186
Source records
- crossref · retrieved 2026-11-08T13:22:12.081Z