Can reproducibility be improved in clinical natural language processing? A study of 7 clinical NLP suites.

Digan W, Névéol A, Neuraz A, Wack M, Baudoin D, Burgun A, Rance B

DOI: 10.1093/jamia/ocaa261
Published: 2021 Mar 1
Container: Journal of the American Medical Informatics Association : JAMIA
Publisher: Not recorded
Open access: yes

Credibility signals

limited evidence Score 45/100 under policy 1.0.0. This is a metadata assessment, not a judgment of the paper's conclusions.

Show all credibility signals

cautionDOI registered: No matching Crossref record was present in this response. Source: Crossref; license: CC0 metadata
cautionDOI resolves: No matching Crossref record was present in this response. Source: Crossref; license: CC0 metadata
not scoredDirectory of Open Access Journals: No matching DOAJ record was present in this response. No allow-list match; this is not evidence of low credibility. Source: DOAJ; license: CC0
not scoredMEDLINE indexed: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredOpenAlex core source: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredKnown publisher allow-list: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredROR affiliation: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredRetraction Watch retraction: No retraction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch expression of concern: No expression of concern notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch correction: No correction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch reinstatement: No reinstatement notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
supportingOpen access status: Normalized open-access status: open. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer
not scoredPublication license: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredPublication version: A publication version was supplied but is not scored. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer
cautionMetadata completeness: 5 of 6 scored descriptive metadata groups are present; missing fields increase uncertainty. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer

Cite this work

BibTeX

@article{allodium:10.1093/jamia/ocaa261,
  title = {Can reproducibility be improved in clinical natural language processing? A study of 7 clinical NLP suites.},
  author = {Digan W and Névéol A and Neuraz A and Wack M and Baudoin D and Burgun A and Rance B},
  year = {2021},
  journal = {Journal of the American Medical Informatics Association : JAMIA},
  doi = {10.1093/jamia/ocaa261},
  url = {https://doi.org/10.1093/jamia/ocaa261}
}

RIS

TY  - JOUR
TI  - Can reproducibility be improved in clinical natural language processing? A study of 7 clinical NLP suites.
AU  - Digan W
AU  - Névéol A
AU  - Neuraz A
AU  - Wack M
AU  - Baudoin D
AU  - Burgun A
AU  - Rance B
PY  - 2021
JO  - Journal of the American Medical Informatics Association : JAMIA
DO  - 10.1093/jamia/ocaa261
UR  - https://doi.org/10.1093/jamia/ocaa261
ER  -

APA

W, D., A, N., A, N., M, W., D, B., A, B., & B, R. (2021). Can reproducibility be improved in clinical natural language processing? A study of 7 clinical NLP suites.. Journal of the American Medical Informatics Association : JAMIA. https://doi.org/10.1093/jamia/ocaa261

Source records

pubmed · retrieved 2026-09-26T19:54:26.060Z