How does AI perform compared to human expert panels in medical Delphi studies? A pilot study through the lens of pathology.

Pantanowitz J, Manko CD, Majewski J, Berbís MA, Farris AB 3rd, Karsan A, Bychkov A, Luna A, Williams B, Delahunt B, Eloy C, McClintock DS, Hollemans E, Tuthill JM, Van der Laak J, Cheng JY, Lennerz JK, Sinard JH, Aneiros-Fernandez J, Calderaro J, Iczkowski KA, Egevad L, Kriegsmann M, Herrmann MD, Salama ME, Del Moral RG, Sirintrapun SJ, Vrbin C, Pantanowitz L, Shen J, Rashidi H

Open source

DOI: 10.1016/j.jpi.2026.100661
Published: 2026 Apr
Container: Journal of pathology informatics
Publisher: Not recorded
Open access: yes

Credibility signals

limited evidence Score 45/100 under policy 1.0.0. This is a metadata assessment, not a judgment of the paper's conclusions.

Show all credibility signals

cautionDOI registered: No matching Crossref record was present in this response. Source: Crossref; license: CC0 metadata
cautionDOI resolves: No matching Crossref record was present in this response. Source: Crossref; license: CC0 metadata
not scoredDirectory of Open Access Journals: No matching DOAJ record was present in this response. No allow-list match; this is not evidence of low credibility. Source: DOAJ; license: CC0
not scoredMEDLINE indexed: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredOpenAlex core source: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredKnown publisher allow-list: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredROR affiliation: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredRetraction Watch retraction: No retraction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch expression of concern: No expression of concern notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch correction: No correction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch reinstatement: No reinstatement notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
supportingOpen access status: Normalized open-access status: open. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer
not scoredPublication license: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredPublication version: A publication version was supplied but is not scored. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer
cautionMetadata completeness: 5 of 6 scored descriptive metadata groups are present; missing fields increase uncertainty. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer

Cite this work

BibTeX

@article{allodium:10.1016/j.jpi.2026.100661,
  title = {How does AI perform compared to human expert panels in medical Delphi studies? A pilot study through the lens of pathology.},
  author = {Pantanowitz J and Manko CD and Majewski J and Berbís MA and Farris AB 3rd and Karsan A and Bychkov A and Luna A and Williams B and Delahunt B and Eloy C and McClintock DS and Hollemans E and Tuthill JM and Van der Laak J and Cheng JY and Lennerz JK and Sinard JH and Aneiros-Fernandez J and Calderaro J and Iczkowski KA and Egevad L and Kriegsmann M and Herrmann MD and Salama ME and Del Moral RG and Sirintrapun SJ and Vrbin C and Pantanowitz L and Shen J and Rashidi H},
  year = {2026},
  journal = {Journal of pathology informatics},
  doi = {10.1016/j.jpi.2026.100661},
  url = {https://doi.org/10.1016/j.jpi.2026.100661}
}

RIS

TY  - JOUR
TI  - How does AI perform compared to human expert panels in medical Delphi studies? A pilot study through the lens of pathology.
AU  - Pantanowitz J
AU  - Manko CD
AU  - Majewski J
AU  - Berbís MA
AU  - Farris AB 3rd
AU  - Karsan A
AU  - Bychkov A
AU  - Luna A
AU  - Williams B
AU  - Delahunt B
AU  - Eloy C
AU  - McClintock DS
AU  - Hollemans E
AU  - Tuthill JM
AU  - Van der Laak J
AU  - Cheng JY
AU  - Lennerz JK
AU  - Sinard JH
AU  - Aneiros-Fernandez J
AU  - Calderaro J
AU  - Iczkowski KA
AU  - Egevad L
AU  - Kriegsmann M
AU  - Herrmann MD
AU  - Salama ME
AU  - Del Moral RG
AU  - Sirintrapun SJ
AU  - Vrbin C
AU  - Pantanowitz L
AU  - Shen J
AU  - Rashidi H
PY  - 2026
JO  - Journal of pathology informatics
DO  - 10.1016/j.jpi.2026.100661
UR  - https://doi.org/10.1016/j.jpi.2026.100661
ER  -

APA

J, P., CD, M., J, M., MA, B., 3rd, F. A., A, K., A, B., A, L., B, W., B, D., C, E., DS, M., E, H., JM, T., J, V. D. L., JY, C., JK, L., JH, S., J, A., J, C., KA, I., L, E., M, K., MD, H., ME, S., RG, D. M., SJ, S., C, V., L, P., J, S., & H, R. (2026). How does AI perform compared to human expert panels in medical Delphi studies? A pilot study through the lens of pathology.. Journal of pathology informatics. https://doi.org/10.1016/j.jpi.2026.100661

Source records

pubmed · retrieved 2026-09-26T03:22:35.924Z