Benchmarking large language models and clinicians using locally generated primary healthcare vignettes in Kenya

Alastair K Denniston, Xiaoxuan Liu, Ambrose Agweyu, Paul Mwaniki, Vaishnavi Menon, Bilal Akhter Mateen, Lynda Isaaka, Conrad Wanyama, Mira Emmanuel-Fabula, Wilkister Musau, Gwydion Williams

Open source

DOI: 10.1136/bmjdh-2026-000081
Published: July
Container: BMJ Digital Health & AI
Publisher: Not recorded
Open access: yes

Credibility signals

uncertain Score 53/100 under policy 1.0.0. This is a metadata assessment, not a judgment of the paper's conclusions.

Show all credibility signals

cautionDOI registered: No matching Crossref record was present in this response. Source: Crossref; license: CC0 metadata
cautionDOI resolves: No matching Crossref record was present in this response. Source: Crossref; license: CC0 metadata
supportingDirectory of Open Access Journals: A matching record was returned by DOAJ. Source: DOAJ; license: CC0
not scoredMEDLINE indexed: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredOpenAlex core source: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredKnown publisher allow-list: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredROR affiliation: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredRetraction Watch retraction: No retraction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch expression of concern: No expression of concern notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch correction: No correction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch reinstatement: No reinstatement notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
supportingOpen access status: Normalized open-access status: open. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer
not scoredPublication license: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredPublication version: A publication version was supplied but is not scored. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer
cautionMetadata completeness: 5 of 6 scored descriptive metadata groups are present; missing fields increase uncertainty. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer

Cite this work

BibTeX

@article{allodium:10.1136/bmjdh-2026-000081,
  title = {Benchmarking large language models and clinicians using locally generated primary healthcare vignettes in Kenya},
  author = {Alastair K Denniston and Xiaoxuan Liu and Ambrose Agweyu and Paul Mwaniki and Vaishnavi Menon and Bilal Akhter Mateen and Lynda Isaaka and Conrad Wanyama and Mira Emmanuel-Fabula and Wilkister Musau and Gwydion Williams},
  year = {2026},
  journal = {BMJ Digital Health \& AI},
  doi = {10.1136/bmjdh-2026-000081},
  url = {https://doi.org/10.1136/bmjdh-2026-000081}
}

RIS

TY  - JOUR
TI  - Benchmarking large language models and clinicians using locally generated primary healthcare vignettes in Kenya
AU  - Alastair K Denniston
AU  - Xiaoxuan Liu
AU  - Ambrose Agweyu
AU  - Paul Mwaniki
AU  - Vaishnavi Menon
AU  - Bilal Akhter Mateen
AU  - Lynda Isaaka
AU  - Conrad Wanyama
AU  - Mira Emmanuel-Fabula
AU  - Wilkister Musau
AU  - Gwydion Williams
PY  - 2026
JO  - BMJ Digital Health & AI
DO  - 10.1136/bmjdh-2026-000081
UR  - https://doi.org/10.1136/bmjdh-2026-000081
ER  -

APA

Denniston, A. K., Liu, X., Agweyu, A., Mwaniki, P., Menon, V., Mateen, B. A., Isaaka, L., Wanyama, C., Emmanuel-Fabula, M., Musau, W., & Williams, G. (2026). Benchmarking large language models and clinicians using locally generated primary healthcare vignettes in Kenya. BMJ Digital Health & AI. https://doi.org/10.1136/bmjdh-2026-000081

Source records

doaj · retrieved 2026-09-26T05:15:48.263Z