Distilling Transformers: A Survey

Jianping Gou, Liyuan Sun, Baosheng Yu, Philip H.S. Torr, Ming-Hsuan Yang, Dacheng Tao

Open source

DOI: 10.1109/tpami.2026.3751310
Published: 2026
Container: IEEE Transactions on Pattern Analysis and Machine Intelligence
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Open access: unknown

Credibility signals

uncertain Score 64/100 under policy 1.0.0. This is a metadata assessment, not a judgment of the paper's conclusions.

Show all credibility signals

supportingDOI registered: A matching record was returned by Crossref. Source: Crossref; license: CC0 metadata
supportingDOI resolves: A matching record was returned by Crossref. Source: Crossref; license: CC0 metadata
not scoredDirectory of Open Access Journals: No matching DOAJ record was present in this response. No allow-list match; this is not evidence of low credibility. Source: DOAJ; license: CC0
not scoredMEDLINE indexed: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredOpenAlex core source: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredKnown publisher allow-list: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredROR affiliation: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredRetraction Watch retraction: No retraction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch expression of concern: No expression of concern notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch correction: No correction notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredRetraction Watch reinstatement: No reinstatement notice matched this DOI in the deployed snapshot. No matching event found; coverage may be incomplete. Source: Retraction Watch; license: CC BY 4.0
not scoredOpen access status: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredPublication license: Not checked or no result supplied; no credibility inference made. Source: No authority result supplied; license: Unknown
not scoredPublication version: A publication version was supplied but is not scored. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer
supportingMetadata completeness: All 6 scored descriptive metadata groups are present. Source: Normalized work metadata; license: Caller-provided; provenance license not supplied to scorer

Cite this work

BibTeX

@article{allodium:10.1109/tpami.2026.3751310,
  title = {Distilling Transformers: A Survey},
  author = {Jianping Gou and Liyuan Sun and Baosheng Yu and Philip H.S. Torr and Ming-Hsuan Yang and Dacheng Tao},
  year = {2026},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  doi = {10.1109/tpami.2026.3751310},
  url = {https://doi.org/10.1109/tpami.2026.3751310}
}

RIS

TY  - JOUR
TI  - Distilling Transformers: A Survey
AU  - Jianping Gou
AU  - Liyuan Sun
AU  - Baosheng Yu
AU  - Philip H.S. Torr
AU  - Ming-Hsuan Yang
AU  - Dacheng Tao
PY  - 2026
JO  - IEEE Transactions on Pattern Analysis and Machine Intelligence
DO  - 10.1109/tpami.2026.3751310
UR  - https://doi.org/10.1109/tpami.2026.3751310
ER  -

APA

Gou, J., Sun, L., Yu, B., Torr, P. H., Yang, M., & Tao, D. (2026). Distilling Transformers: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2026.3751310

Source records

crossref · retrieved 2026-11-08T04:53:57.340Z