https://ai.facebook.com/blog/data-efficient-image-transformers-a-promising-new-technique-for-image-classification/
Data-efficient image Transformers: A promising new technique for image classification
December 23, 2020
“We’ve developed a new method to train computer vision models that leverage Transformers…. Our new technique — Data-efficient image Transformers (DeiT) — requires far less data and far less computing resources to produce a high-performance image classification model.”