https://ai.facebook.com/blog/computer-vision-combining-transformers-and-convolutional-neural-networks/
Better computer vision models by combining Transformers and convolutional neural networks
July 8, 2021
“We’ve developed a new computer vision model… which combines… convolutional neural networks (CNNs) and Transformer-based models… By leveraging both techniques, this vision Transformer-based model can outperform existing architectures, especially in the low data regime, while achieving similar performance in the large data setting.”