what to do if training on JFT-300M is not an option? convnet teachers to the rescue.Now I can train a vision transformer in just 3 days on my local machine using just ImageNet1k? Yes, sign me up!Jan 3, 2021Jan 3, 2021
Published inAnalytics VidhyaUnderstanding the Vision Transformer and Counting Its ParametersTransformers have taken NLP by storm, but they can be adapted for SotA results on computer vision tasks, according to a new paper by…Dec 2, 20203Dec 2, 20203
