Description
The future of AI is in creating systems that can learn directly from whatever information they’re given — whether it’s text, images, or another type of...
Summary
- RESEARCH COMPUTER VISION SEER: Self-supervised computer vision in the real world Our work with SEER parallels work done in NLP, where state-of-the-art models now regularly use trillions of parameters and data sets with trillions of words of text for pretraining.
- Furthermore, the same concept will vary greatly between images, such as with a cat in different poses or viewed from different angles.
- Fortunately, recent progress by Facebook AI and others in the fields of self-supervised learning and ConvNet architecture design has finally made it possible to apply these ideas to computer vision — though we still needed to overcome several challenges, not least of which was the compute capabilities required.