Release v1.0.1 - A Whole New Library! · KeremTurgutlu/self_supervised

By GitHub - 2021-03-15

Description

Self-Supervised Learning Algorithms Extension to Fastai - KeremTurgutlu/self_supervised

Summary

  • Algorithms Augmentations New augmentations module offers helpers for easily constructing augmentation pipelines for self supervised algorithms.
  • CLIP-MoCo A custom implementation which combines CLIP with MoCo Queue implementation to reduce the requirement for using large batch sizes during training.
  • Fastai Upgrade Changes are compatible with latest fastai release.
  • MoCo V1 & V2 (Single and Multi GPU Support) Similar to SimCLR, it's pretty simple to switch from MoCo v1 to v2 using the parts of the library since core algorithm / loss function stays the same.

 

Topics

  1. Management (0.13)
  2. NLP (0.1)
  3. Machine_Learning (0.1)

Similar Articles

What’s new in TensorFlow 2.4?

By tensorflow - 2020-12-14

TensorFlow 2.4 is here! With increased support for distributed training and mixed precision, and tools for monitoring and diagnosing bottlenecks, this

Introducing spaCy v3.0 nightly

By Explosion - 2020-10-15

spaCy v3.0 is going to be a huge release! It features new transformer-based pipelines that get spaCy's accuracy right up to the current state-of-the-art, and a new workflow system to help you take pro ...