Description
TensorFlow 2.4 is here! With increased support for distributed training and mixed precision, and tools for monitoring and diagnosing bottlenecks, this
Summary
- December 14, 2020 — Posted by Goldie Gadde and Nikita Namjoshi for the TensorFlow Team TF 2.4 is here!
- These changes are intended to make both Model.fit and custom training loops more agnostic to optimizer details, allowing you to write training code that works with any optimizer without modification.
- In 2.4 you can now profile MultiWorkerMirroredStrategy training jobs.
- After profiling, you can use the new Pod Viewer tool to choose a training step and view its step-time category breakdown across all workers.