Learning rate schedulers

PyTorch Developer Podcast - A podcast by Edward Yang, Team PyTorch

Categories:

Technology

What’s a learning rate? Why might you want to schedule it? How does the LR scheduler API in PyTorch work? What the heck is up with the formula implementation? Why is everything terrible?