Add exponential backoff and some logging to figure out if it's working

Pull Request resolved: https://github.com/pytorch/pytorch/pull/75860

Approved by: https://github.com/seemethere