This reverts commit 30a5f2a9.

Reverted https://github.com/pytorch/pytorch/pull/81442 on behalf of https://github.com/malfet due to Actually broke runs, see details in https://github.com/pytorch/pytorch/pull/81044