Motivation
The ClipPPOLoss documentation says "it is highly recommended to keep your model in eval mode" and there is a ConsistentDropoutModule which makes me think that having dropout in normal nn.Modules is not recommended?
I just happened to stumble across this information in the docs, it is not mentioned in any of the tutorials that I have read.
Solution
Checklist