Skip to content

[Feature Request] Documentation about recommended use of .train() and .eval() #3140

@valterschutz

Description

@valterschutz

Motivation

The ClipPPOLoss documentation says "it is highly recommended to keep your model in eval mode" and there is a ConsistentDropoutModule which makes me think that having dropout in normal nn.Modules is not recommended?

I just happened to stumble across this information in the docs, it is not mentioned in any of the tutorials that I have read.

Solution

Checklist

  • I have checked that there is no similar issue in the repo (required)

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions