-
Notifications
You must be signed in to change notification settings - Fork 25.1k
Open
Labels
featureA request for a proper, new feature.A request for a proper, new feature.module: distributionsRelated to torch.distributionsRelated to torch.distributionstriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
Description
🚀 Feature
Implement truncated normal distribution.
Motivation
A truncated normal distribution is useful as initializer of weights or when sampling from ReLU potentials. This has been requested before (#2129, https://discuss.pytorch.org/t/implementing-truncated-normal-initializer/4778/15, etc.).
Many packages have this: scipy, matlab, R, julia, tensorflow, and others.
cc @vincentqb @fritzo @neerajprad @alicanb @vishwakftw
Related: #31945
tranhungnghiep, adamconkey, muupan, imflash217, wallyxie and 6 moretranhungnghiep
Metadata
Metadata
Assignees
Labels
featureA request for a proper, new feature.A request for a proper, new feature.module: distributionsRelated to torch.distributionsRelated to torch.distributionstriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate module