This repository compares the PyTorch 1.13.1 default linear parameter initialization scheme with the He approach. It accompanies one of the posts on my blog, which you can find here.
-
Notifications
You must be signed in to change notification settings - Fork 0
pfrendl/pytorch_linear_init
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
An experiment of the PyTorch 1.13.1 linear parameter init variance preserving properties against the He approach.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published