Skip to content

Try out different quant scheme #9

@rdaly525

Description

@rdaly525

A quant scheme that james/someone else at occulus suggested:

Use normal L2 regularization.
Quantize each weight to either -1 or 1 with probability proportional to the current weight.
FOr example: If W = -0.5, set W = -1 with 75% probility and W = 1 with 25% probability.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions