Skip to content

ENH: warm-up period with exponential moving asgd and switch from sgd to asgd when empirical loss gets higher #9

@npinto

Description

@npinto

The idea is to boost the performance by "disabling" the averaging until it gets useful. start with exp_moving_asgd_step_size=1e-2 ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions