Skip to content

Section A.17, formula 17. #2

@1zzt

Description

@1zzt

I was studying your paper/code and had a question regarding Section A.17, formula 17. When I try to apply the formula, the resulting attention score matrix does not have rows or columns that sum to 1, which is different from standard attention matrices. Could you please clarify if I am misunderstanding something, or if there is an additional normalization step required to ensure each row/column sums to 1?

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions