About weight clipping

[SShock92]

Thanks for sharing such a nice work!

I figured out that the weight clipping has NOT been applied to the query and key projection layers when setting clip_version: v1.
Is there any reason for this?