Non-record: 1.1354 BPB — 10L TTT 22ep AdamW Cosine + LeakyReLU(0.5)² + TrigramHash#562
Open
bigbag wants to merge 1 commit intoopenai:mainfrom
Open
Non-record: 1.1354 BPB — 10L TTT 22ep AdamW Cosine + LeakyReLU(0.5)² + TrigramHash#562bigbag wants to merge 1 commit intoopenai:mainfrom
bigbag wants to merge 1 commit intoopenai:mainfrom