Skip to content

GatedAttn + ValueResidual + Full QAT + lzma-9 + BigramHash(2048)#347

Draft
FlashyFlash3011 wants to merge 24 commits intoopenai:mainfrom
FlashyFlash3011:flashyflash3011/long-context-4096-qat-int4-16l
Draft

GatedAttn + ValueResidual + Full QAT + lzma-9 + BigramHash(2048)#347
FlashyFlash3011 wants to merge 24 commits intoopenai:mainfrom
FlashyFlash3011:flashyflash3011/long-context-4096-qat-int4-16l

Commits

Commits on Mar 21, 2026

Commits on Mar 22, 2026

Commits on Mar 24, 2026