v0.1.0rc4
Pre-release
Pre-release
·
24 commits
to develop
since this release
What's Changed
- [feat] ucmtrans: Unify API for Device-Host Memory Transfers by @mag1c-h in #379
- [feat] Add support for Ascend device memory transfers by @mag1c-h in #382
- [Fix] fix build, fix no save kv layer by @Lijiachen1018 in #390
- [feat] Add
pcstorefor enhanced PrefixCache performance by @FangRun2 in #393 - [fix] fix ascend attention by @Lijiachen1018 in #394
- release v0.1.0rc3 by @Lijiachen1018 in #395
- [fix] fix sparse attention by @Lijiachen1018 in #397
New Contributors
Full Changelog: v0.1.0rc2...v0.1.0rc4