This repository was archived by the owner on Jul 21, 2025. It is now read-only.
This repository was archived by the owner on Jul 21, 2025. It is now read-only.
is Baichuan2 model inference available now? #528
Description
I wonder if the Baichuan2 inference is available now?
If the Baichuan2 inference is available now, may I have a sample code which show to use lightseq to accelerate the Baichuan2 inference?