TP Moe and TP+EP MOE support #13
Description
Hello,
Is there a plan to add support for TP and hybrid TP+EP parallelisms to those MOE comm kernels?
Thank you!
Nicolas
{{ message }}
Hello,
Is there a plan to add support for TP and hybrid TP+EP parallelisms to those MOE comm kernels?
Thank you!
Nicolas