Fix TransformerConfig validation for mixed dense/MoE upcycling#3647

Open

rkteddy wants to merge 2 commits intoNVIDIA:mainfrom

rkteddy:fix/transformer-config-dense-moe-ffn

Commits on Mar 1, 2026

Fix TransformerConfig validation for mixed dense/MoE upcycling
rkteddy
committed

Commits on Mar 2, 2026

Improve moe_ffn_hidden_size validation: check moe_layer_freq and raise ValueError for invalid config
rkteddy
committed