Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation (NeurIPS 2025)
-
Updated
Sep 26, 2025 - Python
Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation (NeurIPS 2025)
This repository contains the code used for training/fine-tuning the models introduced in the paper "MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers".
Lightweight PyTorch implementation of Mixture-of-Recursions with Expert-Choice & Token-Choice routing | Runs on your laptop!
Add a description, image, and links to the recursive-transformers topic page so that developers can more easily learn about it.
To associate your repository with the recursive-transformers topic, visit your repo's landing page and select "manage topics."