For me, the goal of this project was to handle transformers fine tuning by implementing and applying optimization training techniques using limited computational resources.
-
Updated
Sep 3, 2023 - Python
For me, the goal of this project was to handle transformers fine tuning by implementing and applying optimization training techniques using limited computational resources.
GPU memory-efficient training for PyTorch - 90%+ memory savings through gradient compression
Add a description, image, and links to the training-optimization topic page so that developers can more easily learn about it.
To associate your repository with the training-optimization topic, visit your repo's landing page and select "manage topics."