TinyViT

New adaptive checkpointing slashes GPU memory for vision model fine-tuning

Researchers have developed an adaptive checkpointing algorithm to reduce the GPU memory required for fine-tuning vision models and vision-language models (VLMs). This method, tested on consumer-grade GPUs with limited V…