I-Segmenter: Integer-Only Vision Transformer for Efficient Semantic Segmentation
Researchers have developed I-Segmenter, a novel framework that enables Vision Transformers (ViTs) for semantic segmentation to operate entirely with integers. This approach significantly reduces the memory footprint and computational cost associated with ViTs, making them more suitable for resource-constrained devices. The system incorporates a new activation function, \u03bb-ShiftGELU, to improve stability during quantization and replaces certain operations to maintain an integer-only execution path. Experiments demonstrate that I-Segmenter achieves competitive accuracy compared to its floating-point counterpart while offering substantial reductions in model size and faster inference speeds. AI
IMPACT Enables efficient deployment of advanced segmentation models on edge devices, broadening AI accessibility.