New framework unifies CNNs and Transformers via k-nearest neighbors

Researchers have introduced Convolutional Nearest Neighbors (ConvNN), a novel framework that unifies convolutional neural networks (CNNs) and transformers. The paper argues that both architectures are special cases of k-nearest neighbor aggregation, differing in how neighbors are selected: CNNs use spatial proximity, while transformers use feature similarity. ConvNN allows for a continuous spectrum between local and global aggregation by configuring similarity functions and neighbor selection strategies. AI

IMPACT This research proposes a unified framework for computer vision architectures, potentially simplifying model design and enabling new hybrid approaches.

RANK_REASON The cluster contains an academic paper detailing a new research framework. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• arXiv
• Convolutional Nearest Neighbors
• k-nearest neighbors algorithm
• KVT-attention
• Transformers

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →