PulseAugur
EN
LIVE 19:43:35

New UPMs enable collaborative AI training without weight extraction

Researchers have introduced Unextractable Protocol Models (UPMs), a new framework for collaborative training and inference of neural networks where individual participants only process subsets of the model. This approach ensures that a complete set of model weights is never available to any single entity by periodically injecting time-varying transforms. UPMs demonstrate minimal impact on perplexity and add only a small overhead in latency, bandwidth, and memory during inference and training. AI

IMPACT Enables secure collaborative AI development by preventing model extraction, potentially facilitating community-driven training initiatives.

RANK_REASON Academic paper detailing a novel method for AI model training and inference.

Read on arXiv cs.LG →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

COVERAGE [2]

  1. arXiv cs.LG TIER_1 · Alexander Long, Chamin Hewa Koneputugodage, Thalaiyasingam Ajanthan, Yan Zuo, Gil Avraham, Violetta Shevchenko, Hadi Mohaghegh Dolatabadi, Sameera Ramasinghe ·

    Unextractable Protocol Models: Collaborative Training and Inference without Weight Materialization

    arXiv:2605.23464v1 Announce Type: new Abstract: We consider a decentralized setup in which the participants collaboratively train and serve a large neural network, and where each participant only processes a subset of the model. In this setup, we explore the possibility of unmate…

  2. arXiv cs.LG TIER_1 · Sameera Ramasinghe ·

    Unextractable Protocol Models: Collaborative Training and Inference without Weight Materialization

    We consider a decentralized setup in which the participants collaboratively train and serve a large neural network, and where each participant only processes a subset of the model. In this setup, we explore the possibility of unmaterializable weights, where a full weight set is n…