PulseAugur
EN
LIVE 15:05:39

New SmartGR framework boosts generative recommendation model efficiency

Researchers have developed SmartGR, a new knowledge distillation framework designed to improve the efficiency and performance of generative recommendation (GR) models. This framework addresses two key challenges in GR: the varying difficulty of distilling knowledge across a semantic ID (SID) hierarchy and the issue of incorrect prefix pruning during beam search. SmartGR incorporates Hierarchy-Aware SID Distillation and Beam-Aware Ranking Distillation to effectively transfer knowledge from larger models to smaller ones. Experiments show that SmartGR enhances performance by 8.6% and achieves an average inference speedup of 2.39 times across four benchmark datasets. AI

IMPACT Enhances efficiency and performance of generative recommendation models, potentially leading to faster and more accurate personalized suggestions.

RANK_REASON Research paper detailing a new method for improving recommender systems. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.IR (Information Retrieval) →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New SmartGR framework boosts generative recommendation model efficiency

COVERAGE [1]

  1. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Jiawei Chen ·

    SmartGR: Hierarchy and Beam-Aware Knowledge Distillation for Generative Recommendation

    Generative recommendation (GR) has emerged as a promising paradigm for recommender systems. Scaling up GR models can improve recommendation performance, but it also substantially increases inference cost. Knowledge distillation provides a practical solution by transferring knowle…