DualBudget

New DualBudget method optimizes long-context text processing

Researchers have introduced a novel approach called DualBudget for processing long-context text, which manages computational costs by separating them into two distinct budgets: the attention graph's available edges and …