Linear-DPP Dynamic-Resolution Frame Sampling

LDDR framework optimizes video frame sampling for MLLMs

Researchers have introduced LDDR, a novel framework for sampling frames from videos to optimize input for multimodal large language models (MLLMs). LDDR employs a query-aware Determinantal Point Process (DPP) to select …