PulseAugur
实时 12:32:38
English(EN) Seeing is Free, Speaking is Not: Uncovering the True Energy Bottleneck in Edge VLM Inference

研究发现:边缘VLM的能源消耗由输出驱动,而非输入

一项新研究表明,边缘设备上视觉语言模型(VLM)的能源消耗主要由生成的输出量驱动,而非视觉输入的复杂性。研究人员发现,生成每个输出令牌比处理输入令牌花费的时间更长,消耗的能源也更多。这表明,减少VLM能源消耗的努力应侧重于控制输出长度,因为即使消除视觉输入处理,能源节省也微乎其微。 AI

影响 专注于VLM的输出长度控制可以显著降低边缘设备的能源消耗。

排序理由 该集群包含一篇详细介绍VLM能源消耗研究结果的论文。

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

研究发现:边缘VLM的能源消耗由输出驱动,而非输入

报道来源 [3]

  1. arXiv cs.AI TIER_1 English(EN) · Junfei Zhan, Haoxun Shen, Mingang Guo, Zixuan Huang, Tengjiao He ·

    Seeing is Free, Speaking is Not: Uncovering the True Energy Bottleneck in Edge VLM Inference

    arXiv:2607.09520v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are the perceptual backbone of embodied AI, but their energy footprint on edge hardware remains poorly understood. Existing efficiency efforts focus predominantly on reducing visual tokens, implicitly…

  2. arXiv cs.AI TIER_1 English(EN) · Tengjiao He ·

    视觉免费,语音收费:揭示边缘VLM推理的真正能源瓶颈

    Vision-Language Models (VLMs) are the perceptual backbone of embodied AI, but their energy footprint on edge hardware remains poorly understood. Existing efficiency efforts focus predominantly on reducing visual tokens, implicitly treating visual processing as the dominant energy…

  3. Hugging Face Daily Papers TIER_1 English(EN) ·

    EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI

    Convolutional neural networks (CNNs) have demonstrated encouraging results in image classification tasks. However, the prohibitive computational cost of CNNs hinders the deployment of CNNs onto resource-constrained embedded devices. To address this issue, we propose EdgeCompress,…