← 首页|学术|FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference
cs.RO · 2608.27384 · 2026-08-27

FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference

Zekai Li, Jiaming Tang, Zhijian Liu
VLA流式解码低延迟具身AI
💬 单卡 30Hz 控制频率、平滑异步执行:FlashVLA 用「流式动作缓冲区」解决 VLA 模型部署时的延迟和异步执行不稳定这两大痛点。

🎯 背景

VLA 模型在机器人操作上前景很好,但真实部署被高推理延迟和不稳定的异步执行卡住了——尤其是基于 flow matching 的 VLA,动作解码需要基于 VLM 上下文做多步迭代。现有高效推理方法能提升控制频率、异步方法能减少执行空闲时间,但很少能同时做到低延迟推理和精确、时间一致的异步执行。

🔬 方法

FlashVLA 维护一个带多个不同噪声水平 chunk 的流式动作缓冲区,用 chunk-wise causal attention 解码,每次推理步只产出一个可执行动作 chunk;这种 chunk-wise 自回归formulation隐式保持了动作连续性,不需要额外的未来状态条件就能实现平滑异步执行。

📊 结果与意义

在大量仿真和真实世界实验中,FlashVLA 大幅提升推理速度同时保持强任务表现,单 GPU 上可达到 ≥30Hz 控制频率、真实部署中异步推理平滑——这种「流式解码+隐式连续性」的思路,和 duplex agent 追求的低延迟流式响应架构在工程范式上高度同构,值得重点关注。
▶ 原文摘要 Abstract
Vision-Language-Action (VLA) models are increasingly promising for robotic manipulation, yet their real-world deployment remains bottlenecked by high inference latency and unstable asynchronous execution. This challenge is particularly pronounced in flow-matching-based VLA models, where action decoding requires multiple iterative steps conditioned on the VLM context. While efficient inference methods improve control frequency and asynchronous methods reduce execution idle time, existing approaches often fail to jointly achieve low-latency inference and accurate, temporally consistent asynchronous execution. We introduce \textbf{FlashVLA}, a streaming action decoding framework that addresses both challenges in a unified formulation. FlashVLA maintains a streaming action buffer with multiple chunks at different noise levels and decodes them using chunk-wise causal attention. This design allows FlashVLA to produce one executable action chunk per inference step. Moreover, its chunk-wise autoregressive formulation implicitly preserves action continuity, enabling smooth asynchronous execution without extra future-state conditioning. Across extensive simulated and real-world experiments, FlashVLA substantially improves inference speed while maintaining strong task performance. It can achieve $\geq$30\,Hz control frequency on a single GPU with smooth asynchronous inference in real-world deployment.
来源:arXiv:2608.27384 · 精读基于摘要与 arXiv HTML/abs 页信息生成,未解析 PDF 全文