← 首页|学术|TAMS: Task-Aware Multi-View Adaptive Streaming for Teleoperation
cs.RO cs.MM · 2608.09731 · 2026-08-10

TAMS: Task-Aware Multi-View Adaptive Streaming for Wireless Telerobotic Manipulation

Zexin Deng, Zhenhui Yuan, Lu Tian, Subhash Lakshminarayana, Longhao Zou
TL;DR:无线遥操作依赖多视角视频反馈但上行带宽受限且动态。TAMS 根据操作阶段分配视频码率:从轻量机器人侧信号推断任务阶段,优先操作者最相关的视角。6-DoF 测试台最受限带宽下完成时间 68.9s→43.9s、成功率 48%→71%。

🎯 问题

无线遥操作依赖及时的多视角视频反馈,但可用上行带宽往往受限且动态,如何分配有限带宽成为瓶颈。

🔬 方法

TAMS(Task-Aware Multi-View Adaptive Streaming):根据当前操作阶段分配视频码率。从轻量机器人侧信号推断任务阶段,优先操作者最相关的视角、对次要视角保持基线可见性。
章节结构(全文标题提取):
I Introduction
II System Model and Problem Formulation
III TAMS Design
IV Experimental Methodology
V Results
VI Conclusion
· III-A Overview of TAMS
· III-B Task Phase Inference
· III-C View Weight Determination
· III-D Bitrate Allocation
· IV-A Experimental Use Case and Task
· IV-B Participants
· IV-C Streaming Conditions, Measures, and Analysis
· V-A Bitrate Tracking
· V-B Visual Fidelity
· V-C Task Performance

📊 结果

6-DoF 遥操作测试台、3 种受限网络条件下:主视角 SSIM 提升、任务完成时间减少、成功率提升。最受限带宽下完成时间 68.9s→43.9s(对比平均分配)、成功率 48%→71%。

📝 原文摘要

▶ 原文摘要 Abstract
Wireless telerobotic manipulation relies on timely multi-view video feedback, but the available uplink bandwidth is often limited and dynamic. This paper presents Task-Aware Multi-View Adaptive Streaming (TAMS), a system that allocates video bitrate according to the current manipulation phase. TAMS infers task phase from lightweight robot-side signals and prioritizes the camera view most relevant to the operator while preserving baseline visibility for secondary views. Experiments on a six-degree-of-freedom (6-DoF) teleoperation testbed under three constrained network conditions show that TAMS improves primary view Structural Similarity Index (SSIM), reduces task completion time, and increases trial success rate compared with equal and static allocation baselines. Under the most constrained bandwidth condition, TAMS reduces mean completion time from 68.9 s to 43.9 s relative to equal allocation and increases trial success rate from 48% to 71%. Code is available at: this https URL .
Deep Read · 2026-08-12高松灯 / Agent 日报
TeleoperationStreamingRoboticsSystem