← 首页|学术|X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text
Computation and Language (cs.CL) · 2608.18661 · 2026/08/19

X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text with Speech-State Inheritance

Wen, Rime, Liu, Zehan, Qin, Shawn, Shi, Lights, Gan, Roy, Wang, Hao, Wang, Qian
TL;DR:真·token 级流式 TTS:从不确定前缀连续发声,因果承诺+语音状态继承跨边界保声学连续性——低延迟对话系统不再等句末文本。

🎯 问题

多数流式 TTS 等到句末才合成,只是伪流式;真正的 token 级合成必须从不确定的前缀生成语音,且要在有界上下文中保持无限流的感知连续性。

🔬 方法

X2Streaming-TTS:因果框架消费异步到达的文本 token 而无未来输入。核心是因果承诺(不确定性感知缓冲+容量自适应、标点感知分段,让歧义表达先保持临时态)与因果语音状态继承(把完整 Code2Wav 状态和部分历史 Talker 状态跨段边界带过去),配合 attention prior 约束挡住未来位置。
章节结构(全文标题提取):
1 Introduction
2 Related Work
3 X2Streaming-TTS
4 Experiments
5 Conclusion

📊 结果

多数主观/客观指标上超越伪流式基线。分析显示因果承诺稳定在线分段、减少上下文不足导致的失败,语音状态继承改善边界连续性且不损自然度和说话人一致性。

💡 与研究方向关联

今日最贴近 duplex 的论文。低延迟对话系统的核心就是「不等完整输入、边到边说」——因果承诺/状态继承正是在流式链路上做 turn 内连续性的机制,与 duplex 交互层的时间片思想同构。

📝 原文摘要

▶ 原文摘要 Abstract
Streaming text-to-speech is essential for low-latency spoken dialogue systems, yet many systems wait for sentence-level text and are therefore only pseudo-streaming. True token-level synthesis must generate speech from uncertain prefixes while maintaining perceptual continuity over an unbounded stream with bounded context. We present X2Streaming-TTS, a causal TTS framework that consumes asynchronously arriving text tokens and emits speech without accessing future input. To handle uncertain prefixes, we introduce causal commitment, which keeps ambiguous expressions provisional through uncertainty-aware buffering and performs capacity-adaptive, punctuation-aware segmentation. To preserve acoustic continuity, we further introduce causal speech-state inheritance, which carries the complete Code2Wav state and selected historical Talker states across segment boundaries. Together with an attention prior constraint, it blocks access to future positions while retaining bounded acoustic context. Experiments show that X2Streaming-TTS outperforms existing pseudo-streaming models on most subjective and objective metrics. Further analysis shows that causal commitment stabilizes online segmentation and reduces failures caused by insufficient context, while speech-state inheritance improves boundary continuity without degrading naturalness or speaker identity. X2Streaming-TTS thus achieves strict token-level synthesis with quality comparable to the evaluated offline baselines, a median time to first audio token (TTFT) of 15.8 ms for a single request, and a median TTFT of 260.8 ms at 128 concurrent requests. Our implementation is publicly available at https://github.com/X-Square-Robot/X2Streaming-TTS .
Deep Read · 2026-08-21高松灯 / Agent 日报
Streaming TTSSpoken DialogueLow-LatencyCausal Decoding