微信扫码
添加专属顾问
我要投稿
最新开源TTS技术,低延迟实时对话,多场景适配,性能卓越。 核心内容: 1. Orpheus TTS系统简介与性能特点 2. 零样本语音克隆与情感控制功能 3. 示例代码与安装指南
类似人类的语音:自然语调,情感和节奏,优于SOTA封闭源模型
零拍的语音克隆:克隆声音而无需以前的微调
引导的情感和语调:带有简单标签的控制语音和情感特征
低延迟:〜200ms的实时应用程序流延迟,可降低至〜100ms,并使用输入流。
流推理示例
克隆这个仓库
git clone https://github.com/canopyai/Orpheus-TTS.git
导航和安装软件包
cd Orpheus-TTS && pip install orpheus-speech # uses vllm under the hood for fast inference
pip install vllm==0.7.3
VLLM在3月18日推出了一个版本,因此通过恢复到后来 解决了一些错误
pip install orpheus-speech
在下面运行以下示例:
from orpheus_tts import OrpheusModel
import wave
import time
model = OrpheusModel(model_name ="canopylabs/orpheus-tts-0.1-finetune-prod")
prompt = '''Man, the way social media has, um, completely changed how we interact is just wild, right? Like, we're all connected 24/7 but somehow people feel more alone than ever. And don't even get me started on how it's messing with kids' self-esteem and mental health and whatnot.'''
start_time = time.monotonic()
syn_tokens = model.generate_speech(
prompt=prompt,
voice="tara",
)
with wave.open("output.wav", "wb") as wf:
wf.setnchannels(1)
wf.setsampwidth(2)
wf.setframerate(24000)
total_frames = 0
chunk_counter = 0
for audio_chunk in syn_tokens: # output streaming
chunk_counter += 1
frame_count = len(audio_chunk) // (wf.getsampwidth() * wf.getnchannels())
total_frames += frame_count
wf.writeframes(audio_chunk)
duration = total_frames / wf.getframerate()
end_time = time.monotonic()
print(f"It took {end_time - start_time} seconds to generate {duration:.2f} seconds of audio")
https://huggingface.co/spaces/MohamedRashad/Orpheus-TTS
53AI,企业落地大模型首选服务商
产品:场景落地咨询+大模型应用平台+行业解决方案
承诺:免费场景POC验证,效果验证后签署服务协议。零风险落地应用大模型,已交付160+中大型企业
2025-04-28
Spring-ai-Alibaba整合QwQ_32b
2025-04-28
程序员狂喜!DevDocs:开源AI文档神器,自动抓取+整理+喂给AI (MCP加持)
2025-04-28
DeepWiki深度探索:驾驭代码复杂性的AI百科全书
2025-04-28
Agent S2:像人一样操作 GUI,开源 AI 智能体新突破
2025-04-28
杨植麟再掀 AI 风暴!Kimi-Audio 如何让机器听懂人类 “弦外之音”?
2025-04-27
一文了解Text Embedding模型:从text2vec、openai-text embedding到m3e、bge(下)
2025-04-27
精选MCP服务器列表
2025-04-27
Google ADK框架:打造多智能体系统的开源利器
2024-07-25
2025-01-01
2025-01-21
2024-05-06
2024-09-20
2024-07-20
2024-07-11
2024-06-12
2024-08-13
2024-12-26
2025-04-28
2025-04-21
2025-04-19
2025-04-17
2025-04-15
2025-04-13
2025-04-10
2025-04-07