The platform aims to solve the rigidity often found in synthetic audio, where minor errors previously required full clip regeneration. Drama 3 introduces audio inpainting, allowing users to isolate specific segments for correction while maintaining the rhythm and mood of the surrounding audio. This capability extends to multi-character scenes, enabling developers to generate interactive dialogue where voices respond to one another within a single, continuous take.
"Voice AI has gotten very good at generating speech. The next step is directing a performance," said Rissa Cao, co-founder and CEO of Fish Audio. The model supports long-form consistency across English, Chinese, Japanese, and Korean, ensuring that character traits remain stable throughout extensive scripts. Shijia Liao, co-founder and chief scientist, noted that the model's architecture analyzes the context on both sides of a target edit to ensure seamless integration of new words.

Comments (0)
No comments yet. Be the first!