The post Meta Advances AI Translation with SeamlessM4T: Bridging Language Barriers with Expressiveness and Speed appeared on BitcoinEthereumNews.com.

Meta, the tech conglomerate renowned for its innovations in the digital space, has recently announced a significant advancement in AI translation technology with the introduction of two new features to its SeamlessM4T model. This move marks a substantial step in breaking down language barriers, enabling more natural and expressive cross-lingual conversations. Enhancing expressiveness in translation One of the standout innovations is the introduction of “SeamlessExpressive.” This feature is a breakthrough in translated speech, addressing the longstanding issue of lack of expressiveness in AI translations. Unlike traditional translation tools that often render speech monotone and robotic, SeamlessExpressive brings a range of human-like qualities to translated speech. These include variations in pitch, volume, emotional tone, speech rate, and pauses. With this technology, users can expect their translated speech to convey both words and the emotions and nuances behind them. Currently, SeamlessExpressive supports multiple languages, including English, Spanish, German, French, and Chinese. However, Italian and Chinese were noted to be absent in the initial demo. This feature promises to revolutionize everyday communication and the production of multilingual content, making it more engaging and relatable to diverse audiences. Streamlining real-time translation Another significant enhancement is “SeamlessStreaming.” This feature addresses the challenge of latency often experienced in speech translation. Instead of waiting for a speaker to complete a sentence or a thought, SeamlessStreaming begins translating while the speaker is still talking. Although it has a brief latency of just under two seconds, this is a considerable improvement over previous technologies. This real-time translation capability is particularly crucial in situations where quick information exchange is essential, such as in business meetings, international conferences, or emergency services. Developing SeamlessStreaming required overcoming the challenge of diverse sentence structures in different languages. Meta’s solution was an advanced algorithm capable of analyzing partial audio inputs to determine the optimal moment…

---

Filed under: News - @ December 4, 2023 6:18 am