Microsoft unveiled its new Interpreter agent earlier this week at Microsoft Ignite.
The tool will give Teams users the option to create a voice profile that could be used by the Interpreter so that its real-time translations would sound just like its associated user.
From early 2025, Microsoft 365 Copilot license holders will have access to the feature in public preview. simulate voices in nine languages, including English, French, German, Italian, Spanish, Portuguese, Japanese, and Mandarin Chinese.
TechCrunch, a technology news publication, referred to a blog post written by Microsoft CMO Jared Spataro, in which he outlined the capability of the Interpreter: "Imagine being able to sound just like you in a different language."
The Interpreter agent in Teams provides real-time speech-to-speech interpretation during meetings, and you can opt to have it simulate your speaking voice for a more personal and engaging experience."
Apart from these feature highlights, Microsoft has not yet shared a detailed view of the Interpreter agent.
However, in an effort to address privacy concerns, it has revealed that it will not store any biometric data or add anything that is not already present in a user's voice.
TechCrunch also shared feedback from a Microsoft spokesperson who provided reassurance that the application would not automatically use your voice: "Interpreter is designed to replicate the speaker's message as faithfully as possible without adding assumptions or extraneous information."
"Voice simulation can only be enabled when users provide consent via a notification during the meeting or by enabling 'Voice simulation consent' in settings."
Users can also change their mind. After agreeing to activate the Interpreter tool, they can later decide to disable it via a Teams setting.
Another worry is that the Interpreter agent could be misused or create security vulnerabilities in some way.
Deepfakes have become a well-known part of social media, sometimes making it difficult to distinguish fact from fiction.
According to cybersecurity news publication, The Record, yearly losses to impersonation scams now cost victims around one billion dollars per year.
This is not, therefore, the first time that technology has been created to mimic voices.
Recently, at the Meta Connect 2024 developer conference, for example, Meta unveiled new AI technology that mimicked celebrity voices to answer questions on platforms like Messenger, WhatsApp, Facebook, and Instagram.
Dame Judi Dench, John Cena, Kirsten Bell, Keegan-Michael Key, and Awkwafina provided celebrity voices.
In another Microsoft blog post, Amber Waisanen, Product Marketing for Collaboration Copilot at Microsoft, pointed to the money that could be saved using the Interpreter agent. "Communicating in a universal way where everyone instantly comprehends what's being said is challenging - often requiring interpretation services for global meetings."
Hiring an interpreter for a variety of meetings is a significant expense that can add up quickly."
"Today, we're introducing the new Interpreter agent - this will allow each user to enable real-time speech-to-speech interpretation in Teams meetings so they can speak and listen in the language of their choice, instantly overcoming language barriers.
"Users will also be able to have the Interpreter simulate their voice for a more inclusive experience."