Thanks to the latest AI and machine learning advancements, Google Translate is adding a new live translate mode and language practice tool.
Google credits Gemini AI models in Translate as helping improve translation quality, multimodal translation, and text-to-speech (TTS).
We’re going far beyond simple language-to-language translation, and delivering an experience that helps you learn, understand and navigate conversations with ease.
The new “Live translate” capability lets you have a “back-and-forth conversation in real time with audio and on-screen translations.” After launching the new interface, select the languages you want, with 70 supported: Arabic, French, Hindi, Korean, Spanish, Tamil, and more.
With a thread-based interface, Google Translate will “smoothly” switch between the pairing by “intelligently identifying conversational pauses,” as well as accents and intonations. Meanwhile, advanced voice and speech recognition models have been trained to isolate sounds and work in noisy, real-world environments.
Replacing the existing offering, this is rolling out now to Google Translate on Android and iOS for users in the US, Mexico, and India.
Meanwhile, Google Translate is getting language learning capabilities. Specifically, Google is focusing on helping you practice conversations. You specify your skill level (below) and goal in an equally conversational manner, or select from presets like “Everyday interactions” or “Travel and transportation.”
- Just starting: Limited knowledge of the language [Coming later]
- Basic: Can communicate using basic words and phrases
- Intermediate: Can express opinions and discuss everyday experiences
- Advanced: Can converse in depth about diverse topics
The Translate app will create “tailored listening and speaking practice sessions just for you.” After picking a scenario, like “Ask about meal times,” you select whether you want to:
- Listen: Build comprehension by listening to conversations and tapping words you recognize
- Speak: With hints as needed
Google will “track your daily progress and help you build the skills you need to communicate in another language with confidence.”
This is rolling out beginning today in beta in Google Translate for Android and iOS: “available first for English speakers practicing Spanish and French, as well as for Spanish, French and Portuguese speakers practicing English.” During this period, it’s free to use.
FTC: We use income earning auto affiliate links. More.
Comments