People who is their native language will not understand and she can't be sure she didn't insult an intired nation... But it's better this way because when it going to be efficent it's going to be to late for our governement to adapt and be sure their is no fraud.
Exactly my thoughts. Many threads are focussed on complaints regarding translations but what according to me distinguish this tool are not only the voice (as you said) but also (and more impressively to me) the deep fake style adjustments to facial features. I feel as if most are missing the woods for the trees. As for the translation itself, it's a little crease that can be ironed out in time. I can speak for the Hindi translation. Even there, the grammar and the pronunciation are immaculate and it does fairly well for rendering a very generic, neutral accent. What it struggles with is English not having gendered words and conjugations and more importantly, the tool translates too literally and consequently, completely messes up the translation and the intended meaning of the second sentence because it doesn't interpret the American colloquialism surrounding the word "totally". In that sense, it might even struggle with the current usage of "literally" as an exaggeration and by extension language constructs like sarcasm. For anyone interested in the finer details of the Hindi mistranslation, I'll simply copy-paste my other comment... *** While the grammar and the pronunciation are perfect, ironically, the translation itself is off. The lack of gendered words and conjugations is already the subject of this thread but much more strikingly, it's the second sentence where the conveyed meaning COMPLETELY CHANGES. I'm willing to wager that she said, 'a language that I totally can't speak' which would imply that she can't the language of Hindi at all. But the engine translated it very literally giving the impression that she can't speak the language completely but implying that she can partially. Colloquialisms and language constructs such as sarcasm naturally and understandably are very challenging for these to deal with. The main takeaway here should be the almost immaculate job it does with her voice and facial features, especially the lips and the teeth, to match the pronunciations. That IMO is the mind-blowing part of this video. The translation can always be iteratively improved but this is the USP, at least to me. I would also be very interested to know how much training data this tool required to produce these results. That might be another differentiator it has going for it. ***
Fellow native speaker. It's the intention delivered by the intonation in the sentence that's off. The translation is correct, the pronunciation a little too ambitious, like a news presenter practising. Point is the emphasis on "auch" ("too" or "also" in english). Sounds like she's correcting someone, or maybe siding with a non-speaker. So I'd translate it more like "me neither". Impressive tech, especially as such short phrases are even more complicated to emphasise naturally. But only two more papers down the line ... (referring to Dr. Zsolnai-Fehér)
Haha. Lol! 😅 But on a serious note, I really hope you all don't let Ai overtake you! It may be helpful, but our brains are better. IF you actually train it!
@@jonasdavies1806not you being queerphobic and disrespecting some Asian cultures with third gender and more. You should educate yourself and be open minded to others.
Damn that's trippy. I'm German and must admit that I would not have noticed anything odd about it, if you hadn't mentioned you're using this voice tool. It hit the emphasis and the tone of your voice almost perfectly. I bet if you gave this one more year to develop it would be flawless... Truly huge if true. But if it masters language specific slang on day may God protect all the good voice actors out there 🙏.
@@saba_350 so, YOU have a clue? and can judge others opinions? wow. Do you know what she said in the original or tried to say? Take my advice: please don't talk about something you don't have a clue either!
@@charles5a well the UT in Star Trek was a storytelling necessity, but we've had humans translating in realtime for years. Either way I look forward to it.
@@BrentHollett indeed. Realtime written translations during web meetings is already impressive enough & quite useful. We're not far from a switch to voice translate by state in webmeetings, and not too far from a time when you can walk around with a device translating realtime while walking on the streets, and pushing that translation to your earphone.
Yeahhhhh….. do you even know hindi it wasn’t accurate it a bit bad honestly cuz no one in india speaks complete hindi as all cuz they don’t even know fricking complete hindi and i bet it won’t be future for now as a translator cuz more languages might have similar and different problems like these as you mentioned she addressed her self as a men so yeah
Nothing is “private” nowadays, the second you get online and log in you willingly took your privacy away. Stop acting shocked about privacy if you’re actively causing it to vanish.
Yeah. I am old, I was already an Adult before Bill Gates was out of high school. Computers have gone from an interesting idea, to a scary threat in just PART of my life.
Omg. As a German I have to say, the AI made your voice sound so realistic and normal but extremely German on the other hand. As a nerd I’m just completely overwhelmed.
Yeah but it was a little off because the accentuation was on the wrong words for what she actually meant. Ich spreche AUCH kein deutsch sounds like someone else didn't speak German too 😅
Yea it was shockingly impressive! The articulation and pronounciation was incredible! Only the Grammar gave it away. It was kinda a word for word translation.
bro sorry but it did NOT sound 100% correct. the intonation was off. language is not only pronounciation but also the intonation. it's way way less important in german than in some asian languages, but still that's where you spot someone who learned german later in life, or a native speaker.
im only a student as of now learning german and, i cant lie thats quite convincing. my ears picked some discrepancies but thats actually not bad for new technology
Las traducciones son literales, va a tomar más tiempo de entrenar los algoritmos para adaptarse al argot obvio. Lo que me sorprende es el timbre de la voz, el ritmo y lo bien que está hecha la boca en deep fake
@@jiophone2412 “Jetzt spreche ICH vielleicht Deutsch. Ich spreche AUCH kein Deutsch.” (I; ALSO) is stressed arbitrarily. The pronunciation is unusually clean, but that's also the case with her original speech in some way. The lips seem to be in sync, but there's some unnatural lip splay-reminding of despair. It's likely caused by a suboptimal concurrence of the original & the artificial mime.
You speaking Hindi had me 😮😮! Although should've been bol rahi hu ( feminine ) instead of bol raha hu ( masculine ), amazing feature nevertheless! Love your content!! :)
I don't see what she's getting at... what did she mean by "but they don't know the voice you're uploading is yours"? I thought it's just auto-translating the audio to different languages, and you can edit the translation, but it's choosing a voice (some default...?) automatically -- because she also said they're not going to clone your voice for the translations
This would make watching dubbed shows much more tolerable, I think I’ll keep using subtitles with it, but if I can’t hear that something is dubbed without looking that would be amazing
This works great, as a french guy i can say that the only thing that felt off is the fact that it felt super slow but beside that I wouldn t be able to tell
My first language is French, but I'm fluent in english as well: most of my day job is in english. One thing that doesn't yet seem quite there yet from the small french clip is that emotions are not being conveyed as well, in my opinion. I think that will be a huge challenge for an AI translator: we often see people changing their behavior quite a lot between languages they are fluent in, mostly because of culture being different. To me, the usual english closing line sounds super hopeful/enthusiastic, kinda like if talking to a friend about something awesome. The French one sounded way more formal, a bit like something you'd find in a TV documentary. That being said, I'm sure the tech will eventually improve, and it's already awesome!
That’s an interesting insight!! I will say I don’t think that’ll be true for very long. I don’t think it will actually be that huge of a challenge ultimately either because of how AI training data is and will increasingly become collected
As a German, I can confirm. It sounds like a native German speaker, but the accentuations are weird. When I first thought she was speaking real German, I blamed it on her being no native speaker, but she had NO accent at all.
Not really. The stressing in the first sentence was kind of awkward. I would stress „jetzt“ (now) or „vielleicht“ (maybe) instead of „ich“ (I). And the second sentence is that as a whole, it sounds like you are affirming another person who just told you they don’t speak German that you don’t as well. Instead of that German is a language you can’t speak among others. For my ears pulling „Deutsch“ to the front and negating the verb instead for „Deutsch, spreche ich auch nicht“ would sound better.
@@salepienI'm doubtful that it will ever get these nuances right but then again the pronunciation is pretty good. It sounds a little soft compared to how most of us speak (an artefact of her accent I guess) but really impressive nonetheless
@@ReligioCritic it's already good but not everyone uses it properly. See modi ji song covers. Some are too good they sound like real while others are less trained model feels like 🤖. Btw loved your video of bhudhist caste system
@@ChemEDanit was a surprisingly good translation, although the melody of the sentence was off. It stressed the wrong word and it somewhat changed the implication of the sentence. But that level of language translation is so complicated and I highly doubt AI will be able to do that in the near future. You'd probably have to be a native german speaker to get these fine differences.
@@ChemEDan It was super convincing! The intonation was a little weird, because it sounded like she asked questions, but just slightly. Otherwise it was flawless! Greetings from Germany 😊
As a German native speaker: That is very comprehensible, very clear pronunciation, but the emphasis is all wrong, even the intonation, in a way. Some other commenters have remarked how you wouldn't phrase it like that, and I disagree, I can totally see it phrased like this, BUT while I can fully and completely and clearly understand what is being said, it sounds off in an uncanny-valley kind of way, as if someone was emphasizing syllables at random, it doesn't make sense in a very alien, incomprehensible "does not compute" fashion. You wouldn't emphasize "ich" in the first half, and while emphasizing "auch" in the second half makes some sense, it would be weighed differently, and you would also emphasize "Deutsch" in that case. There's a flow to a sentence, and it doesn't work out, here.
Oh man, was ein langer Kommentar 😅 Aber hast volkommen recht. In einem anderen Kontext könnte man sich diese Betonung sogar vorstellen, also ist sie nicht komplett falsch, aber in dieser Situation passt es einfach nicht. Wahrscheinlich ist die verwendete KI einfach noch nicht gut darin, den Kontext von Gesprächen zu verstehen oder es wurde wirklich nur der eine Satz übersetzt und die KI wusste nicht, wie genau sie das zu betonen hat :)
Bei dem Satz „Jetzt spreche ich vielleicht deutsch“ wird das „ich“ betont. Das lässt vermuten, dass vorher jemand anderes deutsch gesprochen hat und nun sie. Ist hier natürlich nicht der Fall. Es soll also deutlich gemacht werden, dass sie jetzt deutsch spricht, nachdem sie zuvor eine andere Sprache gesprochen hat. Also wird selbstverständlich das „deutsch“ betont. Also nochmal: Die Betonung ist zwar denkbar, aber im Kontext des Videos nicht korrekt.
Imagine this in zoom for instance, I’d be talking to a Russian who can’t speak a word of English, but he will see me speaking perfect Russian, while I’m seeing him speak in perfect English. We’re probably gonna see this technology develop into real-time translation in the next few years. Exciting!
And the A.I decides what the correct translation is - or it maybe decides to translate something completely different and both persons are each just having a conversation with the A.I., which then can decide whether it wants the people to be peaceful or having war. Regulatories cannot beat that.
I work as a translator and interpreter. Tbh, I am fine with AI taking my job away. I think the benefits outweigh the consequences. Being able to communicate across cultures and countries is a net positive for humankind. In the meantime, I will also learn farming. lol
When you started speaking Hindi I was like woah !! 🤯. But ya like others mentioned, you did say “bol sakta hu” instead of “bol sakti hu”, using male form of the verb which sounded a bit odd. But who cares. ❤️
As a non native hindi speaker , i confirm it was better than most of us, especially the accent . And german was almost perfect . Damnnn the world is domeeed
@@JamesThePokemonHunter I said doomed, cuz of the rapid technological development..we are very near to the technological singularity.. and the future is pretty much uncertain.!! Even the big giants are afraid of what is happening, the one who created them in the first place
Nows a great time to have a unique language thats an amalgamation of multiple other languages: the laws of a mixed language would be really difficult to program for a computes. Big up Jamaica.
hindi voice and pronouncsion was so accurate that when she spoke in hindi language, anyone can thought she is native hindi spoker. but the sad reality is it's AI
You can't fool us, you're fluent in all these languages! and on a serious note: this was astounding, as a native Spanish speaker that was flawless, it actually sounded as someone speaking Spanish at a native level, no flaws, no glitches, no weird sounds/movements, this is so weird and captivating and amazing.
@@AkariK3 that Spanish sounds exactly like a very neutral Spanish, if I ever heard someone talk like that I'd think they were Mexican, source: I'm a Mexican who talks with a very similar if not that accent.
@@AkariK3 in fact she sounds like Ana de la Reguera a lot, her voice is very similar to hers and she almost sounds exactly the same. You can look some clips of her speaking Spanish obviously, well also in English to compare if you'd like to do that.
@@linguistme6870 it was a joke of course but in the end the sound and images are very convincing, it is amazing nonetheless any way you see it and this is a very astounding technological breakthrough.
@@linguistme6870 also, as someone very familiar with Spanish and French, it was flawless, maybe the grammar in Hindi wasn't right because well, she isn't fluent and couldn't tell but still it's pretty impressive.
I've been improving my Spanish lately, and have been learning Italian for the last 3 weeks. Guess I'm just wasting time! 😂 Kidding, obviously. Being able to communicate in person is still very important, and I genuinely want to understand others in person, etc. Of course, those tools aren't far behind, and that's amazing too!
"The practical upshot of this is that if you stick a Babel fish in your ear you can instantly understand anything said to you in any form of language. The speech patterns you actually hear decode the brainwave matrix which has been fed into your mind by your Babel fish... Meanwhile, the poor Babel fish, by effectively removing all barriers to communication between different race and cultures, has caused more and bloodier wars than anything else in the history of creation." - Hitchhiker Guide to the Galaxy.
I think even AI has problem with masculine and feminine sentence endings in Hindi. This is a problem lots of non native Hindi speakers face. It sounds too funny. 🤣
"If we get this right" the road to hell is paved with good intentions. There's people working those jobs, they're called translators. There's localization translators, who can do the subtitles aswell, there's voice actors, who can dub something for you. Yes it costs money, of course it does, they are humans working those jobs. There's no way that such an AI won't ever be used with malicious intent either by other people like you and me or corporations, or governments. Photoshop, deepfakes, AI art, even back when computers didn't exist we modified photographs for propanganda. People will keep abusing these things, don't leave your info, face, voice and personal data online and on privately owned platforms, it will be taken and used for someone else's profit. Remain careful and sceptic of certain "innovations", pay for a human's work before the machine when you can, we're leading ourselves to obsolescence without any financial guarantees behind. Think this through.
Does nobody find this extremely creepy?? People can take your likeness and make an AI video and make you say anything they want in any language possible. It's now incredible easy for anybody to frame you or get you trouble for anything. Hard pass..
This feature of auto-translating on youtube is actually kind of annoying when you're like me, a non-native english speaker who mostly watches english content. The first time it happened was on a MrBeast short and I freaked out
She refers to herself as a guy in Hindi. It was quite unexpected and frankly hilarious 😂😂😂
Yeah but the grammar and pronunciation was perfect
@@krateproductions4872it's much better than any other alternative like google translate that make it look like you're reciting 15th century poems...
@@xa-4246fr
@@xa-4246true
Ikr 😂
30 years ago, this was literal science fiction. Who cares if it's only 80% correct.
Babelfish!
Even 5 years ago! This is really remarkable.
I don't think 30 years ago, they think it was possible!!
I dunno, the great risk of miscommunication is worrying
People who is their native language will not understand and she can't be sure she didn't insult an intired nation... But it's better this way because when it going to be efficent it's going to be to late for our governement to adapt and be sure their is no fraud.
It's not The language. It's the sound. It actually sounds like you. That is some crazy technology.
Exactly my thoughts. Many threads are focussed on complaints regarding translations but what according to me distinguish this tool are not only the voice (as you said) but also (and more impressively to me) the deep fake style adjustments to facial features. I feel as if most are missing the woods for the trees.
As for the translation itself, it's a little crease that can be ironed out in time. I can speak for the Hindi translation. Even there, the grammar and the pronunciation are immaculate and it does fairly well for rendering a very generic, neutral accent.
What it struggles with is English not having gendered words and conjugations and more importantly, the tool translates too literally and consequently, completely messes up the translation and the intended meaning of the second sentence because it doesn't interpret the American colloquialism surrounding the word "totally". In that sense, it might even struggle with the current usage of "literally" as an exaggeration and by extension language constructs like sarcasm.
For anyone interested in the finer details of the Hindi mistranslation, I'll simply copy-paste my other comment...
***
While the grammar and the pronunciation are perfect, ironically, the translation itself is off. The lack of gendered words and conjugations is already the subject of this thread but much more strikingly, it's the second sentence where the conveyed meaning COMPLETELY CHANGES.
I'm willing to wager that she said, 'a language that I totally can't speak' which would imply that she can't the language of Hindi at all. But the engine translated it very literally giving the impression that she can't speak the language completely but implying that she can partially.
Colloquialisms and language constructs such as sarcasm naturally and understandably are very challenging for these to deal with.
The main takeaway here should be the almost immaculate job it does with her voice and facial features, especially the lips and the teeth, to match the pronunciations. That IMO is the mind-blowing part of this video. The translation can always be iteratively improved but this is the USP, at least to me.
I would also be very interested to know how much training data this tool required to produce these results. That might be another differentiator it has going for it.
***
Not only the voice feather of you. It changed the month and eyes actions to match the voice. It's crazy.
People still say AI wont get better
@@kaorutikuikr!!
@@prayanklalan5138 I'm not reading all of that 💀
I'm fluent in german and it kind of made a mistake on which words to put emphasis on, but like the fact that it could even do this is just crazy!
Exactly, truly the creepiest part lies in the fact that it was pretty much said in her own voice O_O
Yeah, definitely sounds weird and off... Though I can't really put my finger on it, tbh... (native speaker)
Fellow native speaker. It's the intention delivered by the intonation in the sentence that's off.
The translation is correct, the pronunciation a little too ambitious, like a news presenter practising.
Point is the emphasis on "auch" ("too" or "also" in english). Sounds like she's correcting someone, or maybe siding with a non-speaker.
So I'd translate it more like "me neither".
Impressive tech, especially as such short phrases are even more complicated to emphasise naturally. But only two more papers down the line ... (referring to Dr. Zsolnai-Fehér)
Nah I am a fluent German speaker myself and it was damn near perfect. That is scary.
Cleo became Clinton in Hindi.
Lol tru 😂
Clinton
Cleonardo
That's Typically a Lady's voice
😂
Plot twist: Cleo has been AI generated and fooled everyone for a long time
Plot twist: somebody gonna go full Code Lyoko for this fine ass woman.
Plot twist: Heisenberg is Transcendent
So it was MKBHD all along!
That's why I came here to mention her that is we use this tool so it can create a lot of confusion like the You accent in Hindi and English
Walter white😂
I was stunned for a second when she spoke A.i so fluently.
Haha. Lol! 😅 But on a serious note, I really hope you all don't let Ai overtake you! It may be helpful, but our brains are better. IF you actually train it!
@@mvillegasv8 amen 🙌🏻
Broo the hindi got me 😂😂😂😂😂😂😂😂😂😂😂
I was surprised when I saw hindi and even more surprised when I saw she was referring to herself as a guy
1/2 delightful, 1/2 horrifying. Now I know why aliens in Star Trek speak perfect English.
The treasonous one in Star Trek Beyond used a translation-decoding collar, so… an alternative, yes
They explained that frequently in the series... The badges they wear are communicators and translators.
100% horrifying
😂😂😂...
well when she used it sher refered to herself as a guy in hindi so I'm not worried
Cleo speaking Hindi is the best thing I've seen today
Stop it. Koi India ka naam lele yaa usse kuch related aur tum chutiye uska comment section bhar dete ho.
Gora validation se Chen nhi bharta kya?
Her words are literally being cloned translated. Did you not understand what she said. She's not speaking your language 😲
@@dmr123kkla I didn't say she actually spoke Hindi and it's not my language
You must not have a lot going on
But as a dude
Polyglot pranks the internet
This one had me chuckling 💀
LOL
Kekekeke 😂
Is she?!?
She knows where her audience is
The Spanish translation had an awkward translation for "wild" but it was still crazy good.
this is not good, its terrifying. Cue deepfakes of everything, and the end of epistemological ground truth.
@bobf5360 good as in proficient.
The accessibility is good. The abusability isn't.
The German one was also off a bit.. the pronounciation was good but the choice of word was weird.
Also her spanish was specific from Mexico, so if they use it to fake some I know is not Mexican i'll know its fake, but still very good.
It's like "J" after a "H", "Salvahje".
Like the AI try to go with a Caribbean accent and then change to neutro.
Holy crap, that English is flawless!
It's okay
Lmaooo
@PiousMoltar dude, first, well that's toxic. Second, it's a joke
there were some mistakes but hindi one is very accurate
they didn't get the joke bro 🤣
Imagine how many fake polyglots they're going to be
And how many salty people will claim actual polygons as fake
Oh no
@@dunkyourdonuts2282as someone who tastes salty I do indeed hate polygons… their shape, yikes
@@haz226ikr polygons are so ugly.. 😔
There’re
"Tower of Babel joins the chat"
The Hindi speaking was insane and fluent and felt natural. The gender was incorrect, but AI will figure that diff out in no time, amazing! 🤩
Hindi got the gender wrong. But still amazing
Ai won't figure that difference out, it's a problem in the language themselves.
@@prateekkarn9277 with a bigger data set it can figure it out. Chat gtp is a language based AI. It just needs more data and time.
@prateekkarn9277 ai will definitely figure it out.
@@prateekkarn9277It can figure out by understanding the difference in male and female voice.
That Hindi was damn near perfect!! No weird slang or overly flowery language that some direct textbook translation tools use. Awesome!
Only Gender is changed😂
@@infotechoverloaded721the biggest Only 😂
Except switching her gender
You never know how many genders are here in the west.
@@jonasdavies1806not you being queerphobic and disrespecting some Asian cultures with third gender and more. You should educate yourself and be open minded to others.
As a french speaker the French translation sounds soo AI and robotic. ( La voix de lama fâché 😭😭)
AGAHAHAH OUI TELLEMENT
IKR it was such a stiff voice
As a non french speaker, i can back this up
on a pas écouté le même extrait alors... si l'audio était juste un peu plus accéléré j'aurais vraiment cru qu'elle peut parler français 😅
@@youtubeurtout-à-fait
Damn that's trippy. I'm German and must admit that I would not have noticed anything odd about it, if you hadn't mentioned you're using this voice tool. It hit the emphasis and the tone of your voice almost perfectly. I bet if you gave this one more year to develop it would be flawless... Truly huge if true. But if it masters language specific slang on day may God protect all the good voice actors out there 🙏.
yes, indeed the German sounded very convincing.
@@henningbartels6245it made no sense what she said it sounded good but it made not sense please don’t talk about something you have no clue about
in german it made no sense what she was saying. it sounded good but it did not make sense what she was sasyim.
@@saba_350 so, YOU have a clue? and can judge others opinions? wow.
Do you know what she said in the original or tried to say?
Take my advice: please don't talk about something you don't have a clue either!
Cadence and emphasis were wrong and native speakers wouldn’t word the last sentence that way.
As an indian, that’s the best i’ve seen an american get at hindi 😂😂
Edit: yes the gender tense was hilarious (she referred to herself as a guy lol)
Itna toh chltaa h bhai
@@user-dy3qn3vd1t yeah we know
@@user-dy3qn3vd1tWe know….
@@Hakunamataaa sahi me idhar ke launde Hindi ki zyada khichdi bana dete hei, other than gender that was really good 😂
She’s not actually speaking the languages. It’s an AI voice over using a translator lmao
This is the best quick to the point HeyGen video. You rock!
I don't think this is Heygen, her lip sync in this is just too perfect.
Were getting closer to a universal real time translator every day.
Another StarTrek prediction?
@@charles5a well the UT in Star Trek was a storytelling necessity, but we've had humans translating in realtime for years.
Either way I look forward to it.
@@BrentHollett indeed.
Realtime written translations during web meetings is already impressive enough & quite useful. We're not far from a switch to voice translate by state in webmeetings, and not too far from a time when you can walk around with a device translating realtime while walking on the streets, and pushing that translation to your earphone.
That's so cool!😊 The hindi one sounded really accurate except for the tiny fact that you addressed yourself as a male in hindi😅
Yeahhhhh….. do you even know hindi it wasn’t accurate it a bit bad honestly cuz no one in india speaks complete hindi as all cuz they don’t even know fricking complete hindi and i bet it won’t be future for now as a translator cuz more languages might have similar and different problems like these as you mentioned she addressed her self as a men so yeah
@@ultimategaming4018ok
@@ultimategaming4018its a new product.
It will improve with time and effort
@@ultimategaming4018She spoke perfect Hindi except addressing herself as a male. And where did you get the idea that nobody can speak perfect Hindi?
@@ultimategaming4018forget about her hindi.
WTH is wrong with your english?
I am unable to understand your comment properly.
From a teaching and learning perspective this is insanely cool and exciting, from a privacy perspective this is terrifying
Yup
Nothing is “private” nowadays, the second you get online and log in you willingly took your privacy away. Stop acting shocked about privacy if you’re actively causing it to vanish.
Yeah. I am old, I was already an Adult before Bill Gates was out of high school. Computers have gone from an interesting idea, to a scary threat in just PART of my life.
My online spanish class project just got wild 😂
That Hindi was so realistic except that the AI referred to herself as a male lmao
Doraemon's gadgets are getting real...
fr
Yup translation tool wala 😂
Can't wait for the anywhere door and time machine.
💀
Omg. As a German I have to say, the AI made your voice sound so realistic and normal but extremely German on the other hand. As a nerd I’m just completely overwhelmed.
Yeah but it was a little off because the accentuation was on the wrong words for what she actually meant.
Ich spreche AUCH kein deutsch sounds like someone else didn't speak German too 😅
Oh wow youre sooooo nerdy....youre soo cool
War geil oder??? Bis jetzt dachte ich immer die Videos sind fake
Yea it was shockingly impressive! The articulation and pronounciation was incredible! Only the Grammar gave it away. It was kinda a word for word translation.
bro sorry but it did NOT sound 100% correct. the intonation was off. language is not only pronounciation but also the intonation. it's way way less important in german than in some asian languages, but still that's where you spot someone who learned german later in life, or a native speaker.
As a German: that actually sounded quite convincing already ❤
True
But the "auch" did sound kinda outta place not enugh to make me think its ai but yeah
sie klingt ein bisschen wie gnu mit der betonung
@@z4po325finde ich net
im only a student as of now learning german and, i cant lie thats quite convincing. my ears picked some discrepancies but thats actually not bad for new technology
AI becoming terrifying day by day.. 😂😂
You summoned the whole Indian audience with a single line!! 😂
NOT EVERYONE IN INDIA SPEAK HINDI
Hindi Audience
@@LeoDas688 these people think Hindi is the only one spoken in India.😂
@@Rajkumz or every Indian know hindi
People are gonna suddenly have a WHOLE BUNCH of films they're willing to watch.
Omg the Spanish was short but STUNNING, unlike French which sounded a bit more Google Translate-y, I’m awed, can’t wait to get my hands on this
Salvaje? No tiene sentido en castellano...
@@DaniSilvSestaba pensando lo mismo. Seguro que dijo "Wild" en el original
Las traducciones son literales, va a tomar más tiempo de entrenar los algoritmos para adaptarse al argot obvio. Lo que me sorprende es el timbre de la voz, el ritmo y lo bien que está hecha la boca en deep fake
@@DaniSilvSen Puerto Rico lo tendría 😂. pero al parecer es una traducción literal.
That lip movement match is phenomenal OMG
This is the true technology
For German, the lips seem kind of off imho, even though the sound itself fits.
@@christbaumer Is that so? The match for Hindi was spot on even tho the speech used by the AI is referring to her as a man and not a woman
@@jiophone2412 “Jetzt spreche ICH vielleicht Deutsch. Ich spreche AUCH kein Deutsch.” (I; ALSO) is stressed arbitrarily. The pronunciation is unusually clean, but that's also the case with her original speech in some way. The lips seem to be in sync, but there's some unnatural lip splay-reminding of despair. It's likely caused by a suboptimal concurrence of the original & the artificial mime.
It's still kinda experimental tho. The French sounds like google translate, the rest I don't know about, but it sounds kinda unpolished,idk
The French was actually pretty good. It even got the accent right.
Spanish too, it's crazy!
Only thing maybe is the speed of the speech, but otherwise it was pretty impressive
No the french was weird
The french was pretty bad, it sounded like a regular robot.
Yep, the French part sounds weird.
Upload this to neurolink, we'll be able to communicate with each other with ease, let alone an alien species in the future.
"If we get this right..." she says.
She has tremendous faith that this is not Pandora's Box.
Oh wait, that box was busted open years ago. 😂
You speaking Hindi had me 😮😮! Although should've been bol rahi hu ( feminine ) instead of bol raha hu ( masculine ), amazing feature nevertheless! Love your content!! :)
My Punjabi wife said the same thing. Amazingly good pronunciation and grammar, except that one thing haha.
@@ItchyCinderBlock Haha! Almost every Indian in the comment section is pointing out that one little mistake!
@@ItchyCinderBlockit's horrifying to think AI can speak better Hindi then your wife in a few years
This is actually quite terrifying.
Simply because of the malfeasance it could be used for.
I don't see what she's getting at... what did she mean by "but they don't know the voice you're uploading is yours"? I thought it's just auto-translating the audio to different languages, and you can edit the translation, but it's choosing a voice (some default...?) automatically -- because she also said they're not going to clone your voice for the translations
Hmmmm. Yes, as Cleo said. "If they get it right." She's usually optimistic, so it was good of her to cast some shade on this tech.
Already has been. Eric Adams robocalls
Someone on UA-cam makes short videos using Arnold Schwarzenegger's voice. Including singing.
Another another does dad jokes with the voices of presidents.
This would make watching dubbed shows much more tolerable, I think I’ll keep using subtitles with it, but if I can’t hear that something is dubbed without looking that would be amazing
That's actually terrifying and appealing at the same time
The last French part when she said “Teek-noL-Ooe-Gee” is what made me like this video
The French was decent. It did sound a tad "robotic", though.
The french one was the weird one and lips did not go with it
As a French guy I can say it was still pretty impressive although it sounded more like Québec French. Pretty cool though!
Not only does the Hindi sound convincing, the mouth movements are perfect!
Oh my goshhhh
Your Spanish was fantastic, the mouth movement looks so natural and it's only going to get better
The AI did not translate the Spanish very well, though. It's clunky and the mouth movements seem a little weird.
Can’t wait until the day it offers the option to do the same language but different accents
OMG YESSS i want to hear my voice in a Scottish accent!!
This works great, as a french guy i can say that the only thing that felt off is the fact that it felt super slow but beside that I wouldn t be able to tell
My first language is French, but I'm fluent in english as well: most of my day job is in english.
One thing that doesn't yet seem quite there yet from the small french clip is that emotions are not being conveyed as well, in my opinion.
I think that will be a huge challenge for an AI translator: we often see people changing their behavior quite a lot between languages they are fluent in, mostly because of culture being different.
To me, the usual english closing line sounds super hopeful/enthusiastic, kinda like if talking to a friend about something awesome.
The French one sounded way more formal, a bit like something you'd find in a TV documentary.
That being said, I'm sure the tech will eventually improve, and it's already awesome!
That’s an interesting insight!! I will say I don’t think that’ll be true for very long. I don’t think it will actually be that huge of a challenge ultimately either because of how AI training data is and will increasingly become collected
As a German, I can confirm. It sounds like a native German speaker, but the accentuations are weird. When I first thought she was speaking real German, I blamed it on her being no native speaker, but she had NO accent at all.
So true. There is so much more information contained in *_how_* someone speaks, and it differs from language to language.
As a native German i can say the German was on Point.
Not really. The stressing in the first sentence was kind of awkward. I would stress „jetzt“ (now) or „vielleicht“ (maybe) instead of „ich“ (I).
And the second sentence is that as a whole, it sounds like you are affirming another person who just told you they don’t speak German that you don’t as well. Instead of that German is a language you can’t speak among others.
For my ears pulling „Deutsch“ to the front and negating the verb instead for „Deutsch, spreche ich auch nicht“ would sound better.
@@salepienI'm doubtful that it will ever get these nuances right but then again the pronunciation is pretty good. It sounds a little soft compared to how most of us speak (an artefact of her accent I guess) but really impressive nonetheless
Also die Aussprache war schon super
@@salepienja der Satzbau war etwas ungewöhnlich aber nicht falsch
@@athmaidyes the gramatik was a little of but it defenetly wasnt softer or harsher then normal German
The hindi is so perfect that it has better quality than Hollywood dubbed movies , really !
Emotions are missing.
not at all. she is identifying as male in Hindi lol
@@FireandIce-eh7mxBro, that's a minor error, imagine how good AI will get in the next 3-4 years?
@@ReligioCritic it's already good but not everyone uses it properly. See modi ji song covers. Some are too good they sound like real while others are less trained model feels like 🤖. Btw loved your video of bhudhist caste system
@@ReligioCritic me tumhe 1saal se janta hu bhai. Tum jee de rahe ho kya subscription se lag rha h
As an english-Spanish speaking person that was insane!!
I'm learning German and it was so exciting when I realised I could understand what you said just by listening
That's cool! How convincing was it?
@@ChemEDanit was a surprisingly good translation, although the melody of the sentence was off. It stressed the wrong word and it somewhat changed the implication of the sentence. But that level of language translation is so complicated and I highly doubt AI will be able to do that in the near future. You'd probably have to be a native german speaker to get these fine differences.
@@ChemEDan It was super convincing! The intonation was a little weird, because it sounded like she asked questions, but just slightly. Otherwise it was flawless! Greetings from Germany 😊
Wow, das ist ein toller Erfolg! Viel Vergnügen weiterhin beim Lernen 😊
As a German native speaker: That is very comprehensible, very clear pronunciation, but the emphasis is all wrong, even the intonation, in a way.
Some other commenters have remarked how you wouldn't phrase it like that, and I disagree, I can totally see it phrased like this, BUT while I can fully and completely and clearly understand what is being said, it sounds off in an uncanny-valley kind of way, as if someone was emphasizing syllables at random, it doesn't make sense in a very alien, incomprehensible "does not compute" fashion.
You wouldn't emphasize "ich" in the first half, and while emphasizing "auch" in the second half makes some sense, it would be weighed differently, and you would also emphasize "Deutsch" in that case. There's a flow to a sentence, and it doesn't work out, here.
Oh man, was ein langer Kommentar 😅
Aber hast volkommen recht. In einem anderen Kontext könnte man sich diese Betonung sogar vorstellen, also ist sie nicht komplett falsch, aber in dieser Situation passt es einfach nicht. Wahrscheinlich ist die verwendete KI einfach noch nicht gut darin, den Kontext von Gesprächen zu verstehen oder es wurde wirklich nur der eine Satz übersetzt und die KI wusste nicht, wie genau sie das zu betonen hat :)
@@cardist3144österreicher hier. klingt nicht all zu falsch tbh
klingt wie ein fernseh-newsredakteur
You need to take a deep look into how AI keeps improving itself by eliminating all its mistakes in a duration of seconds every day of its existence ..
Blödsinn, das klingt absolut perfekt nach reinem Hochdeutsch, ohne Fehler. Die Betonung ist selbstverständlich auch Top.
Bei dem Satz „Jetzt spreche ich vielleicht deutsch“ wird das „ich“ betont. Das lässt vermuten, dass vorher jemand anderes deutsch gesprochen hat und nun sie. Ist hier natürlich nicht der Fall. Es soll also deutlich gemacht werden, dass sie jetzt deutsch spricht, nachdem sie zuvor eine andere Sprache gesprochen hat. Also wird selbstverständlich das „deutsch“ betont. Also nochmal: Die Betonung ist zwar denkbar, aber im Kontext des Videos nicht korrekt.
This is getting awfully close to Douglas Adams' babblefish. Really, really exciting!
Imagine this in zoom for instance, I’d be talking to a Russian who can’t speak a word of English, but he will see me speaking perfect Russian, while I’m seeing him speak in perfect English. We’re probably gonna see this technology develop into real-time translation in the next few years. Exciting!
That's some blackmirror stuff
But, then, why the need to learn a language?
So sad.
@@TedEhioghae To connect the whole world together with zero barriers? Sign me up
@@drip3889 It's sad.
And the A.I decides what the correct translation is - or it maybe decides to translate something completely different and both persons are each just having a conversation with the A.I., which then can decide whether it wants the people to be peaceful or having war. Regulatories cannot beat that.
I work as a translator and interpreter. Tbh, I am fine with AI taking my job away. I think the benefits outweigh the consequences. Being able to communicate across cultures and countries is a net positive for humankind.
In the meantime, I will also learn farming. lol
The dubbing industry 💀
holy shit, you're right
RIP
I never liked them anyway. Look at computer science taking everyones job.
I mean for art i think dubbing is still way better, this seems more for things like documentaries, educational videos, etc.
The german was actually pretty okay, except that the words ended way to abrupt
I thought it was good, I’ve only taken German for 3 years but I could understand it perfectly
The german was good. Nothing less than that.
@@LuciferTheFirstBornThe intonation was off which made me not understand the sentence at first.
@@notfounderrornotfound at least thats a valid point. Sounds a bit off. I suspect it happend cause there was a cut in the clip.
Not sure I see what you mean and I'm basically a native speaker
When you started speaking Hindi I was like woah !! 🤯. But ya like others mentioned, you did say “bol sakta hu” instead of “bol sakti hu”, using male form of the verb which sounded a bit odd. But who cares. ❤️
She cracked the Indian Algorithm
As a non native hindi speaker , i confirm it was better than most of us, especially the accent .
And german was almost perfect .
Damnnn the world is domeeed
It sounds like metro announcement 😂
Domed?
The world is doomed because we cant communicate better? Would that not be a good thing?
@@JamesThePokemonHunter I said doomed, cuz of the rapid technological development..we are very near to the technological singularity.. and the future is pretty much uncertain.!! Even the big giants are afraid of what is happening, the one who created them in the first place
@@kannadafactstar nothing wrong with advancing as the human race
Your Hindi voice is so soothing
plot twist: She actually speaks german and hindi and just says it's AI so everyone is amazed and shares the video
This is the beauty of the internet… but also the scary part. Like all tools, if used correctly, they are fantastic. But if abused… not so much.
that was soooo... cool...
when you suddenly started to speak hindi, I actually thought it's real "you" talking....😆
"But if we get this right..."
That here, we won't 😂😂😂😂
Nows a great time to have a unique language thats an amalgamation of multiple other languages: the laws of a mixed language would be really difficult to program for a computes. Big up Jamaica.
I was amazed at work because my coworker’s screen is English, but on the big screen it’s in Spanish.
This is just on a whole different level
The french was so smooth 🤯
I WAS NOT EXPECTING YOU TO JUST RANDOMLY START SPEAKING HINDI??? I'VE WATCHED THAT AT LEAST 10 TIMES NOW AND IT STILL AMAZES AND FLABBERGASTS ME-
hindi voice and pronouncsion was so accurate that when she spoke in hindi language, anyone can thought she is native hindi spoker. but the sad reality is it's AI
Its a great way to frame someone.
She in Hindi sounds like the lady on Indian train platforms
How talkative you are😊
You can't fool us, you're fluent in all these languages! and on a serious note: this was astounding, as a native Spanish speaker that was flawless, it actually sounded as someone speaking Spanish at a native level, no flaws, no glitches, no weird sounds/movements, this is so weird and captivating and amazing.
I need to add: it doesn't sound like european Spanish to me, but something in between; maybe like someone whose relatives are from latam, kind of mix
@@AkariK3 that Spanish sounds exactly like a very neutral Spanish, if I ever heard someone talk like that I'd think they were Mexican, source: I'm a Mexican who talks with a very similar if not that accent.
@@AkariK3 in fact she sounds like Ana de la Reguera a lot, her voice is very similar to hers and she almost sounds exactly the same. You can look some clips of her speaking Spanish obviously, well also in English to compare if you'd like to do that.
@@linguistme6870 it was a joke of course but in the end the sound and images are very convincing, it is amazing nonetheless any way you see it and this is a very astounding technological breakthrough.
@@linguistme6870 also, as someone very familiar with Spanish and French, it was flawless, maybe the grammar in Hindi wasn't right because well, she isn't fluent and couldn't tell but still it's pretty impressive.
I've been improving my Spanish lately, and have been learning Italian for the last 3 weeks. Guess I'm just wasting time! 😂 Kidding, obviously. Being able to communicate in person is still very important, and I genuinely want to understand others in person, etc. Of course, those tools aren't far behind, and that's amazing too!
I love how she did Hindi first because she knows she’ll get all the Indian comments 😅
Interesting
North Indian comments*
@@octopusmusic332Exactly
that's pretty much obvious
"The practical upshot of this is that if you stick a Babel fish in your ear you can instantly understand anything said to you in any form of language. The speech patterns you actually hear decode the brainwave matrix which has been fed into your mind by your Babel fish...
Meanwhile, the poor Babel fish, by effectively removing all barriers to communication between different race and cultures, has caused more and bloodier wars than anything else in the history of creation." - Hitchhiker Guide to the Galaxy.
I read babel fish and instantly recognised o e of my favourite Sci fi books
people who are studying hard to become a translator. are going to become jobless in few years 💀💀
its 100% not true because there is a lot that goes into translation...not only translating itself
for example ?@@Gytis_Of_KFP_The_4th_PenKing
learning languages is more about human connection and it is also a fun hobby
I think even AI has problem with masculine and feminine sentence endings in Hindi. This is a problem lots of non native Hindi speakers face. It sounds too funny. 🤣
This is the end of the 'Look at me, I can speak two languages'-youtubers
Your AI clone will always be one step ahead of you!
Whats really cool to watch you speak latin spanish ❤
"If we get this right" the road to hell is paved with good intentions.
There's people working those jobs, they're called translators. There's localization translators, who can do the subtitles aswell, there's voice actors, who can dub something for you. Yes it costs money, of course it does, they are humans working those jobs.
There's no way that such an AI won't ever be used with malicious intent either by other people like you and me or corporations, or governments. Photoshop, deepfakes, AI art, even back when computers didn't exist we modified photographs for propanganda.
People will keep abusing these things, don't leave your info, face, voice and personal data online and on privately owned platforms, it will be taken and used for someone else's profit.
Remain careful and sceptic of certain "innovations", pay for a human's work before the machine when you can, we're leading ourselves to obsolescence without any financial guarantees behind. Think this through.
Ah the TARDIS translator
As a nerd who loves languages, this is super exciting and cool. As a paranoid depressive, this is terrifying.
Does nobody find this extremely creepy?? People can take your likeness and make an AI video and make you say anything they want in any language possible. It's now incredible easy for anybody to frame you or get you trouble for anything. Hard pass..
It's coming. We can't stop it.
They’ve opened a Pandora’s box. This is not going anywhere good!
This feature of auto-translating on youtube is actually kind of annoying when you're like me, a non-native english speaker who mostly watches english content.
The first time it happened was on a MrBeast short and I freaked out
As a german I was shocked how realistic this sounded
This is not optimistic; it's dystopian
Indians! Assemble!!
looks like the star trek communicator is becoming a reality.
German sounded so flawless that as a German native, I was literally confused 😅
i feel like the emphasis on ich and auch felt so wrong for the context of the sentences tho. it sounds so good but still a little uncanny
Cleo in Hindi❤ now I can die peacefully
The hindi translation tripped me out. Honestly crazy tech
I had that idea that youtube should let us dub our videos as well as add subtitles years ago
The possibilities for fraud are amazing.
MrBeast should use this for his channels in other languages
Nah... we should destroy this.
It even got her french body language
I DON'T KNOW WHAT IS YOUR CHANNEL ABOUT 😂BUT LOOKS INTERESTING. Subscribed.
So is that app good then.?
Julia Roberts: You copied my likeness and I've got some mouths to feed. Where are my genetic royalties?