Ai translation of all available language using HeyGen

[@awochquio]

As a Korean who also speaks Japanese, it sounds exactly like english speakers learned the languages for few months and tries to speak about some difficult subject with a broken translator’s help

[@3dvfxprofessor]

German here. There are minor translation issues at the beginning and end, but overall the fluency and expression are impressive. If this is perfected, we will see an age of communication revolution, but also a period of abuse. I'm sure AI will force-transform social media and the media landscape. Social media will become worthless when it comes to socio-political content (videos) and we will probably see a post-analog age (written word) alongside the 5th and 6th industrial revolutions. People will prefer to meet and talk in real life again!

[@fredronin3564]

That's what I think and that's what we can hope.

[@Robin-yq6mt]

wise words my friend

[@mertmertmertos]

Turkish speaker here - That speech was fantastic! Very impressive!

[@sob201]

Turkish speaker here, it was like the first month of an expat in Turkey

[@deaddoomed2380]

imagine using this in real time on videocalls, you could speak with anyone disregard the language

[@Deflect-fteod2]

As someone who's first language is spanish, that spanish translation was incredible. It sounded amazing.

[@alitonoliveira1700]

Brazilian feedback here. The translation at the beginning was a little bit weird, but overall the fluency and expression were awesome.

[@atlanta2076]

Native German here. The translation is rather bad, but the German itself is 98% flawless. The rhythm, the flow, the pronounciation. Absolutely perfect. It's like you're a German native speaker reading a rather clunky script.

[@AhmedTelleserDehyer]

Useful video. Besides, I once used a plug-in called Immersive Translate can also translate video subtitles in real time. I think its translation is also accurate.

[@jakubsujka6153]

Polish native speaker here. The translation is not perfect, some sentences are not natural for a polish native speaker. Still, the pronunciation is just incredible! It really impressed me

[@HeyfromEurope]

Zgadza się, brzmiał jakby był Polakiem (akcent).

[@user-glg20]

Because polish is more complicated (declination, conjugation, etc) than many other languages. Wiem co piszę, bo znam to z autopsji xD

[@Midaspl]

Yes. It sounds ok, lipsync is really good, but the translation is well... Far from perfect. I'd say it's barely understandable and just because I've heard the original sentence in English. Otherwise some parts would make me wonder if the guy has a stroke. I think it's mostly because Polish is way more precise than English and you need to take some additional information from the context of the sentence, to properly translate it this way.

[@pannajustyna2282]

„Ciesz się” xD

[@ukaszmacieja7093]

Też jestem pod wrażeniem, zasadniczo gdyby przyspieszył mówić to by przeszło bez zastanowienia . Każdy by myślał że poprostu tak niechlujnie mówi. Choć uważam że jak ktoś bez wiedzy ze to tłumacz uznałby ze to jego głos

[@patrykborkowski1504]

Polish ⚪🔴 Sounds quite natural like someone who speaks well. There is also sound of breath before speak like natural dialog. Mouth moves are match too.

[@anasboumali8266]

as a french speaker , there are some flaws but the overall perfermance is impressive , and it is still largely better than a human speaking in a broken way...

[@BhaumikDave]

If some hindi speaking person listen to this 05:21 to 05:30 without any context he/she won't even notice that it is AI generated. The speech, speed, voice and even mouth movement is so near perfect to fool any person.

[@MrJonFinger]

woah

[@BhaumikDave]

Even the best can be improved so in this case the only thing I would suggest is if developers can make it a bit less formal. Currently it uses too formal words like a news reporter but setting a tone for a youtubers script is not a big deal but doing this will altogether remove the hair line difference of real and fake. It would be that effective.

[@MelihaMontaj]

Im here because thumbnail said Turkish, yea turkish translation is pretty good

[@adamc6250]

Polish translation is not perfect but fully understandable. Thanks for share.

[@AlexBrandin]

Very helpful! Thank you!👌👍

[@simonav6398]

Italian feedback. Almost perfect but I perceived some 'glitches' that make it clear that the speaker is not a native Italian. But I know many Italians who speak much worse :)

[@jsteidel0]

The second time listening I opened a second browser tab and started it when the first tab playback reached the first English translation. I think the order of the words did change a little. All the different versions were about the same length because the last two were still well aligned. There was a pause in speech but not in expression in the Italian version and then the translation seemed to speed up for a little bit. Since the other translations track so well, I'd anticipate that another translation into Italian would probably be okay. I am curious if HeyGen can do translation on-the-fly during streaming. Also, I wonder how difficult it would be for a professional translator to authenticate such a translation if it were done live, maybe by recording the input & output and being able to annotate the recording with check marks or X marks.

[@mreuphrates8764]

Turkish speaker here. Translation is a little weird on some sentences. Some words sounded more robotic than natural in the beginning. Pronunciation is very good. It made you sound like a native Turkish speaker with Istanbul(offical&prestige) accent.

[@MrJonFinger]

Interesting, how was it weird? Too literal?

[@mreuphrates8764]

"I'm not really trying to be the AI translation guy but..." was translated as "I don't become artificial intelligence, translation guy is here but" from 13:27 to 13:30 your speech speed increased. I assumed AI tried to catch up with lip sync. Translation of "just" to Turkish is always tricky. So, AI translated it as "sadece" which means only and it sounds redundant in the sentence. "You'll probably not get any more translation videos" was translated as second person plural while "Enjoy it" was translated as second person singular imperative. Apparently, AI is having a hard time detecting English plurals. Also, there were a few other minor details but the KZbin comment section is not the place to discuss all of it. I hope I could help with your question. @@MrJonFinger

[@saliheraslan65]

@@mreuphrates8764 If I would watched your video without knowing you are using AI translate, I would say you are Turk.

[@franktielemans6624]

Belgian here. The spoken Dutch is from the Netherlands and not from Belgium, which is what I expected. The sentence structure is correct, although I must say that everything is pronounced a bit slower compared to the original. You sound more enthusiastic in the original, it feels a bit sluggish. I also don't really have the impression that I recognize your voice timbre. Not all intonations are correct either I looks like the frame rate is halved compared to the original. All in all still impressive though, if you don't pay attention you could easily fall for it. I currently recognize that generated footage by artifacts in the ears.

[@Diadras]

Dutch here; He is rather slow and his N and especially his R is super pronounced, which makes it unnatural.

[@_argx_]

I think the biggest issue here is that that In India we don't actually speak Hindi like that in a normal way we mix Hindi and English(hinglish) and their are some weird pacing issues

[@WrongPerson-hq5dt]

Indian here, there are some serious pace issues but overall the translation is nice. The audio is slower than you would normally speak and weirdly speeds up in the middle. Also we usually use a lot of english words even when speaking hindi so it felt like you were forcing yourself to stick to just hindi rather than speaking naturally

[@jotjakubjot]

Hindi is hard

[@inkdouma]

i understand spanish, hindi and japanese, all of them sounds good accurate but the speech speed in some part are faster and slower than it should be (normal).

[@DomLobo]

A queda da qualidade na imagem da região do maxilar me incomodou um pouco. Ainda mais se pensar em um uso para empresas da área da beleza, estética e coisas assim. Masss, a tradução ficou excelente. Tem um leve sotaque mineiro. Mas é muito bom.

[@Jestrick]

Hindi is just 'formal', words that no one really use in casual conversation. It's more like reciting chapters of hindi novel.

[@lorenzoditria4703]

Italian speaker here... The voice is acceptable and the pronunciation is accurate (considering that Italian language is made of lot's of different sound, nuances and dialects). Sometimes, in general, the sound of the voice is a little bit creaky and not so clean as expected. For sure it will be more accurate in the future. Anyway this whole AI thing is impressing... [EDITED] The translation is not 100% accurate.

[@samrajkadam3160]

Robert Lewandowski

[@xuandong3610]

Chinese native speaker is here, the pronunciation is incredible, however the translation is a liitle bit stiff

[@mr.k7294]

WoW!!!!

[@olivnmr1169]

The French translation is good but it sounds like several accents were mixed-up. sometimes you sound french, sometimes canadian and sometimes you sound like an american who speaks perfect french but still has a slight american accent. the result is amazing but doesn't sound natural.

[@KaskoYT]

EL ESPAÑOL ESTA PERFECTOOOOOOOOO

[@umutcansaliheryilmaz4901]

Turkish native speaker here. Translation has some minor problems but still keeps the overall meaning. My subjective view on the tone/accent/voice : it sounds like a native Turkish speaker (flamboyant) gay man =) What I mean is : in a way the pronounciation is perfect but I don't think if Jon Finger would sound like this if he lived in Turkey for 15 years and perfected his Turkish accent. Someone else could sound exactly like this though.

[@marcelosimonmalaquia2602]

Português tá perfeito

[@PowerRedBullTypology]

Dutch > it sort of overly pronounces words, and is very monotonic, which makes it a bit robotic. Some words like 'the/an' in Dutch were missing in the last sentences, which is not natural in Dutch to do. However, what bothered me most was how slow he is speaking. I am curious if it adapts to the speed of a language?

[@bailahie4235]

(Also Dutch native) Well, I agree it sounds quite "lazy". But I think it also partially adapts to the original video - there he also speaks at a relatively slow pace, and is also quite monotonic. (But indeed, not *that* monotonic.) So, in a sense it is even more impressive. It is impressive either way, the Dutch is very convincing. I wouldn't easily notice it was generated content, if I wouldn't have known and wouldn't have paid careful attention. I would think its just a lazy speaker.

[@PowerRedBullTypology]

@@bailahie4235 Yeah, and things like speed can adjusted. Also, in some countries I think people just speak slower than others, on average. Also, it could be that in some languages you need more words or longer words to express something, which could make it seem too slow in other languages, without speed adjustment

[@PowerRedBullTypology]

@@bailahie4235 Hij praat trouwens een beetje traag zoals presentator Valerio Zeno!

[@PowerRedBullTypology]

@@bailahie4235 I have to say though that the most impressive thing though, which is the matching mouth movement is totally on point. So even if the voice sounds a bit robotic because it's a bit to monotonic/robotic, I am sure they will solve this with upcoming updates!

[@bailahie4235]

@@PowerRedBullTypology interesting question. Yes, I wonder whether that could be of influence (longer expressions in one language compared to the other). Of course, this depends on the model they used.

[@gianmatteo4702]

Italian - WOW

[@francophone.]

The French (which has a Canadian accent) is slightly off in the translation

[@flowtalks2548]

Ciesz się (jeżeli wybrałeś kierunek lingwistyczny na dowolnych studiach wyższych 😅)

[@MildlyLinguistic]

Advanced Japanese speaker here. Major mistakes, highly unnatural direct translation, and needs a lot of work. You wouldn't understand it at all unless you heard the original English it was being translated from. But that's not surprising since English-Japanese is one of the hardest language pairs.

[@MrJonFinger]

very Interesting, that explains why there has been such little Japanese response on other platforms

[@fynnfish]

The Japanese is hilarious because it really sounds like his second language. I expected it to sound more robotic and of course the content makes no sense for a good part but something about the intonation or accent sounds so much like „real person tried really hard to acquire Japanese language skills, well done, keep going my little friend“ 😂😭

[@jackkendall6420]

@@fynnfish When the computer is a /r/learnjapanese lifer 💀

[@NSPlayer]

Timestamps 😅

[@MrJonFinger]

Yea, I’ll probably do that later today. I just wanted to post it before I went to sleep.

[@58659085089547]

How did you do it? I looked on HeyGen and could not find an option of dubbing over.

[@PanDzikus]

Polskie tłumaczenie jest trochę koślawe. Np. jest: "jak się porusza usta" (trzecia osoba, liczba pojedyncza) a powinno być "jak się poruszają usta" (trzecia osoba, liczba mnoga). Poza tym brzmienie jest bardzo dobre ale nie jest idealne. Jeśli ktoś nie wie co to A.I. i że potrafi robić takie rzeczy, to może się nabrać ale ludzie świadomi będą potrafili się zorientować, że to robota sztucznej inteligencji. Polski brzmi jakby był odrobinę przyspieszony, zapewne dlatego, że jest bardziej rozwlekły od angielskiego i aby zmieścić się w tym samym czasie, słowa muszą być wypowiadane szybciej.

[@piotrmoskal_pl]

albo "jak się porusza ustami" kim, czym

[@PierIsABaraReader]

The Korean one sounds like he was eating something while speaking. The curse of bringing over the American inflections over the consonants I guess 😂 I get that you need to still retain your "voice signature", but man, he sounds like he's drowning 🤣 TLDR: Korean sounds like how you differentiate American Cleo to Australian Cleo

[@siokuengmeng1939]

As a Chinese, I can hear that there are so many grammar mistake, we can still understand but it will be so weird.

[@JonathanBourdon-c5t]

Your french sound exactly like Justin Trudeau

[@komikaze41]

Turkish is wonderful. we say ohaaa

[@vusalsuazad5984]

هل يمكنك فعل ذلك باللغة العربية؟

[@wayneohm]

the korean translation is shaky but the accent is excellent.

[@tuomollo]

Polish translations is not great, you can tell that it was AI translated right away.

[@flowtalks2548]

How many years a foreigner should/could study to get to this level? Good luck!

[@Coidance]

진짜 놀랍다

[@ПавелПавлович-д8ц]

Wanna see Thai language

[@파이리-e9l]

13:56 한국어

[@hongkongischeaper]

Turkish doesn’t look/sound natural - extremely slow and word choices are off for the most parts. The last section of it, however, sounded somewhat better.

[@teofilol2666]

If I don't know better, I'd thought you are some polyglot trying to flex his multi language skills on KZbin 😅