How to Make a Language Translator - Intro to Deep Learning #11

Let's build our own language translator using Tensorflow! We'll go over several translation methods and talk about how Google Translate is able to achieve state of the art performance.
Code for this video:
github.com/llSourcell/How_to_...
Ryan's Winning Code:
github.com/rtlee9/recipe-summ...
Sarah's Runner-up Code:
github.com/scollins83/teal_deer
More Learning Resources:
/ machine-learning-is-fu...
www.tensorflow.org/tutorials/...
devblogs.nvidia.com/parallelf...
• A Practical Guide to N...
neural-monkey.readthedocs.io/e...
blog.systransoft.com/how-does-...
www.wildml.com/2016/01/attenti...
blog.altoros.com/enabling-mul...
www.quora.com/How-can-I-build...
blog.heuritech.com/2016/01/20...
smerity.com/articles/2016/goo...
Please Subscribe! And like. And comment. That's what keeps me going.
Join us in the Wizards Slack channel:
wizards.herokuapp.com/
And please support me on Patreon:
www.patreon.com/user?u=3191693
Credits to Biggi Hilmars for the intro tune
Follow me:
Twitter: / sirajraval
Facebook: / sirajology Instagram: / sirajraval
Signup for my newsletter for exciting updates in the field of AI:
goo.gl/FZzJ5w
Hit the Join button above to sign up to become a member of my channel for access to exclusive content! Join my AI community: chatgptschool.io/ Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available):
www.wagergpt.co

[@braa194332]

I really appreciate that you're a professional who's willing to share his expertise, even though I'm not interested in this subject. Unfortunately when senior Chemical engineers retire, they leave the plant they worked at and their 30+yrs knowledge goes with them. They fix problems that appear in the plant with properly logging the events, but only in their minds. So when they retire all the professional knowledge is lost. What you are doing here is really special, thank you.

[@rccowboys]

dam, that's exactly what i was thinking...

[@michaelpatrick6024]

*I like the design of the **Bestt.Digital** translator , and charging case. It is little bit heavy. The application is easy to use, but there are things to be improved. For example, I knew the earbud are connected to the phone, but I didn’t know I need to reconfirm it again, so I would be able to use “Speaker mode” . I took sometime to find it though.*

[@AIInsightsNClassics]

Love your vids! And the rap parts are awesome! Thank you for showing us how easy is ML. For me as an statistician it's a pleasure to see what you create each week!

[@SirajRaval]

thanks Rafael!

[@arekbee]

By the way, Marian Rejewski was the first polish mathematician who broke Enigma machine in 1932, before WorldWar 2 and before Alan Turing.

[@ankishbansal420]

Memory ain't enough, Pay attention..... I like it very much. Thanks Siraj for this wonderful video.

[@Fireking300]

Thank you, Siraj. This probably isn't because of me but I requested this topic in the last videos comments and to my surprise this is the next topic. I'm very happy to see this video.

[@SirajRaval]

Awesome, thanks Anon!

[@sigmaanalytics4891]

@@SirajRaval would you help me where can I find Indian languages data sets ?

[@Jeff-pw6to]

your explanation speed is way much better ! Thank you !

[@SirajRaval]

thanks Jeff

[@MaxIme555]

Great work, love your channel! It's all starting to make sense but still wouldn't be able to write a model for a new problem yet. Also love the rapping, really cool ;)

[@SirajRaval]

thanks Max!

[@sal5858]

greetings from Kuwait! I'm intrested in translation field in general and this video helped alot! thank you very much for sharing this well-executed video. subscribed

[@jamesabasifreke]

Hi Siraj, you create LIT content! I love it. Keep up the good work. I'm learning so much to hopefully impress my interviewers at Google. :)

[@SirajRaval]

thanks Abasifreke!

[@matheusd.rodrigues429]

I was sent by Daniel Shiffmann (actualy by you on his channel) and You are amazing!

[@larryteslaspacexboringlawr739]

thank you for another tensorflow video

[@NattapongPUN]

Thank you for your great VDO. I'm learning from you. :)

[@King15kunal]

Hey Siraj could you please make a video on NMT (Neural machine translation), which is one of the advanced machine translation methods.

[@DanMana1]

Hi Siraj, could you please do a video on bounding box detection? I really like your videos, thanks for all the effort you put into making them

[@SethuIyer95]

Quality of the video is awesome!

[@SirajRaval]

thanks Sethu! Good to see you :)

[@AceofSpadesss]

I see, so you need to add a script element with path to js file to html to make hello world. That makes a lot of sense, thanks.

[@oliverli9630]

awesome! looking forward to your incorporation of the context, a very important factor. for example, In English, "You aren't a student, are you?" (if you are) "Yes." In Chinese, "You aren't a student, are you?" (if you are) "No." not just the whole article, if you are translating a movie, i think people would be interested in knowing how to label everything and teach the machine to learn them. looking forward to that

[@oliverli9630]

character actions in movies can change the translation, you know.

[@SirajRaval]

great points thanks Oliver

[@fredcmdy]

great as always

[@SirajRaval]

Thanks Fred!

[@youmobilepakistan5146]

Just started with OpenNMT, one simple question: Once trained and deployed, does the neural network grow upon each usage? i.e. if I train OpenNMT then deploy it on a server and make it public, will the machine keep learning unsupervised when people use it? Does the knowledge base of the machine grow?

[@salrite]

Hello Siraj, its World :-p "Great videos, thanks... "The way you teach/share knowledge is way different from anyone. Your excitement makes vids interesting :-p Though Some of the topics needs more details .

[@jennac3758]

Good to know that google translate can be trusted tomorrow, I'm going to translate sentences to Italian because there's a girl in my 6th hour that doesn't speak English and I want to talk to her hope it goes well 🤞🏻

[@themonkeyminds7252]

Jenna Lynn hi How are you?? Can we become friends??

[@jagmohansingh3120]

Hi Siraj, I am new to machine learning. I have seen bunch of your videos which are very good and interesting. I have one question, from where do I start as a beginner. Should I continue directly from deep learning or clear some my basics first. I have experience in python so that will not be a problem.

[@charlesbuckman7492]

Awesome videos!

[@SirajRaval]

thanks Charles!

[@chicken6180]

woah! neat. do you ever plan on doing any videos/tutorials where numpy or other ML libraries aren't used? like, just python and numpy?

[@SirajRaval]

hey Spark. Hmm yea, for Generative Adversarial networks which are coming up.

[@DosellIo1]

love it!

[@SirajRaval]

woot!

[@arpitsrivastava8431]

Hey Sir,how can i start deep learning as i am new to this field.

[@PreciousOpal]

I am not in this level of education...but i was plotting on making a deep learning ai system you can carry on with mic for listening and small form monitor you can carry on and it translates in real time words spoken in any language. Again, i know nothing about this stuff but it seems like its well on its way...reguardless....if the system is made maybe it can be incorporated into a dfesign like the idea i got....maybe the lack of knolege comes from the lack of having that type of hardware...i love learning things

[@hanyuliangchina]

thank your awesome video, siraj. Maintain an efficient working learning state, what keys do you think is ?

[@SirajRaval]

ill make a vid on this soon thanks tony

[@juubes5557]

Hey! How do I resize images for my neural network?

[@aryopradiptagema6677]

how to add attention on top of a non seq2seq lstm? i wanna do a text classification and i think attention might help (mathematically)?

[@randyellis6924]

When I run: from tensorflow.models.rnn.translate import data_utils I get an ImportError saying "No module named tensorflow.models" Any help, please? Thanks in advance.

[@rockking]

import data_utils replace it

[@AnimeshBasak]

did you solved it because i am facing the same problem.. how to solve it?

[@WilsonMar1]

[2:28] coding begins [7:35] execution statements and responses

[@jasonhaven7170]

Wilson Mar thanks

[@MirkoPlitt]

Is this meant to work with a specific version of TensorFlow? I'm on 1.0.1 and it throws errors ("has no attribute 'rnn_cell'") which are apparently related to some undocumented changes between TF versions. I've also been running into other errors but have been able to figure them out -- is this part of the challenge? ;-)

[@SirajRaval]

yea rnn_cell was moved to contrib github.com/tensorflow/tensorflow/issues/7664 this is the hardest challenge i've given, i will honor even an attempt keep it up

[@000FURQAN]

Thankxxx siraj , u r awesome man

[@SirajRaval]

thanks Furqan!

[@yantons]

I am getting below error when running this. Siraj could you please help."Valueerror: Variable proj_w already exists, disallowed. Did you mean to set reuse = True or reuse =AUTO_REUSE in VarScope"

[@DataScienceExplorers]

Your codes don't usually work as shown, however videos are encouraging.

[@jigyasasakhuja8070]

can you please tell me what is a cross-lingual translator ?

[@hussain5755]

can any one please give me a link to how to set up the environment for tensor flow, jupyter etc/??

[@ronwein2990]

Great video as always Tnx for sharing!! Would it be possible to share the weights of your videos? it would be much better to see results that way for the poor who don't use gpu:)

[@oliveredholm4284]

Cool video Siraj! What's the music in the beginning?

[@SirajRaval]

in the vid desc at the bottom, thanks Oliver!

[@gabrielcostanzo9121]

Can you do a video on a hardware solution? With an arduino, raspberry pi or something like that. Your vids are great, thanks for uploading!

[@diegoantoniorosariopalomin4977]

you mean running like running neural networks in a mini pc ?

[@gabrielcostanzo9121]

Diego Antonio Rosario Palomino could be anything really I'd be interested in what he could come up with. Hopefully the use of sensors or motors.

[@diegoantoniorosariopalomin4977]

Example ! i want to make a rc car controlled by a neural network , if that kind of computing is lite enough i will be running it in a mini pc mounted on the vehicle

[@rowansmith8472]

First result on a web search: wroscoe.github.io/keras-lane-following-autopilot.html

[@AviPars]

Example ! agreed

[@motivationmusic4821]

thank you for using python3 this time!

[@jayventura1]

Can I ask a sample format for the source language or target language? Thank you very much in advance!

[@quickdudley]

I think it's one-hot encoding with one input for each word known by the network.

[@prathamnishad1033]

can we use machine learning to convert code from one programming language to other.

[@gravypadruski462]

Check Transcoder by facebook

[@josipvukoja7197]

Siraj you should get a professional mic with a filter! It will put your videos to a whole another level ;)

[@anjana9037]

Can we buy this device on Amazon

[@SouthernHerdsman]

Translation between policies and pseudo code instructions will create an enormous shift in paradigm in ?.

[@YEILD-YOUR-SOUL-2GOD-ONLY.]

Hi siraj how do you create a language software for yr country,so it can be downloaded in all devices in our era

[@kinsleyKJV]

hey can you make an episode on Latent Sentiment Analysis on score essays to a numeric value or grade say 90% or 20% in python. There's is little content on KZbin that fully describe Latent Sentiment Analysis ,most of they just talk about TF-IDF,so i am looking for more really.

[@alemmat1750]

You are the best

[@SirajRaval]

thanks Jorge!

[@VideoNash]

thanks

[@joshanishweb]

is this machine good enough to satisfy all our deep learning stuffs

[@lolpop7799]

where do i have to put that tranlation zip file?

[@mohammadreyaan6214]

please guide me . . How i make portable language translator offline device with the help of arduino or pi ?

[@datacoders2048]

bro is it possiple to find which is their native country based on the photos through giving collection of photo he is indian and he is britain

[@wolfganggermain7175]

I know this is an old post but anyone know the winner of this one? Please

[@fieldmarschalcoramine9654]

Can you make a video over Gene expression microarray data like ACGT... using DL? Thanks in Advance :)

[@prasadkatkade6703]

I am newbie here can anybody tell me how to solve error "no module named data_utils "

[@bindiberry6280]

WOW!!! TensorFlow works for sign languages as well !!! How ?!! Please, show us !!!

[@ebtesamh9624]

which version of tensorflow did you used

[@kristoferbrethower1656]

if you use 0.12.1 it should work, but you need to downgrade to python 3.5.X

[@uttamdwivedi7709]

Hi, I am using this tutorial to create a webpage, where anyone can upload the document (pdf, docx) to translate the file. Can anyone help me on how to get the pdf document in python and extract the texts to translate it?

[@a.m.m9203]

mr.Siraj Raval nice to meet you my name is nandar im from indonesia

[@badrotaibi4229]

Siraj u r Great

[@sukumarh3646]

from tensorflow.models.rnn.translate import data_utils I am getting the error that this package does not exist. How to solve this?

[@sukumarh3646]

I have tensorflow but for data_utils, i am getting the error 'unresolved reference'

[@nuraisyah9509]

Hi. did anyone know how's to create a transliteration machine learning that can solved homograph disambiguation using python?

[@sandeerads]

My requirement is to do a style translation of English language from informal to formal style. Is it correct to take this approach for my task??

[@NicheAsQuiche]

This would work, but this is kind of an outdated architecture for Natural Language Processing. The new state of the art is BERT, which focuses completely on using attention and has no recurrent layers. They would both do the job but BERT would perform better, though it would be a much larger model.

[@sandeerads]

@@NicheAsQuiche Thanks for your reply ❤

[@MrTk3435]

Siraj, can you please show the 10,000 hours project? I like to see how I can shorten the learning process in any subject. thank love u :-) :-)

[@VictorGallagherCarvings]

What we now need is and English to English translator.

[@rowansmith8472]

Like a dialect translator? en.wikipedia.org/wiki/List_of_dialects_of_the_English_language

[@harjitsingh7308]

American english to real english translator would be great

[@liperuf]

puta merda, esse é meu novo canal preferido no youtube. [pt-br ;)]

[@mfonseca]

meu também!

[@SirajRaval]

legal!

[@navyazaveri2993]

Background music? ;)

[@SirajRaval]

in the vid desc at the bottom!

[@joshanishweb]

hi siraj what laptop do you use

[@SirajRaval]

macbook pro 2016

[@mfonseca]

Nice Portuguese pronounciation! :)

[@SirajRaval]

thansk Marcio!

[@Haahahahahaaa]

the rap man

[@kedimiow4249]

How can I discover a foreign language look like russian? do you tell me?

[@vishalkhatri432]

have you done any Hindi to English translator . if yes then give me the code or this same code works in it...thankyou.....reply as soon as possible brother....

[@kyliereadd9147]

I wonder how this would work with a language that is made up.

[@anamnihal7566]

Good

[@ahmadziayousufi4646]

2:22 PASHTO ;)

[@lalithanimmaraju3316]

Wrooooooong! 4:19 such things made me to prefer ur videos :) :)

[@TheNemzy]

Coding challenge: github.com/Nemzy/language-translation

[@SirajRaval]

excellent work nemanja

[@FranksWorldTV]

You make AI meme-a-licious! :P

[@SirajRaval]

thanks Frank!

[@lancetherandomgamer8617]

the language i like to speak is BOBLISH TRANSLATED (እኔ እዚህ ድረስ አግኝቻለሁ ፣ የሴት ጓደኛዎን ይሳቡ እና እርስዎም በህይወትዎ ቀሪ ሥቃይ እና ሥቃይ ሊደርስብዎት እና ሥቃይ ደርሶብዎታል)

[@ash38287]

I thought I might be a clever person. I watched this video. I am not a clever person. The end.

[@amrutha46]

Siraj, pl help me with mathematics behind google translator

[@LaTortuePGM]

it's "prend-moi dehors", 'cos attrape is like catching a fish, but prend is take, but catching someone in a sexual way as well, so it's more appropriate to the context. ;)

[@rabiaaiqbalmalik5208]

Can you help for english-urdu machine translation model?

[@m.nmalik6264]

Are you researcher or translator? Would like to share insight about ML and AI?

[@plutonium_guy]

read face and play songs according to the mood of that person using machine learning

[@0308valentin]

A little hard to set up due to the size of the touchscreen and lack of specific instructions kzbin.infoUgkxNkNu8Sb6OAjgDHKMklYTaO-lJ4YPAIoS but when set up it is easy to use., I look forward to using it in travel when I am in a country where I am clueless in the language.

[@hebozhe]

Uh, okay, at 5:03 , that Chinese sentence isn't correctly tokenized. "知識 就是 力量" would be correct.

[@delusivecontentment544]

I came to this video to figure out how to make a translator that could translate sentences from a document into a created fictional language... Wellpppp.... That didn't work out.... Haha.

[@diegoantoniorosariopalomin4977]

now that you mention IBM , do they still make any products ? Are they a company that just sits there sucking money out of investors ?

[@KylePiira]

They're still a pretty big player in the field of AI.

[@diegoantoniorosariopalomin4977]

Kyle Piira what have they done ? do they have s ml library like tensorflow ? , or a collection of ml obstacles like open ai ?

[@KylePiira]

They offer a decent number of cloud ML apis www.ibm.com/watson/developercloud/services-catalog.html

[@diegoantoniorosariopalomin4977]

Kyle Piira each of these services seems like personal projects someone interested in ml would have on their github , not products made by a company . In fact most are things that siraj has made videos about ( sentiment analisis , chatbots language translation ) , so people who follow this series probably have remade all of this and understood it well enough to improve upon it ( coder challange of the week )

[@SirajRaval]

hey Diego, yeah Watson is their biggest product right now but google is better than them in every way nowadays lol

[@jamesbhattacharya3880]

Siraj, you look very much like Sergey Brin!

[@SirajRaval]

never got that one before. thanks!

[@SirajRaval]

But remember its 'Sergey Brin looks like me' :)

[@abhaskarchary3809]

Hi Siraj, I am a computer science student recently started working on a project on machine learning. I need to make a bot to learn the game "chain reaction" that i have coded in pygame. I'm stuck on how should I implement the bot. Some help would be really appreciated!! Thanks in advance..

[@DigitalMonsters]

Using Ghibli on your thumbnail is playing dirty, how could I not click.

[@SirajRaval]

haha

[@fitipapani9805]

2:27 samoan uwu

[@Ponape4]

SMT and neural machine translation are great, but they are not useful for minority languages which do not have parallel corpora (Quechua, Wolof, Chamorro...), and that's a pity.

[@mohamedahmed-fn8qb]

? can you make video for face recognition

[@SirajRaval]

coming soon

[@davidsalleyezonme1283]

Portuguese yeahhh

[@SirajRaval]

yeahh

[@plutonium_guy]

or marIO type ai for neural networks game player for counter strike​ using neural networks