Deep Learning with Python, TensorFlow, and Keras tutorial

An updated deep learning introduction using Python, TensorFlow, and Keras.
Text-tutorial and notes: pythonprogramming.net/introdu...
TensorFlow Docs: www.tensorflow.org/api_docs/p...
Keras Docs: keras.io/layers/about-keras-l...
Discord: / discord

[@wolverine87833]

This guy is really authentic and legit. Doesn't beat around the bush, no cringy intro music, just straight to the point. Best Intro of Deep Learning I have watched so far!

[@MrDots99]

"ok first we need to install tensorflow " 5 hours later i returned to the video haha

[@yelmak]

wait, it only took you 5 hours to get tensorflow installed?

[@samforsberg5698]

how did u install it

[@yelmak]

@@samforsberg5698 gave up with pip and installed it with anaconda

[@benjaminfindon5028]

@@yelmak only 5? bruh that shit took me 24. And I ended up using the same solution i had at the start, with out realizing that was the installation "facepalm"

[@FreakyStyleytobby]

What kind of problems did you guys have? For me it was quicker, i had the wrong python interpreter (32 instead of 64)

[@omkarjagtap2351]

Installs keras, predicts mnist data, feels like GOD

[@sentdex]

After re-watching, I notice I never explained "epoch." Epoch is just a "full pass" through your entire training dataset. So if you just train on 1 epoch, then the neural network saw each unique sample once. 3 epochs means it passed over your data set 3 times.

[@timothyyee1966]

Epoch is just a fancy way to say iteration. Generally speaking, iteration/epoch is used in optimization where weights are updated after each time step. Usually best to learn gradient decent prior to deep learning.

[@windmill1965]

At 4:44 you would want to write " > 3".

[@AladdinPersson]

I like you Sentdex, but there was more than just the word epoch that you didn't explain. For example, what is x_test, y_test and why do we have something different in x_train and y_train? What does flatten mean? What is an optimizer, what does it do? To me there are also several other things left unexplained and sort of swept under the rug. I believe you have the best of intentions and you do help a lot of people in becoming better programmers in several different ways. I just think that you have two options by making these kinds of videos, and the first is that you go through things so that people not just vaguely understand things but actually master them and really understand them. The second option I believe is that you say that I'm going to assume you know the basics of neural networks: and if you don't, go check Andrew Ng out and then come back to my videos.

[@shubhamkadam7956]

I want all the videoes how can I get all of these videos

[@aloufin]

I hope in a near future tutorial you add in tensorboard howto, specifically showing images with a slider!

[@behshadmohebali6234]

This is exactly what I needed as the first clip on TensorFlow and deep learning. Consider this comment as a warm "thank you" and a remote (but firm) hand shake!

[@anishkelkar6434]

This tutorial gave a hands on approach to machine learning unlike most of the other tutorials. Thank you very much.

[@labreynth]

Why do I have to keep coming on youtube to simply learn something (for free) that I came to university for?

[@Jitesh-ek5xf]

Degree

[@labreynth]

@@Jitesh-ek5xf Hardly worth anything these days

[@Jitesh-ek5xf]

@@labreynth hmmm I guess so

[@sharonv3597]

Maybe because they don't explain it well or elaborate more on it? Since that's the case for me, they only teach us the math but not the actual code

[@prateeknayak5699]

Just a brilliant beginning. Finally the KZbin notification led to something amazing

[@abhijeetsharma5533]

In later versions of tensorflow, you need to specify input shape of flatten layer if you are reusing the saved model. model.add(tf.keras.layers.Flatten(input_shape=(28, 28))) instead of model.add(tf.keras.layers.Flatten())

[@omingole7304]

Yes, thanks

[@cyrusparvereshi6454]

Hey Harrison, I just wanted to thank you for making these amazing tutorials! I finished your beginner tutorial, and while it went pretty deep into some things, I have a great toolkit that I can use to explore web development, data analysis, and cyber security! I love programming and your videos are some of the most helpful resources that I have been privileged to discover. I promise I will take this knowledge and apply it to something that will change the world! :D

[@user-cq2oz3qh2l]

ان شاء الله ❤️

[@JustCallMeRob]

I am so happy you are doing an update on this topic right after i finished your main machine learning playlist. Your videos have been very helpful, thank you so much for your work !

[@abdulqayyumahmadzai8275]

I have been following your videos from almost 18 months and its been amazing your tutorials have helped me alot. Thank you for these tutorials.

[@juhotuho10]

now this is the reason i subbed, have been learning python for the last month and can't wait to get deeper into deep learning

[@souravgames]

thank you for revisiting the basics . i just hope its a long comprehensive series

[@ethanraymosqueda3780]

Thank you sooooo much Sentdex. I'm doing my thesis and I needed to learn how tensorflow works. Awesome tutorials here

[@sentdex]

Awesome, best wishes to you on your thesis!

[@AnnnEXE]

I learned more from this video than I did in an entire deep learning course I took last academic quarter. Huge thanks, my dude :^) this is going to help a ton for my thesis work!

[@gil-evens]

What are you majoring in?

[@AnnnEXE]

@@gil-evens Computer engineering!

[@gil-evens]

@@AnnnEXE nice, what's your thesis about?

[@AnnnEXE]

@@gil-evens quantum error correction! It was really really fun :)

[@petr.g]

I have one question. Why is his profile picture more pixelated every time?

[@sentdex]

I'm pretty confident you're the first person on youtube to mention it. I've been slowly changing it :D

[@petr.g]

i thought it is becouse of my slow internet :D, nice vid really appreciate you doin' those tutorials. And i really like your cups.

[@petr.g]

I just thaught it is funny little easter egg...

[@petr.g]

Good for you ;)

[@herbz1037]

yes.

[@roar779]

11:17 *casually drinks from a shark!*

[@liam1558]

@@alamimouad mack the knife? :)

[@abdulwahab182]

I have listened the entire lecture while driving The way coding part was done by reading it loud while typing was superb ! I had the whole picture even without looking at the screen. Bundle of thanks

[@Shaurya_Pant]

This video is awesome! period. I've literally seen so many seminars and videos on KZbin... This is the first one that gave me all the comprehensive details, along while making the entire program... on the side ... Thanks. It really helped.

[@Rushirajloke]

Finally what I have been waiting for..

[@bricktheworld7240]

Thank god, I was following the old tutorials and these are so much easier.

[@sentdex]

Glad to hear these are easier to follow!

[@MrCreeper20k]

Thank you so much for this, I have started learning and done the “hello worlds” of keras and am really trying to get to some advanced stuff and hopefully eventually reinforcement learning

[@jamesward7554]

This is absolutely amazing. Please continue this! Absolutely love your work

[@rishisharma5249]

I had searched so much for this type of video!!! Ufffffff!, Finally got it thanks you very much for this and eagerly waiting for next videos too 😊

[@timothyyee1966]

This was excellent. I’m a novice in ml and this is easy to follow and understand. Please do more. I’ve gotten lost in other people’s tutorials and videos that I just lose motivation and interest because they don’t simplify concepts like you do. Keep it up! Also appreciate the use of iPython nb.

[@sentdex]

I will do my best to keep going in this style!

[@intersstella]

Thanks for this video! It has stood the test of time, and was a great intro even two years after its first upload.

[@christopherhall1216]

Nice vid. So many videos ramble on side thoughts and spend 20 minutes explaining their hypothetical use case. This dives directly into it. Thank you!!!!

[@JamalAbo]

17:50 Actually, predictions = new_model.predict([x_test]) broke the program, then I changed it to predictions = new_model.predict(x_test) And it worked Fine :)

[@geraldhoxha]

Thanks

[@isabellebernard1903]

Same here, thank you! I was looking for an answer :D

[@ashishjohnsonburself]

same here too... thanks

[@brianrosario82]

Thank you :)

[@babakmbm]

same

[@johannesschmid9239]

GREAT JOB! You explained it very well, thanks a lot. Thats exactly what I searched for! However, I think for beginners you should also mention the parameter y and that it is the label of the respective x.

[@sayonbhattacharya6092]

Took a day to do this, but I thoroughly loved it. Thanks to his simple and interesting explanation.

[@sabrinalzahrani9710]

You made it very simple for me, I was pretty lost before this video! Thank you man

[@user-ur9fs8cx4f]

Thank you for the wonderful work!

[@PandoraMakesGames]

Another great tutorial! Inspires me to make my own AI videos.

[@3nrasandun]

Thanks bro.... This is the best ‘getting in to Tensorflow’ video I found

[@guitarmaniac091]

Man, I could kiss you. I've spent the better part of a week trying to find an up to date tutorial on keras where the person actually types the code out and explains what it does as he does, and this is exactly what I've been looking for. Very helpful!!

[@ivangouvea4195]

Incredible tutorial, I am familiar with TF and Keras and this is super well explained. Covered everything a learner should know. Something cool for next one is AutoML or Autokeras

[@Stinosko]

I have a question and didn't really remember if you covered it, why do you use Jupyter to code in for this tutorial? Or did you explained in another video/written tutorial?

[@JasonWhittle1]

So glad you're updating this. Especially with a higher level package.

[@bee00778]

One of the best videos ever I watched for a begineer.

[@shyampadia]

Could you also talk a little about static vs dynamic graphs in tensorflow and pytorch in one of the future videos. It would be a huge help

[@sentdex]

Thanks for the suggestion. I'll see about working that in somehow.

[@anjithnair3082]

Please make a playlist for deep learning. From basics to advanced stuff. It will be super helpful.

[@tm1813]

hi Sentdex, I think I remember that I ever downloaded your Tensorflow videos, maybe in a year. However, I cannot find it now. To tell the truth, I did not understand enough for those old videos. However, these series for Keras are far more understandable. I really appreciate your contribution!

[@ashiralam1115]

Eagerly waiting for the followup. This was very helpful

[@manishdhal1351]

Amazing ... waited a long time for this !!

[@sentdex]

No more waiting for you!

[@w1malik]

How can I decide to pass 128 units like you did in adding 128. You said this is number of neurons. How can I decide the number of neurons according to the data I have.

[@user-fy5go3rh8p]

I cannot thank you enough for your work! Great job, very helpful.

[@vaibhavpoliwal2820]

I am totally beginner to deep learning, and really this is best explanation for making your first neural network model with TensorFlow, thank you very much for your great explanation.

[@MrFuxya]

Yesssssss, I want moreee!!!

[@Salman-xz4km]

Please little Pytorch tutorials also .... cause its Lit and easy to follow and more pythonic

[@darkhorse5848]

hands down the best channel to learn deep learning from

[@Suigeneris44]

Lovely lovely explaination! Lovely! What I have realized is: if you want to perfect python coding or any coding...you have got to practice!Practice!Practice!

[@Killercs14]

Honestly, where do you learn all these stuff at such pace? You dont even have a cs major background. Not sure if this is impressive or a sign of my own unproductivity :( Regardless, I appreciate your existence

[@SJ23982398]

It is always nice when people appreciate your existence.

[@elirockenbeck6922]

@@SJ23982398 speak for yourself

[@jorostuff]

It's called passion.

[@onkulis5720]

books

[@SethuIyer95]

Yoooooooo this is amazing

[@TZPlayer]

Thank You!!!!! I've been wanting one of these for ages now!

[@maclee2036]

simply love your channel. you have explained this far better than my professor.

[@WorldBluegrassDay]

Anyone experiencing this error: "ValueError: You are trying to load a weight file containing 3 layers into a model with 0 layers. ". Change this line: model.add(tf.keras.layers.Flatten()) to: model.add(tf.keras.layers.Flatten(input_shape=(28, 28))) Should resolve the problem.

[@alejandrorosales3057]

how does this work? and thank you

[@coryrandolph8501]

You need to add the input_shape: model.add(tf.keras.layers.Flatten(input_shape=x_train.shape[1:]))

[@ankurchauhan9631]

Thanks Dude

[@TheHamza300]

Thanks, buddy, I was experiencing that error for quite a while

[@ThomasPlaysTheGames]

I was on the right track with the error. Thanks for the help.

[@FarGamingOfficial]

*I gotta get that shark mug*

[@taijosephinedanielle2962]

The fact that he Explained reasons behind every step is the most pleasing. Now I have a good understand of how Neural Network works. Thanks a lot sir. I subscribed to your channel already Keep the good job sir

[@mohamedali8428]

Well done, thank you! Finally what I have been waiting for..

[@Julian-ny5tt]

I thought I am watching Edward Snowden teaching me how to code lmao.

[@manassengudia1854]

😃😃

[@appchu5671]

Same

[@loisewanjiru9600]

hey, i need help . am experiencing this error when i try to train(fit) the model. ValueError: Data cardinality is ambiguous: x sizes: 60000 y sizes: 10000 Please provide data which shares the same first dimension.

[@nickgerwe5302]

I had this same issue, but then noticed a copy and paste error when normalizing data. Make sure your x_test is normalized using x_test rather than x_train. When I updated my code to as show below, it worked #normalize data x_train = tf.keras.utils.normalize(x_train,axis=1) x_test = tf.keras.utils.normalize(x_test,axis=1)

[@prudhvikumar6293]

@@nickgerwe5302 ValueError: Shapes (32, 1) and (32, 10) are incompatible did you come across this error by any chance?

[@altenwerthriqalexbal7577]

Getting the error: "I'm too stupid and this seems way beyond my level of understanding". Amazing ... waited a long time for this !!

[@anirbanghosh6328]

hey bro im getting ERROR:root:Internal Python error in the inspect module. Below is the traceback from this internal error.

[@rezaniazi4352]

Good timing ;) I just see your old videos months before but it was pain in the a** for me to learn and in mean time figuring out how to use the codes in newer version of the program Thanks a lot man ! Now I subscribe ☺️

[@gregfield4457]

I came across an issue when trying to print val_loss, val_acc it was complaining about the shape being 10000 and needed to be 60000 seems to work by normalising using x_train, x_test = x_train / 255.0, x_test / 255.0

[@kIocuchl2]

Yeah, I had the same problem. You have to comment: #x_train = tf.keras.utils.normalize(x_train, axis=1) #x_test = tf.keras.utils.normalize(x_train, axis=1) and write x_train, x_test = x_train / 255.0, x_test / 255.0 instead. Thanks man!

[@issamjadar5415]

@@kIocuchl2 x_train = tf.keras.utils.normalize(x_train, axis=1) x_test = tf.keras.utils.normalize(x_test, axis=1)

[@lhorbrum1818]

Getting the error: "I'm too stupid and this seems way beyond my level of understanding".

[@mapri50]

Thats no wonder with your profile picture

[@jensenraylight8011]

*suddenly the model works:* maybe I'm a genius after all

[@feraudyh]

I think this is not the right place to enter the subject, he already assumes a lot. This is a place to consolidate your knowledge by implementing a demo. Sorry I can't give you a pointer to an introductory reference, but there are dozens of those.

[@cryptogh2797]

Don't worry... Use Google colab.... You don't need to install tensorflow just import it

[@enderkulucka]

I use kaggle. you don't need to install tensorflow.

[@piyushvermaiitkgp]

Thank you so much! Came here after going through all the theory/maths behind the NN, and strongly needed python syntax to execute it.

[@SHAP179]

That`s what we`ve been waiting for! Keep up the good work!

[@eazye7059]

i have this error in Jupyter notebook after installing and importing Tensorflow The kernel appears to have died. It will restart automatically.

[@AbhishekMishraiitkgp]

I had the same problem. Try conda install nomkl . Install nomkl package in the same environment you are running your jupter notebook in.

[@bricktheworld7240]

Do you think you could do a tutorial on reinforcement learning?

[@sentdex]

I would like to include that in this series for sure.

[@KartikayBagla]

sentdex please do it, I've kinda been stuck at making cartpole work properly.

[@MegaTRIANGULUM]

sentdex yeah! Deep Q would be great

[@houdamouttalib4729]

cool

[@tejaslotankar5430]

Really Have been waiting for this from long time!!!! Thanks a lot!!

[@leahg_]

Best tutorial I've seen yet, not once did I stop and think "what is he talking about?" lol, thank you!!

[@masbro1901]

8:07 NameError: name 'x_train' is not defined , what happen ? where's that image 7 i can get

[@anuragsuresh5867]

mas bro run the first line before

[@X_platform]

Yes! Tensorboard please!

[@aswathgi6468]

Awesome❤️🔥! I was waiting for this tutorial ❤️❤️

[@loicdumortier4634]

I used to be jealous on your programming skills. Now I am jealous on your programming skills and shark cup :) Great video!

[@vashistnarayansingh5995]

I am getting error on executing the mode.save() line it is showing not implementation error I am using Google colaboratory to train the model

[@TimvonHahn]

It seems to be a bug... I'm had the same problem. See the github bug report here: github.com/tensorflow/tensorflow/issues/22837 I down-graded to TF 1.10 and it solved the problem.

[@Crabbpower]

If you want to use the latest version you need to give the Flatten layer class the input variable input_shape like this: ` model.add(tf.keras.layers.Flatten(input_shape=(28, 28)))`

[@recepuludag6655]

@@Crabbpower thanks a lot man, i was getting crazy does it matter if the parameter of input shape is more or less than the original pixel size. i think it matters do you know any way to overcome this

[@Reventonn134]

@@Crabbpower love ya man, saved me the hassle

[@Sam-jg5zv]

Try import keras as keras instead of import tensorflow as tf. then, change all the code tf.keras to just keras.

[@theerawatramchuen9886]

I hv got an error " ValueError: The first layer in a Sequential model must get an `input_shape` argument. " on Jupyter notebook. My tensor flow is 1.5.0 Version GPU. Kindly advise solution.

[@andrescuenca1122]

getting this same error, did you figure this out?

[@MichaelGauciMT]

Include an input_shape argument like this: model.add(tf.keras.layers.Flatten(input_shape=(28, 28)))

[@coryrandolph8501]

model.add(tf.keras.layers.Flatten(input_shape=x_train.shape[1:]))

[@jorgesilva932]

This video is awesome, really waiting for the next one on the topic.

[@zozozozo4503]

يسعد ربك من سورية عم بتابعك You are a good man I follow you from Syria

[@anandchavali6299]

You should make separate playlist/series for basic and advanced so we noobs can level in a more linear fashion. not a total beginner to advanced but like a more explaining on a whiteboard how things work series

[@sentdex]

Compared to this video, you want more basic, more advanced, or similar?

[@anandchavali6299]

sentdex similar or advanced, I think we all love you because your videos are so deep and connecting they make difficult difficul'nt

[@fxelix9951]

sentdex I really enjoy your videos, but since I haven't worked with tensorflow or similar this video threw many new functions and commands at me :D Could you maybe write some comments next to what you've done? It makes things easier to follow during and later on :) Additionally, any good updated resource to Keras/tensorflow you can recommend?

[@Dockmark5]

sentdex I vote for more basic : )

[@RedShipsofSpainAgain]

more advanced please

[@quanghuy8794]

IDLE: mr.Harrison i don't feel so good..

[@sentdex]

Hahah :)

[@chongchonghe3748]

Best TensorFlow hand-on introduction on KZbin. (This is actually the first video of this kind I watched, but I don't think I need to watch another one.) BTW, watching this after watching 3Blue1Brown's series video on Deep Learning is a joy.

[@sameris6581]

Huh, that worked surprisingly well for me. Thanks for this!

[@ifeanyindukwe3086]

Hey, I seem to get this error ValueError: You are trying to load a weight file containing 3 layers into a model with 0 layers. whenever I run the line of code below: new_model = tf.keras.models.load_model('epic_num_reader.model') Any hint of how to resolve this??

[@ZahidulHossain]

Same here. Keras has an issue opened on github github.com/keras-team/keras/issues/9822

[@alokrajgupta9452]

You might use this for tf version 1.9.0 model.add(tf.keras.layers.Flatten(input_shape=x_train.shape[1:]))

[@kinlam6304]

change the first line in the model to this : model.add(tf.keras.layers.Flatten(input_shape=x_train[0].shape))

[@vaibhavsingh1049]

Check this stackoverflow.com/questions/52664110/attributeerror-sequential-object-has-no-attribute-output-names/53980337#53980337 As per the changing to "keras" from "tensorflow.keras", just remove the "tensorflow."part and rest is the same

[@thedosiusdreamtwister1546]

AI: "When you smile, you go from a 6 to an 8!" Me: "You were trained on the mnist data set, weren't you?" (True story)

[@anfechtung-143bgb4]

whats the mnist data set ? Do you mean 8! = 40320 or just 8

[@thecityofknowledge]

love your teaching way.really amazing

[@farnazfarhand5957]

it was really clear and helpful honestly you save from confusion in this case

[@DaStuntChannel]

How can you have 60000 samples as input and 10000 as target? I get "ValueError: Input arrays should have the same number of samples as target arrays. Found 60000 input samples and 10000 target samples."

[@tingupingu3394]

You found out how to get past the error?

[@DaStuntChannel]

​@@tingupingu3394 This code is very old, I recommend you to go somewhere else, don't remember the specific fix

[@GeeVaaz]

@@tingupingu3394 from another comment here: NonyaSerdo 3 meses atrás I had the same problem. I accidentally forgot to change "x_train" to "x_test" in the second normalize statement. Correcting that gave me the expected results.

[@RagnarLothbrok1337]

@@GeeVaaz Thank you. I wonder how this ever worked for him in the video.

[@sachinswamy5264]

predications = new_model.predict([x_test]) ERROR: list index out of range

[@bharatsreyus8748]

yeah same here... anyone of help pls???????

[@bharatsreyus8748]

model.add(tf.keras.layers.Flatten(input_shape=(28, 28))) #this solves the problem mate! : )

[@akshaybhardwaj10]

Each and every series of yours is so well explained

[@sentdex]

That means a lot to me to hear, thanks!

[@sergiomares9952]

Great video! Thank you again, this is probably a great overview super high level but so good

[@twiddle7125]

I know this is an old video and I know you're using the convention of X being input and Y being output, but I think it is important to really explain that since for this particular example your data is a plot of x and y points in a 28x28 grid. I was slightly confused for a while until I printed the y values to see that they were the outputs and not the y-coordinate data.

[@maghribioujdi]

whenever i do the part of predictions = new_model.predict([x_test]) i get the following error: 'list' object has no attribute 'shape' i'm following the exact same steps as you did and i was carefull with any typos

[@SmartieEdits]

what worked for me was removing the brackets around x_test: predictions = new_model.predict(x_test)

[@wenyiyan2945]

Yea, it works after I removed [ ]. I am confused that Sentdex emphasizes that should put ([test]) not (test) in the video. No idea why his code doesn't work for my python environment.... @@SmartieEdits

[@xinking2644]

I like this video, sentdex's explain is simple and easy to understand, and he is a passionate person!

[@homiehari]

wow this was one of the first tutorials I ever used to build a neural network. crazy discovering this page again from your QLora video.

[@meda3li]

91 dislike????? i'm wondering whyy ??? it's just perfect (for biginner)

[@Doomer6969]

he doesn't explain anything

[@Aayushcv]

no. I am struggling with this..

[@fazilmes]

Getting error while loading model in Google Colaboratory. [AttributeError: 'list' object has no attribute 'shape']

[@Adam_Nemcik]

@Jostein Dyrseth Same issue here. In case i use just >>> predictions = new_model.predict(x_test); I receive : "IndexError: list index out of range" Any idea how to fix it ?

[@mdmasumbillah1796]

Dear sentdex, Your Videos Helped Me A Lot. Thank You Very Much.

[@oxydol3456]

This video teaches me a lot. Thank you.