Basic Computer Vision with ML (ML Zero to Hero - Part 2)

[@kaustaubh1234]

A sensible teacher . Perfect for scientific teaching.Thanks a lot.

[@laurencemoroney655]

Thank you! :)

[@biomystical]

I knew this before, but now I feel like I am really learning it in practice, good teaching style

[@laurencemoroney655]

Thanks!

[@mihir24051969]

I am a non-IT, Mechanical Engineering Professional (27 Years in Manufacturing Industry) and very thankful for the wonderful way of teaching that I ever had in my life!.

[@ConsultingjoeOnline]

I wish I would have discovered this series sooner! Thank you!

[@kciudaras]

Waiting for the next episode! Such a great series

[@laurencemoroney655]

Thanks!

[@kaelhop]

Introducing convolutional neural networks (ML Zero to Hero, part 3): kzbin.info/www/bejne/rpC5o5qNibCen68

[@kzdm5255]

Why are there only 127 functions when there are 28x28 pixels?

[@amankumarchourasiya2279]

Thankyou so much for providing this material. We need tutors like you.

[@laurencemoroney655]

Thanks!

[@eliasdimadis8307]

Great teaching! At last, after years of searching found a great tutorial for that topic! Keep on the great job..

[@raviverma7197]

thank you to the whole team of tensorflow

[@chrismorris5241]

Very excited and appreciative of this series. Doing a great job of simplifying a complex topic. Thanks again and can't wait for the next episode!

[@laurencemoroney655]

Thanks, Chris!

[@alkhashtee]

I don't understand who are those people and what they thinking to dislike this of piece of treasure. Come on and show me what you can do better, instead of just being lazy/jealous and dislike the video. Go ahead Laurance Moroney and keep doing what you doing we all love you and Josh Gordon.

[@LaurenceMoroney]

I do understand it somewhat -- and it's typically people who *already know* this stuff are critical of it being explained this way. In order to keep it simple, I'm trying to layer in concepts, but when they don't see those concepts explained in this video, they think that it is incomplete. That's something that we call 'Curse of Knowledge' at Google, and I'm doing my best to avoid it here. I'm sorry to the folks that don't enjoy it, but you aren't the target audience for this :)

[@torstenknodt6866]

Would be great if you could explain why 128 is perhaps a good value when having these 28*28=728 inputs and you want 10 categories at the end.

[@thedinosham]

784

[@gia7026]

😊ol😊😊

[@shrikantrane9601]

Can you elaborate how exact 128 is ? From how it come in picture ?

[@kitulinokitulino3360]

Great video. Last number of Table showing softmax at minute 5:54 should be 0.978 and not 9.78. These are probabilities and should sum to 1

[@laurencemoroney655]

Good point!

[@kitulinokitulino3360]

Laurence Moroney you’re most welcome :)

[@mistsu1171]

Oh I didn't know it was supposed to sum to 1. I thought it's just a random value...

[@sansha2687]

@@laurencemoroney655 it is not Good point. All the numbers in the row totals upto 10 which is number of labels, you can check 9.78+0.22=10.

[@willv88]

Everything is explained nicely except why the middle layer is chosen to be 128. What if this middle layer was 32, or 300? From a mathematical perspective I understand that more functions likely results in better fitting, but how did you determine the ideal number to use? Also, what if we just skipped this second layer entirely?

[@rohanmanchanda5250]

Honestly, these videos are better than the codelabs,

[@laurencemoroney655]

Thanks!

[@iamrising7176]

Your job description should be: Make Hard Concepts Look Easy. Thanks so much.

[@inquisitivelearner8649]

Loss function - How good/bad the model did Optimizer - generate new parameters for the functions to do better Relu- Rectified linear unit Softmax - Picks the bigge at number in the set Model.predict

[@mustafakhan5821]

I didn’t get these f values. What are they and why 0-127?

[@rickkamlunglee]

Great tutorial and exercise. Just one note on the last exercise (exercise 8) with the following line: if(logs.get('acc')>0.9): Resulted in Error: TypeError: '>' not supported between instances of 'NoneType' and 'float' Quick google pointed be to change 'acc' to 'accuracy' as follows: if(logs.get('accuracy')>0.9): Then it works. Hope it helps my fellow students...

[@laurencemoroney655]

Change to 'accuracy' and try.

[@ayrtonfithiadisedjati5366]

Thank you very much!

[@navidabasi]

Does anyone know why there are just 128 functions to give out a number? I mean why 128?

[@lucasmarques4521]

I just didn´t understand why the number 128. It´s just a arbitrary number ?

[@laurencemoroney655]

Mostly, and it's up for experimentation. Find the smallest one that gives the best results.

[@Themojii]

Great video. Just one typo. Time 5:37 is 0.978 (not 9.78) which is a probability score where all those 10 numbers should add up to 1.

[@su-swagatam]

I was following along with the code and when I tried to evaluate the test set with the model I got a type error:'float' object is not iterable should I cast it as an int? Great content by the way...

[@laurencemoroney655]

Which line specifically?

[@basharwadan8789]

try to divide train_images and test_images by 225.0 train_images, test_images = train_images/255.0 , test_images/255.0

[@manchalanagesh9585]

Ure super , I searched for these some doubts on that youtube, u be right person which u give correct knowledge, my sincere thanks to u by touching ure feets

[@Superman_Kryptonite]

why 128? I didnt get it, why it couldnt be just 100?

[@oliverli9630]

Will next episode explain why 128 neurons in the middle? thanks.

[@laurencemoroney655]

No, sorry. The right number for a given problem is something you need to figure out.

[@oliverli9630]

@@laurencemoroney655 all right. thanks for answering :)

[@krishnakhadka2802]

if u tried out the code in tensorflow 2.0, there are few changes tf.train.AdamOptimizer() => tf.optimizers.Adam() if getting following error: TypeError: cannot unpack non-iterable float object add metrics i.e. model.compile(optimizer=tf.optimizers.Adam(), loss='sparse_categorical_crossentropy', metrics='accuracy') or remove test_acc i.e. test_loss= model.evaluate(test_images, test_labels)

[@rabinadk1]

Softmax doesn't set largest to one. If you just want to get the one with highest probability you can choose from the values of z. Softmax returns probability of each class.

[@kitgary]

After watching this series, I can tell that machine learning is so easy and everyone with enough practice and passion can become a machine learning engineer!

[@laurencemoroney655]

I believe so! Thanks! :)

[@samjithraj7467]

Good Episode.. You explained it a very simple way.

[@LaurenceMoroney]

Thanks!

[@GoribMahi]

Wonderful explanations! Looking forword to more videos.

[@thamizhendiranc4229]

Really gave me the perfect outline for the computer vision. Thank you !!!

[@laurencemoroney655]

Thanks! :)

[@mohammedamirjaved8418]

Laurence Moroney! You are just Love..

[@lethecat]

Wonderful explanations! Looking forward to more videos!

[@roningick5707]

At 4:00 in the video what does adjusting the 128 value do to the training model?

[@weiyewang2903]

Thanks for the sharing, this series really help a lot !

[@psy0rz]

Awesome! Couldnt find part 3, only to realise this is brand new:)

[@LaurenceMoroney]

Thanks! Coming weekly

[@aaronphan3625]

Thanks for the material Laurence. I'm looking forward to future videos.

[@laurencemoroney655]

Thanks Aaron! :)

[@timothymalche8907]

Good explanation but how to determine 128 functions?

[@pradeepjat5929]

Very good series(Love Machine Learning)

[@LaurenceMoroney]

Thanks!

[@felipeletelierbasaez6369]

Where have you been this whole time Sir? Can't wait for the next episode!

[@LaurenceMoroney]

Right here :)

[@smartcontxlimited5658]

Thanks Laurence, this is a great series, very informative.

[@laurencemoroney655]

Welcome! Glad you're enjoying!

[@fatmabradai9601]

I couldn andrestand 128 and the the function f0 .. f127 how it works to get the 9 result

[@stepanvalerivich6999]

Hey Laurence, just to clarify, does the value 128 represent the number of hidden layers we are implementing in the neural network? Looking forward to more videos!

[@laurencemoroney655]

The 128 is the number of neurons in that layer, not the number of layers. The number of layers can be derived by counting the lines of code where we use a tf.keras.Layer(something)

[@popbayern89]

Hello Lawrence, Thank you so much for this series. I am new to Tensorflow and I need to use it to classify images, along with a matrix representation that represents a certain feature (analogous to XML files with Object Detection APIs) ... As I have got no idea where to start, which Tensorflow image classification script or framework would you use, if you were me?

[@JamesJon1187]

Isn't 5:50 argmax not softmax? Also, this course if fantastic! THanks for breaking down everything, unlike some other "beginner" courses that leave all the comprehension footwork to the student!

[@laurencemoroney655]

Welcome! Argmax finds the biggest. Softmax normalizes them to add up to 1 and then finds the biggest.

[@Innovativest]

sorry, where is the code he says it is in the notebook below?

[@rishisharma5249]

Big Fan of yours sir Completed your deep learning. ai courses

[@AllinOne-vd9oy]

Rishi bhai deep learning. ai courses ki link share kar sakte ho

[@samjithraj7467]

Rishi Sharma from coursera ?

[@lysapala2812]

But how do I know, how many layers and how many neurons I need? Is it just by testing and watching, if the machine is doing its job well, or is there a trick how to figure it out?

[@laurencemoroney655]

Usually by trial and error, a neural architecture search, or just a good guess :)

[@alaaeddineboutout9543]

why u choose 128 functions ?

[@kinglaw1688]

Im currently learning python do I need to be good at maths to learn what you are teaching here?

[@laurencemoroney655]

I don't think so. I'm not particularly good at Maths.. :P

[@adammcallister8195]

It's great to always use the same Datasets for learning, but I think I can learn quicker If I was shown how to create my own datasets and analyze them. Datasets should be called "Trainers"

[@laurencemoroney655]

For images, you can just create subdirectories of images, and use these as your dataset. See the next video in this series for more details.

[@TorIvanBoine]

Any hints on how to install tensorflow without any errors?

[@dorg99]

if we have relu and softmax in each layer- where are the model parameters/weights that will be adjusted by the optimizer ?

[@laurencemoroney655]

The filter values in the convolutional layers, and the weights/biases in the 'Dense' ones

[@d3nt391]

Can someone explain to me why in the example code we are using this fashion dataset but it keeps referring to the "handwritten digits" we're trying to classify? Is this a mistake?

[@PritishMishra]

BEST TUTORIAL EVER....!!!!!!!!

[@erkutates151]

I got a question. Why any library is imported as their initials? is this a rule in programming or ease of use? import tensorflow as tf? import numpy as np? why is that?

[@laurencemoroney655]

I think it's just convenience, short and easy to remember. You could call it anything you like (import tensorflow as xy)

[@saraths9044]

Sir I understood the working of the function relu on the second layer, but why is it used there?

[@aliabed9394]

I think that not always a computer vision system is a machine learned system, right? Thanks

[@dragon_warrior_]

dayum these videos are cool and the codelabs too

[@dhapolapankaj]

Does the Algorithm decides which number to assign to Ankle Boot? Or How we can assign a number to specific object? Although we know the number of outputs, I'm little bit confused on assigning numeric output value!

[@laurencemoroney655]

It doesn't. The person that created the dataset labelled each piece of data, so instead of labelling something 'ankle boot', they labelled it '6'. Then, when training, the NN is told, 'when you see these pixels, they're a 6', 'when you see these pixels, they're a 9', and it tries to figure out the rules that determine those mappings.

[@Multimassar]

I did not understand the 128 part, why picking 128?

[@Usle1230editz]

Amazing expert & tutor, thanks..Awesome

[@laurencemoroney655]

Welcome, and thank you! :)

[@cygmoid]

Does increasing the number of functions in the keras.layer.Dense make the neural network accurate?

[@laurencemoroney655]

It *can*, or it might be a waste of resources. That's something to experiment with.

[@tariqshabirbhatti4793]

following this current series of ML...!

[@LaurenceMoroney]

Thanks!

[@iangonzalez4309]

After running test_loss, test_acc = model.evaluate(test_images, test_labels), I got this error: TypeError: cannot unpack non-iterable numpy.float64 object Does anyone know why?

[@donatassederevicius6313]

You need to add an accuracy metric: model.compile(optimizer = tf.keras.optimizers.Adam(), loss = 'sparse_categorical_crossentropy', metrics=['accuracy'])

[@rohanmanchanda5250]

1:07 - Ashuwashoo? What's that sir??

[@laurencemoroney655]

'What makes a shoe a shoe' - I didn't sneeze :)

[@azmatsiddique3564]

Hello Sir, Is it compulsory to write keras.layers.Flatten(input_shape=(28,28)) ??????? this code also work for me model = tf.keras.models.Sequential([tf.keras.layers.Flatten(),

[@William_Clinton_Muguai]

I love it! AI is super-amazing!

[@learnwithajwa4689]

It's really helpful me in understanding the the concept

[@Sagar_Tachtode_777]

great teaching style, Thank you... to run this code which tool you are using?? R or Python ??

[@fredmartins5722]

python

[@TejasPhase]

Thanks for this Video. Now waiting for the next one.

[@LaurenceMoroney]

Me too! :)

[@javiersuarez8415]

Thank you for sharing this videos with us. I have a question Laurence, if a had a reduced set, let us say 50 samples an 2 categories, it is worth it to increase the quality of the image or the deepness of the network to improve the accuracy score? Im my case the label comes from an expensive analysis and we are tryin to find a good aproximation using a CNN.

[@LaurenceMoroney]

It would very much depend on the diversity of your samples. One technique to avoid overfitting, particularly with a small set is to look at Image Augmentation in Keras.

[@rajansaharaju1427]

Outstanding series

[@laurencemoroney655]

Thanks, Rajan!

[@amankumarchourasiya2279]

Is my_images expected to be a numpy array or the array formed by reading an image using cv2 library of python? Please reply.

[@laurencemoroney655]

Generally it should be structured the same as the training dataset -- so explore the format of that, and you'll have your answer. It differs based on how you train the model.

[@Robert-ht5kd]

You didn"t say what are those f0 - f127 functions.

[@the_techelite_6097]

So how does all this code look like when compiled

[@luisaguiar4415]

Very clear. Great video

[@saisagole2143]

Why did you specifically chose 128 functions

[@bilaldmx]

Same question

[@yumquickcook]

Is there a more basic ml learning videos? These r good ,but m cmpltly new with these

[@LaurenceMoroney]

These are as basic as I could do! :) Try the first 1-2 chapters of "Deep Learning in Python" by Francois Chollet for a more fundamental description

[@luis96xd]

Amazing video, it was well explained

[@ManojAP]

Thanks sir, it helps lot

[@hal_from_all_nations]

Im another one who don't catch why 128 neurons in the middle layer. Great Video, thanks.

[@michzouthins1657]

Cool! Very informative! If it was also about working with tensors on Google Cloud with your own pictures! I would really appreciate it!

[@LaurenceMoroney]

Later I will show working with images that are downloaded as a zip file. It should be easy to adapt that.

[@RandomGuy-hi2jm]

can we do the same with voice data???

[@jarosawmaruszewski1678]

Why not. Just series of numbers with label assigned. NN is agnostic to input nature.

[@powerhour4602]

Are we no longer acknowledging the difference between ML and DL? Is DL now nestled within ML?

[@LaurenceMoroney]

Not at all. I'm just trying to keep this as simple as possible by reducing the concept count. At the moment, we're at a very abstract high level where there's little difference between the two, and it would take a lot more detail before we'd need to get into the distinctiveness between them. Let's focus on teaching the concepts first so that we can understand the more advanced stuff as it appears.

[@hadimasri420]

hello Laurence pls how can i know which optimizer i have to choose and which loss? im so confused pls help me

[@laurencemoroney655]

The answer there is 'it depends'. My recommendation, before you understand them all, is to look at similar solutions that people have open sourced and start with the function choices they made. To learn more about different function types, and how they work, I'd recommend deeplearning.ai's specialization on Coursera taught by Andrew Ng. It was one of the primary ways I learned. :)

[@davidgodri3982]

Great video! I noticed some typos in the exercises code - such as in the last exercise the callback's name doesn't match callback created (i.e. [callbacks] should be [myCallback()]). I hope that helps! Please keep the videos and exercises coming! :)

[@laurencemoroney655]

Thanks! Sometimes moving from code to slides stuff creeps in. Hopefully it's ok in the links.

[@hamedk7228]

Moroney is a hero!

[@laurencemoroney655]

I'm trying... :)

[@smhmkkh]

How do people find all these photos on e.g shoes. He used 70 thousand images of them of course its not possible to collect them 1 by 1 right?

[@manfyegoh]

cant wait for the next video!

[@laurencemoroney655]

Coming soon!

[@arifindobson]

TensorFlow rocks!

[@laurencemoroney655]

It does, doesn't it? :)

[@revietech5052]

Why do we have 128 functions? Why 128?

[@laurencemoroney655]

Purely arbritrary. Test different values to get the best results.

[@keithprossickartist]

Again, thank you.

[@slkslkful]

thanks for this great series

[@laurencemoroney655]

Welcome!

[@subrahmanyamvemuri5881]

This is wonderful.

[@KirillBezzubkine]

Waiting for the next vid. Thx

[@laurencemoroney655]

On its way...

[@sagar73594]

Nicely done.

[@laurencemoroney655]

Thanks! :)

[@kalyanalladi]

Crisp and clear

[@laurencemoroney655]

Thank you!