Transfer Learning | Deep Learning Tutorial 27 (Tensorflow, Keras & Python)

📺 Transfer learning is a very important concept in the field of computer vision and natural language processing. Using transfer learning you can use pre trained model and customize it for your needs. This saves computation time and money. It has been a revolutionary break through in the field of deep learning and nowadays you see it being used widely in the industry. In this video we will go over some theory behind transfer learning and then use google's mobile net v2 pre trained model to train our flowers dataset
#transferlearning #transferlearningdeeplearning #transferlearningkeras #transferlearningtensorflow #transferlearningmodels #deeplearningtutorial #transferlearningexample
Code: github.com/cod...
Do you want to learn technology from me? Check codebasics.io/... for my affordable video courses.
Deep learning playlist: • Deep Learning With Ten...
Machine learning playlist : www.youtube.co...
🌎 My Website For Video Courses: codebasics.io/...
Need help building software or data analytics and AI solutions? My company www.atliq.com/ can help. Click on the Contact button on that website.
#️⃣ Social Medias #️⃣
🔗 Discord: / discord
📸 Dhaval's Personal Instagram: / dhavalsays
📸 Instagram: / codebasicshub
🌎 Website: codebasics.io/
🔊 Facebook: / codebasicshub
📱 Twitter: / codebasicshub
📝 Linkedin: / codebasics
❗❗ DISCLAIMER: All opinions expressed in this video are of my own and not that of my employers'.

[@codebasics]

Folks, here's a link to our bootcamp for learning AI and Data Science in the most practical way: tinyurl.com/395u4mnm

[@sherifbadawy8188]

Man your courses taught me to lose my ego, and to live out for the people. Thank you so much for this. This has to be a blessed deed that you did this.

[@mhdkfl]

By watching your deep learning whole series i have cleared my bunch of doubts . Your way of putting any topic so simple is really amazing. Hatts off to your teaching methodology. A heartiest request to you to Please upload NLP series (including LSTM and Encoders/Decoders) with a good project. I am eagrely waiting.

[@codebasics]

Yes nlp series is in my plans

[@zkhan2023]

@@codebasics sir, when will you starting that series?

[@bagheerathan8975]

here how can we test the model after train the model plz tell me

[@bagheerathan8975]

@@codebasics here how can we test the model after train the model plz tell me

[@GautamKumarBEE]

A very humble request, please add atleast 5-6 more videos in this series.

[@sandiproy330]

With a clear example you explained transfer learning so beautifully. LOved to see your tutorial. Thank you so much sir.

[@AlonAvramson]

Your way of explaining complex issues in such an easy and simple way is truly amazing. Thank you!

[@anoshpa-6531]

I don`t have words to thank you for this deep learning series, you have explained every single topic in simple language. Thanks a ton :) :) Keep Uploading such series :)

[@codebasics]

👍☺️

[@bagheerathan8975]

here how can we test the model after train the model plz tell me

[@prajjowldahal8959]

@@codebasics sir in github code are not there it shows error it is moved from github????

[@yaswanthyalamuri8799]

Wow, such a great techique to train models. Thank you sir for making it easy for us

[@mums2109]

Even though this of two years old it is still very well taught. Thank you!

[@zaidalmahmoud4272]

Wow! What a simple and clear illustration of Transfer Learning. Thank you!

[@mangaldasgaonkar568]

import tf_keras IMAGE_SHAPE = (224, 224) classifier = tf_keras.Sequential([ hub.KerasLayer(model_link, input_shape=IMAGE_SHAPE+(3,)) ]) First install tf_keras by pip install tf_keras then, import it by import tf_keras And use it classifier = tf_keras.Sequential([...]) For me it is working Replace tf.keras to tf_keras everywhere

[@johndaniellet.castor7189]

Woahh!! Thank you very much for this!!

[@muskanagrawal9428]

thanks!! it worked

[@KishorSadavarte-z1i]

Thanks a lot dost.

[@shreyasb.s3819]

Omg..u have cleared my lot of doubts here...superbbb explained...thank you much sir. Please contribute more towards RNN also like this.

[@codebasics]

Sure I will

[@bhaskargg6018]

no words to praise, the session is superb , thanks a lot for sharing your knowledge

[@homeOfTrivia]

Excellent course. This is my "Go To" resource for Machine Learning and Deep Learning. Please think of creating a series of projects that can make one grow their skills. Keep the price affordable.

[@izharkhankhattak]

Really great lecture. Keep helping the people like that. Thank you so much.

[@codebasics]

My pleasure

[@bagheerathan8975]

@@codebasics here how can we test the model after train the model plz tell me

[@sumit121285]

really helpful....you are the best teacher for deep learning....also for machine learning.....thankyou so much...... i m a big fan of yours.....

[@codebasics]

😊🙏

[@aliksmshaik-x8t]

Amazing explanation, very easy to understand

[@work-dw2hl]

Your teaching style is outstanding

[@PriyankaDarshanam]

For those who are getting this error Only instances of keras.Layer can be added to a Sequential model. Received: (of type ) try this, import tf_keras and replace every 'tf.keras' with 'tf_keras'

[@autistikosmalakas]

I. LOVE. YOU

[@inhibited44]

That example with the flower identified as an umbrella got me thinking. I applied your model to my data. I have pictures of an object with rust and blemishes on them. The model identified a few pictures as a snake of some sort or a hyena. If I do a case study of a bunch of pictures in my data and feed them to the model, I should be able to program into it the actual appropriate identity once the model has ascertained it's a snake, hyena or whatever.

[@nineteen5899]

Thanks mate... it helped.. Love from London..

[@codebasics]

Glad it helped

[@harshalbhoir8986]

This is something new I learned!!!

[@pvtgcn8752]

Very Lucid Explanation

[@Vicky-x1n]

Hello @codebasics, thanks again for a very well presented topic. This helps a lot. I had few queries after seeing this video, so looking for some guidance. First: The final trained model has 5 flower classes only as output. Does this mean we loose original data set classes of 1000? or can we retain the original classes of 1000 objects and add these 5 new flower classes? Second: when we downloaded the pre-loaded model, we used trainable=False, what is the significance of this parameter? Third: if we have a model saved locally? can we use a similar way to load and train the model or it will need to be done differently? Thanks again!

[@tomdapchai]

thanks, very easy to follow

[@kunalll24]

Having error while using the pretrained model, error : ValueError: Only instances of `keras.Layer` can be added to a Sequential model. Received: (of type ) please help.

[@CertifiedAuthur]

Have you been able to solve this error?

[@TaranehGanjizadeh]

same i need some help

[@TarSusiFY]

Install tf_keras compatible to tensorflow version (e,g, I use tensorflow 2.16, so pip install tf_keras==2.16.0) then 'import tf_keras', then change tf.keras.Sequential to tf_keras.Sequential. This is probably due to version incompatiblility.

[@zzzmd11]

Hi Thanks for the great explanation as always. Just wanted to know about model ensembling or stacking across different datasets. As in developing a one single model which is trained from 2 separate datasets which have their own separate set of features (which are not overlapping with each other). Is it possible and are there any examples which are already done? Can you please shed a light on this..Thank you so much in advance...

[@nguyennhi8524]

Thank you so much!!! 👏

[@kollurisharada5102]

VERY GOOD EXPLANATION

[@codebasics]

Thanks for liking

[@pratyushsinha5201]

Thank you so much sir. This was extremely helpful!

[@codebasics]

Glad it helped!

[@dilipkumar2k6]

You need a standing ovation :-)

[@akshayvasav2497]

@codebasics this is greatest video of transfer learning i have ever seen, usually people load dataset from tensorflow directly instead of local disk. You load it from local disk which is great thing. I just have one question what you appended in "y" , class name or class Id ?

[@HotshotArafath]

Sir can we use this method for the leaf disease project also as a extension?

[@srishtikumari6664]

Wonderful explanation!!

[@advertisemedia1509]

can you show how prediction is done after transfer learning is done .... i mean after retraining the model with flower images plz show how to check results... thanks a lot... i tried but couldn't do ....thanks a lot

[@reinishasarojini6908]

I need more videos on transfer learning sir

[@tewodrosgebre204]

Thank you. Helpful.

[@ucm269]

In the last layer of the trained model, though softmax layer is being used , how we are getting some of our prediction values to be greater than 1??

[@siddharthkshirsagar2545]

amazing🙃

[@saltanatkhalyk3397]

Thank you very much.

[@codebasics]

Glad it was helpful!

[@lalitsingh5150]

Thank you sir

[@codebasics]

Welcome

[@juangutierrez3309]

YOU ARE A LEGEND! Thanks for helping me understand how transfer learning worksQ Just had one question... I understood everything but this piece of code: model.compile( optimizer="adam", loss=tf.keras.losses.SparseCategoricalCrossentropy(from_logits=True), metrics=['acc']) Where did you get this? Do I use this with any model I use for transfer learning?

[@codebasics]

This has nothing to do with transfer learning. Whenever you train a model in deep learning you need to use this line

[@bagheerathan8975]

here how can we test the model after train the model plz tell me

[@bagheerathan8975]

@@codebasics here how can we test the model after train the model plz tell me

[@PavanKumar-rp2xz]

​@@bagheerathan8975 Model.evaluate(X_test,y_test)

[@AniketChakraborty-q2d]

While loading the classifier model (MobileNet_V2) inside tf.keras.Sequential([]), it gives error saying keras.Sequential([]) needs keras.layers instances, not hub.KerasLayers instances. I check the documentation, the same code is given there also. I am doing it in jupyter notebook. I checked my tf and hub installations are perfect. What is the problem?

[@studentmitra5372]

Can you please analyse HAM10000 dataset. Because this dataset is highly imbalanced and it also contain meta data in csv file. So I am bit confused.

[@studentmitra5372]

it's humble request

[@sagarmahobia5159]

Wouldn't it affect the ability to recognize images other than these flowers because now the last layer has been trained with a smaller dataset? Like recognizing a chair or. bike

[@ansariarbaz3374]

nice video sir just wanna add u must use softmax activation function in last layer directly.... please

[@sabarimahesh]

Is it possible to do transfer learning for ANN ? Any reference available ? I could see more examples for CNN. Is there any reason behind.

[@RanjitSingh-rq1qx]

Sir please make more videos on transferring learning.i think this is not sufficient to use transferring learning in more easy way 🙏

[@naa12333]

thank you sir for the wonderful tutorials... I am following all the steps in this video as well in previous episode (26), I get an error when I train the model, since I am new I could not figure out how to fix this error. error: ValueError: Data cardinality is ambiguous: x sizes: 2752 y sizes: 918 Make sure all arrays contain the same number of samples.

[@navneetkumar5517]

thank you so much bhaiya

[@CertifiedAuthur]

I'm having a value error when trying to wrap the hub and keras.layer, how were you able to get past there?

[@HIMANSHU-lm5tg]

sir, u have taught so much of free that i have not learnt in any of the paid courses. i am trying to use ML and AI in financial instruments for trading and investing. but due to non familiarity with ML and AI world I m not able to figure out from where to start and what is relevant for me. plz guide me.

[@Raj-sz9pg]

from where did you downloaded those classes list ?

[@Frostbyte-Game-Studio]

holy fuck that might save me a lot of fucking trouble thank you so much for this video and for this code

[@dileeppanigrahi4453]

Hi sir, How can i remove the last layer , without using feature_vector model. what i mean is how to remove the last layer from the classification model(mobilenet_v2) and freeze the trained layers .

[@UsmanKhan-hu8hw]

can we apply the same way for transforming of text sentiment model?

[@balajim2107]

It shows flowers as umbrella and so on..Then using mobilenet is good?or bad?

[@karatugba]

What if I want to classify 1005 classes with freezing, what do I need to do?

[@suleyman.p]

why we didn't use an activation function in last dense layer ?

[@bensalah90]

nice video keep going ;so what would you suggest as model from TL HUB to train signal or spectogram

[@321-youvrajsinghgaur3]

Please Tell How can we save this model after transfer learning !

[@zaindurani8168]

Thanks a lot sir

[@codebasics]

👍😊

[@andrewzolensky9807]

Hi, great tutorial! Quick question, when training the single dense layer around minute 24:00, why is there no activation function (e.g. softmax) applied to the final, trainable dense layer?

[@andrewzolensky9807]

Edit: minute 23:30

[@gauravtripathi562]

It's taking by default value for that and its relu i think or you can check....but keeping it empty means it's taking default value for that

[@nastaran1010]

the model perfomance with useing 'feature vector' is increased. but when i tried to predict ([X[0],X[1], X[2]]), it perfomes so bad. why?

[@arcanepersona1676]

Thanks a lot , I appreciate your way of explaining deep learning 😊 I would like to ask about image classification using transfer learning .. if I have a dataset of images with the size 100x100 .. and the image size in the pre trained model is 300x300 .. a bigger size .. how do I make my smaller sized original images fit in that pre trained model ?

[@TarSusiFY]

"ValueError: Only instances of `keras.Layer` can be added to a Sequential model. Received:

[@chealsytchasso3871]

HI is it possible tu convert an image of 3D dimensions in to an image of 4D dimensions?

[@wcottee]

So let me see if I understand...we froze all the weights/biases/filters for all the layers except the final one. So when we say we are "training" the model with our flower data set, we are only optimizing the weights and biases of the final layer (i.e. the input to the softmax function)?????

[@CertifiedAuthur]

How do you get past the hub and keras.layer zone. I have been getting value error

[@Suriyabegum22PHD053]

sir, how to search TensorFlow hub training models give me the same as you have used.

[@rasanjalirathnayake8873]

when we use pupil detection, i mean wha t I need is to localize the pupil center, are we using classification? just like left eye and right eye ? or something else? please reply.

[@codebasics]

Are you doing object detection? Have you tried yolo etc?

[@rahulrangu6506]

hi sir can we get the ppt also in deep learning tutorials and Machine Learning tutorials that you have used to explain the concepts

[@suhaalam2127]

Do you have any tutorial where u have shown any regression problem solving using deep learning?

[@adityahpatel]

Hello, why are there so many MobileNet model variants on Tensorflow hub? Like mobilenet_v2_50_192, mobilenetv2_035_96, mobilenetv3_large_100_224 and so many other variants? What is the different between these?

[@yassmingourya9975]

Hey, I really liked your videos you are explaining everything in a quiet simple way, but can we use transfer learning on non_image data set? , like I have a dataset composed of srtings I transformed it to arrays and I want to make predictions using arrays, does transfer learning help in this case? Thanks a lot

[@codebasics]

yes transfer learning is not restricted to only images. you can use it for other problems too

[@yassmingourya9975]

@@codebasics ah great, thanks for your reply. please can you help with some documentations or instructions on how to do i'll be so grateful

[@sanarabhi4906]

@@yassmingourya9975 please did you found documentations for using transfer learning on non_image data set , i need to do it but can't find anything useful. thank you

[@quattrandang4312]

Hello guy ! I need help . Specifically, I followed your code but when I bring that model to deploy in my project, using load_model does not work. Ok i understand it doesn't save the complete model but i want it to save only the part i changed (output layer) so when i use it i need to have it (custom_objects={'KerasLayer':hub.KerasLayer }) . But the problem here is that when I use the above command, my model will not work after a period of time (according to my understanding, when I load the model in the above way, it will download a temporary folder containing the information. the model number and structure ( which contains some .pb and pbtxt files ) - this folder will be partially deleted by something after about a week , so it causes an unusable error , If you want to use it again, you need to delete the folder and let it download the new one). I don't want my program to crash every once in a while. Do you have any way ? In addition, I have found a way to fix it, but it is not a good way. I use :" from tensorflow.keras.applications import " to load sample models and add classes directly to this model. It works like a self-built model so you don't have to reload the keras layer every time you use it (which caused my error). However, this way it is quite resource-intensive. Do you have a better alternative? Thanks for reading . Looking forward to hearing from you soon.

[@Raj-sz9pg]

how to know if its working? in the end after we run 5 epoch

[@saltanatkhalyk3397]

your code works ^_^

[@SachinGupta-dn7wt]

You predicted using a classifier that was pre-trained(in which you got inaccurate results), but I wanted to see how we can give one input image and check the output by using the new classifier.

[@baburamchaudhary159]

since, we have 1000 classes, why do we get (1, 1001), when executing result.shape

[@Maryashahere]

Sir how can we apply transfer learning for numerical data?

[@Seene_me_cinema]

Sir... Can you please show CNN in UCIHAR dataset... Will be really helpful

[@dr.md.atiqurrahman2748]

Wow!!!!!!! If I had an option, I would subscribed (1000000000000000000000000000....................I don't know how many zeros I would add) times.

[@codebasics]

Thanks for your kind words of appreciation Atiqur.

[@Janamejaya.Channegowda]

Thank you, can transfer learning be done for time series data?.

[@chymoney1]

Yes, but I’d imagine it does not have advantages over LSTM or transformer

[@rahaf1418128]

is this could consider as convolutional neural network?

[@tirthadatta7368]

Sir, the tutorial is well made. But can u please tell us how to add batch size and other preprocessing steps in this code??

[@jrajpal5]

Hi sir, i watch your videos every day But with the same dataset, i am getting losses of 1.6 and accuracy close to 0.21 with transfer learning as well as with cnn So please tell how can i improve them

[@krutikagouda2696]

Can you please suggest trained model for ai based picture translation project

[@abduladhilpk8223]

why yolo algorithm takes hours to train to perform object detection using transfer learning

[@yashu1089]

which classifier are you using

[@riadelectro1]

Please teacher; could you give me a master topic proposal about clustering images?

[@fvviz409]

Hey can you teach us how to do real time neural network prediction using open-cv? It is very useful in computer vision

[@saarakauser7008]

very informative sir. can you explain how to combine 2 or more pretrained models..

[@aintthatharsh]

How and why would someone do that?

[@nastaran1010]

what is the version od tensorflow, hub?

[@Makingrobloxvids]

hello how can I use Transfer learning on 1 dimension data

[@MJEEVA-r5f]

how to increase running speed of epoch in jupyter notebook for flower dataset classification

[@hafizhtrinelzy145]

buy gpu instead

[@amudalagopikrishna5745]

what is that third value in the input shape

[@huskymotivations]

it mean the images are color images, like (RGB), and if we have black and white images we use 1 instead of 3. I'm also a beginner but i guess most probably that's the reason

[@snehashrivastav5544]

Can you please add the fish dataset link

[@harshitrathi3077]

sir is the python project of Grocery Application Completed ?

[@adityapatil6723]

how can i find the 1000 classes txt file

[@charantejchetty149]

Hey , how can I download Mobile net V2 dataset?

[@Abhishek-jd9qk]

What was the need of adding 1 and 3 to the dimensions ?

[@lakshsinghania]

same doubt, maybe the index/number