Transfer Learning | Deep Learning Tutorial 27 (Tensorflow, Keras & Python)

[@codebasics]

Check our Deep Learning Course (in PyTorch) with Latest, Industry Relevant Content: tinyurl.com/4p9vmmds Check out our premium machine learning course with 2 Industry projects: codebasics.io/courses/machine-learning-for-data-science-beginners-to-advanced

[@sherifbadawy8188]

Man your courses taught me to lose my ego, and to live out for the people. Thank you so much for this. This has to be a blessed deed that you did this.

[@mhdkfl]

By watching your deep learning whole series i have cleared my bunch of doubts . Your way of putting any topic so simple is really amazing. Hatts off to your teaching methodology. A heartiest request to you to Please upload NLP series (including LSTM and Encoders/Decoders) with a good project. I am eagrely waiting.

[@codebasics]

Yes nlp series is in my plans

[@zkhan2023]

@@codebasics sir, when will you starting that series?

[@bagheerathan8975]

here how can we test the model after train the model plz tell me

[@bagheerathan8975]

@@codebasics here how can we test the model after train the model plz tell me

[@GautamKumarBEE]

A very humble request, please add atleast 5-6 more videos in this series.

[@mangaldasgaonkar568]

import tf_keras IMAGE_SHAPE = (224, 224) classifier = tf_keras.Sequential([ hub.KerasLayer(model_link, input_shape=IMAGE_SHAPE+(3,)) ]) First install tf_keras by pip install tf_keras then, import it by import tf_keras And use it classifier = tf_keras.Sequential([...]) For me it is working Replace tf.keras to tf_keras everywhere

[@johndaniellet.castor7189]

Woahh!! Thank you very much for this!!

[@muskanagrawal9428]

thanks!! it worked

[@KishorSadavarte-z1i]

Thanks a lot dost.

[@sandiproy330]

With a clear example you explained transfer learning so beautifully. LOved to see your tutorial. Thank you so much sir.

[@AlonAvramson]

Your way of explaining complex issues in such an easy and simple way is truly amazing. Thank you!

[@yaswanthyalamuri8799]

Wow, such a great techique to train models. Thank you sir for making it easy for us

[@anoshpa-6531]

I don`t have words to thank you for this deep learning series, you have explained every single topic in simple language. Thanks a ton :) :) Keep Uploading such series :)

[@codebasics]

👍☺️

[@bagheerathan8975]

here how can we test the model after train the model plz tell me

[@prajjowldahal8959]

@@codebasics sir in github code are not there it shows error it is moved from github????

[@mums2109]

Even though this of two years old it is still very well taught. Thank you!

[@shreyasb.s3819]

Omg..u have cleared my lot of doubts here...superbbb explained...thank you much sir. Please contribute more towards RNN also like this.

[@codebasics]

Sure I will

[@zaidalmahmoud4272]

Wow! What a simple and clear illustration of Transfer Learning. Thank you!

[@bhaskargg6018]

no words to praise, the session is superb , thanks a lot for sharing your knowledge

[@izharkhankhattak]

Really great lecture. Keep helping the people like that. Thank you so much.

[@codebasics]

My pleasure

[@bagheerathan8975]

@@codebasics here how can we test the model after train the model plz tell me

[@work-dw2hl]

Your teaching style is outstanding

[@homeOfTrivia]

Excellent course. This is my "Go To" resource for Machine Learning and Deep Learning. Please think of creating a series of projects that can make one grow their skills. Keep the price affordable.

[@sumit121285]

really helpful....you are the best teacher for deep learning....also for machine learning.....thankyou so much...... i m a big fan of yours.....

[@codebasics]

😊🙏

[@aliksmshaik-x8t]

Amazing explanation, very easy to understand

[@PriyankaDarshanam]

For those who are getting this error Only instances of keras.Layer can be added to a Sequential model. Received: (of type ) try this, import tf_keras and replace every 'tf.keras' with 'tf_keras'

[@autistikosmalakas]

I. LOVE. YOU

[@nineteen5899]

Thanks mate... it helped.. Love from London..

[@codebasics]

Glad it helped

[@kunalll24]

Having error while using the pretrained model, error : ValueError: Only instances of `keras.Layer` can be added to a Sequential model. Received: (of type ) please help.

[@CertifiedAuthur]

Have you been able to solve this error?

[@TaranehGanjizadeh]

same i need some help

[@TarSusiFY]

Install tf_keras compatible to tensorflow version (e,g, I use tensorflow 2.16, so pip install tf_keras==2.16.0) then 'import tf_keras', then change tf.keras.Sequential to tf_keras.Sequential. This is probably due to version incompatiblility.

[@inhibited44]

That example with the flower identified as an umbrella got me thinking. I applied your model to my data. I have pictures of an object with rust and blemishes on them. The model identified a few pictures as a snake of some sort or a hyena. If I do a case study of a bunch of pictures in my data and feed them to the model, I should be able to program into it the actual appropriate identity once the model has ascertained it's a snake, hyena or whatever.

[@harshalbhoir8986]

This is something new I learned!!!

[@pratyushsinha5201]

Thank you so much sir. This was extremely helpful!

[@codebasics]

Glad it helped!

[@pvtgcn8752]

Very Lucid Explanation

[@tomdapchai]

thanks, very easy to follow

[@kollurisharada5102]

VERY GOOD EXPLANATION

[@codebasics]

Thanks for liking

[@HotshotArafath]

Sir can we use this method for the leaf disease project also as a extension?

[@nguyennhi8524]

Thank you so much!!! 👏

[@srishtikumari6664]

Wonderful explanation!!

[@ucm269]

In the last layer of the trained model, though softmax layer is being used , how we are getting some of our prediction values to be greater than 1??

[@tewodrosgebre204]

Thank you. Helpful.

[@sagarmahobia5159]

Wouldn't it affect the ability to recognize images other than these flowers because now the last layer has been trained with a smaller dataset? Like recognizing a chair or. bike

[@saltanatkhalyk3397]

Thank you very much.

[@codebasics]

Glad it was helpful!

[@SachinGupta-dn7wt]

You predicted using a classifier that was pre-trained(in which you got inaccurate results), but I wanted to see how we can give one input image and check the output by using the new classifier.

[@Vicky-x1n]

Hello @codebasics, thanks again for a very well presented topic. This helps a lot. I had few queries after seeing this video, so looking for some guidance. First: The final trained model has 5 flower classes only as output. Does this mean we loose original data set classes of 1000? or can we retain the original classes of 1000 objects and add these 5 new flower classes? Second: when we downloaded the pre-loaded model, we used trainable=False, what is the significance of this parameter? Third: if we have a model saved locally? can we use a similar way to load and train the model or it will need to be done differently? Thanks again!

[@lalitsingh5150]

Thank you sir

[@codebasics]

Welcome

[@dileeppanigrahi4453]

Hi sir, How can i remove the last layer , without using feature_vector model. what i mean is how to remove the last layer from the classification model(mobilenet_v2) and freeze the trained layers .

[@akshayvasav2497]

@codebasics this is greatest video of transfer learning i have ever seen, usually people load dataset from tensorflow directly instead of local disk. You load it from local disk which is great thing. I just have one question what you appended in "y" , class name or class Id ?

[@dilipkumar2k6]

You need a standing ovation :-)

[@reinishasarojini6908]

I need more videos on transfer learning sir

[@juangutierrez3309]

YOU ARE A LEGEND! Thanks for helping me understand how transfer learning worksQ Just had one question... I understood everything but this piece of code: model.compile( optimizer="adam", loss=tf.keras.losses.SparseCategoricalCrossentropy(from_logits=True), metrics=['acc']) Where did you get this? Do I use this with any model I use for transfer learning?

[@codebasics]

This has nothing to do with transfer learning. Whenever you train a model in deep learning you need to use this line

[@bagheerathan8975]

here how can we test the model after train the model plz tell me

[@bagheerathan8975]

@@codebasics here how can we test the model after train the model plz tell me

[@PavanKumar-rp2xz]

​@@bagheerathan8975 Model.evaluate(X_test,y_test)

[@andrewzolensky9807]

Hi, great tutorial! Quick question, when training the single dense layer around minute 24:00, why is there no activation function (e.g. softmax) applied to the final, trainable dense layer?

[@andrewzolensky9807]

Edit: minute 23:30

[@gauravtripathi562]

It's taking by default value for that and its relu i think or you can check....but keeping it empty means it's taking default value for that

[@ansariarbaz3374]

nice video sir just wanna add u must use softmax activation function in last layer directly.... please

[@zzzmd11]

Hi Thanks for the great explanation as always. Just wanted to know about model ensembling or stacking across different datasets. As in developing a one single model which is trained from 2 separate datasets which have their own separate set of features (which are not overlapping with each other). Is it possible and are there any examples which are already done? Can you please shed a light on this..Thank you so much in advance...

[@Raj-sz9pg]

from where did you downloaded those classes list ?

[@nastaran1010]

the model perfomance with useing 'feature vector' is increased. but when i tried to predict ([X[0],X[1], X[2]]), it perfomes so bad. why?

[@navneetkumar5517]

thank you so much bhaiya

[@CertifiedAuthur]

I'm having a value error when trying to wrap the hub and keras.layer, how were you able to get past there?

[@Janamejaya.Channegowda]

Thank you, can transfer learning be done for time series data?.

[@chymoney1]

Yes, but I’d imagine it does not have advantages over LSTM or transformer

[@siddharthkshirsagar2545]

amazing🙃

[@RanjitSingh-rq1qx]

Sir please make more videos on transferring learning.i think this is not sufficient to use transferring learning in more easy way 🙏

[@advertisemedia1509]

can you show how prediction is done after transfer learning is done .... i mean after retraining the model with flower images plz show how to check results... thanks a lot... i tried but couldn't do ....thanks a lot

[@TarSusiFY]

"ValueError: Only instances of `keras.Layer` can be added to a Sequential model. Received:

[@zaindurani8168]

Thanks a lot sir

[@codebasics]

👍😊

[@adityahpatel]

Hello, why are there so many MobileNet model variants on Tensorflow hub? Like mobilenet_v2_50_192, mobilenetv2_035_96, mobilenetv3_large_100_224 and so many other variants? What is the different between these?

[@yassmingourya9975]

Hey, I really liked your videos you are explaining everything in a quiet simple way, but can we use transfer learning on non_image data set? , like I have a dataset composed of srtings I transformed it to arrays and I want to make predictions using arrays, does transfer learning help in this case? Thanks a lot

[@codebasics]

yes transfer learning is not restricted to only images. you can use it for other problems too

[@yassmingourya9975]

@@codebasics ah great, thanks for your reply. please can you help with some documentations or instructions on how to do i'll be so grateful

[@sanarabhi4906]

@@yassmingourya9975 please did you found documentations for using transfer learning on non_image data set , i need to do it but can't find anything useful. thank you

[@sabarimahesh]

Is it possible to do transfer learning for ANN ? Any reference available ? I could see more examples for CNN. Is there any reason behind.

[@UsmanKhan-hu8hw]

can we apply the same way for transforming of text sentiment model?

[@karatugba]

What if I want to classify 1005 classes with freezing, what do I need to do?

[@naa12333]

thank you sir for the wonderful tutorials... I am following all the steps in this video as well in previous episode (26), I get an error when I train the model, since I am new I could not figure out how to fix this error. error: ValueError: Data cardinality is ambiguous: x sizes: 2752 y sizes: 918 Make sure all arrays contain the same number of samples.

[@wcottee]

So let me see if I understand...we froze all the weights/biases/filters for all the layers except the final one. So when we say we are "training" the model with our flower data set, we are only optimizing the weights and biases of the final layer (i.e. the input to the softmax function)?????

[@CertifiedAuthur]

How do you get past the hub and keras.layer zone. I have been getting value error

[@balajim2107]

It shows flowers as umbrella and so on..Then using mobilenet is good?or bad?

[@suleyman.p]

why we didn't use an activation function in last dense layer ?

[@abduladhilpk8223]

why yolo algorithm takes hours to train to perform object detection using transfer learning

[@suhaalam2127]

Do you have any tutorial where u have shown any regression problem solving using deep learning?

[@arcanepersona1676]

Thanks a lot , I appreciate your way of explaining deep learning 😊 I would like to ask about image classification using transfer learning .. if I have a dataset of images with the size 100x100 .. and the image size in the pre trained model is 300x300 .. a bigger size .. how do I make my smaller sized original images fit in that pre trained model ?

[@nastaran1010]

what is the version od tensorflow, hub?

[@studentmitra5372]

Can you please analyse HAM10000 dataset. Because this dataset is highly imbalanced and it also contain meta data in csv file. So I am bit confused.

[@studentmitra5372]

it's humble request

[@Suriyabegum22PHD053]

sir, how to search TensorFlow hub training models give me the same as you have used.

[@rasanjalirathnayake8873]

when we use pupil detection, i mean wha t I need is to localize the pupil center, are we using classification? just like left eye and right eye ? or something else? please reply.

[@codebasics]

Are you doing object detection? Have you tried yolo etc?

[@rahulrangu6506]

hi sir can we get the ppt also in deep learning tutorials and Machine Learning tutorials that you have used to explain the concepts

[@chealsytchasso3871]

HI is it possible tu convert an image of 3D dimensions in to an image of 4D dimensions?

[@bensalah90]

nice video keep going ;so what would you suggest as model from TL HUB to train signal or spectogram

[@Frostbyte-Game-Studio]

holy fuck that might save me a lot of fucking trouble thank you so much for this video and for this code

[@321-youvrajsinghgaur3]

Please Tell How can we save this model after transfer learning !

[@HIMANSHU-lm5tg]

sir, u have taught so much of free that i have not learnt in any of the paid courses. i am trying to use ML and AI in financial instruments for trading and investing. but due to non familiarity with ML and AI world I m not able to figure out from where to start and what is relevant for me. plz guide me.

[@quattrandang4312]

Hello guy ! I need help . Specifically, I followed your code but when I bring that model to deploy in my project, using load_model does not work. Ok i understand it doesn't save the complete model but i want it to save only the part i changed (output layer) so when i use it i need to have it (custom_objects={'KerasLayer':hub.KerasLayer }) . But the problem here is that when I use the above command, my model will not work after a period of time (according to my understanding, when I load the model in the above way, it will download a temporary folder containing the information. the model number and structure ( which contains some .pb and pbtxt files ) - this folder will be partially deleted by something after about a week , so it causes an unusable error , If you want to use it again, you need to delete the folder and let it download the new one). I don't want my program to crash every once in a while. Do you have any way ? In addition, I have found a way to fix it, but it is not a good way. I use :" from tensorflow.keras.applications import " to load sample models and add classes directly to this model. It works like a self-built model so you don't have to reload the keras layer every time you use it (which caused my error). However, this way it is quite resource-intensive. Do you have a better alternative? Thanks for reading . Looking forward to hearing from you soon.

[@yashu1089]

which classifier are you using

[@Seene_me_cinema]

Sir... Can you please show CNN in UCIHAR dataset... Will be really helpful

[@praneedhaweerakoon8570]

What are the methods available to improve the accuracy of custom models??except trial and error.

[@zaindurani8168]

Keras tuner try it

[@dr.md.atiqurrahman2748]

Wow!!!!!!! If I had an option, I would subscribed (1000000000000000000000000000....................I don't know how many zeros I would add) times.

[@codebasics]

Thanks for your kind words of appreciation Atiqur.

[@fvviz409]

Hey can you teach us how to do real time neural network prediction using open-cv? It is very useful in computer vision

[@Raj-sz9pg]

how to know if its working? in the end after we run 5 epoch

[@Maryashahere]

Sir how can we apply transfer learning for numerical data?

[@rahaf1418128]

is this could consider as convolutional neural network?

[@Makingrobloxvids]

hello how can I use Transfer learning on 1 dimension data

[@saltanatkhalyk3397]

your code works ^_^

[@harshitrathi3077]

sir is the python project of Grocery Application Completed ?

[@uswakhan3050]

can anyone help me in resolving this error .... ValueError: Only instances of `keras.Layer` can be added to a Sequential model. Received: (of type )

[@parimalkothari7607]

Got the solution?

[@uswakhan3050]

@@parimalkothari7607 no did you get it??

[@mangaldasgaonkar568]

First install tf_keras Then import tf_keras And then replace tf.keras to tf_keras everywhere

[@saarakauser7008]

very informative sir. can you explain how to combine 2 or more pretrained models..

[@aintthatharsh]

How and why would someone do that?

[@tirthadatta7368]

Sir, the tutorial is well made. But can u please tell us how to add batch size and other preprocessing steps in this code??

[@charantejchetty149]

Hey , how can I download Mobile net V2 dataset?

[@krutikagouda2696]

Can you please suggest trained model for ai based picture translation project

[@arpitjain6451]

model.fit(X_train_scaled, y_train, epochs=5) ValueError: Failed to convert a NumPy array to a Tensor (Unsupported object type list). error occur at this line

[@anshXR]

model.fit only accept numpy arrays. So try running this :- X_train_scaled = np.array(X_train_scaled) y_train = np.array(y_train)

[@riadelectro1]

Please teacher; could you give me a master topic proposal about clustering images?

[@adityapatil6723]

how can i find the 1000 classes txt file

[@amudalagopikrishna5745]

what is that third value in the input shape

[@huskymotivations]

it mean the images are color images, like (RGB), and if we have black and white images we use 1 instead of 3. I'm also a beginner but i guess most probably that's the reason

[@baburamchaudhary159]

since, we have 1000 classes, why do we get (1, 1001), when executing result.shape

[@jrajpal5]

Hi sir, i watch your videos every day But with the same dataset, i am getting losses of 1.6 and accuracy close to 0.21 with transfer learning as well as with cnn So please tell how can i improve them

[@Abhishek-jd9qk]

What was the need of adding 1 and 3 to the dimensions ?

[@lakshsinghania]

same doubt, maybe the index/number