Activation Functions | Deep Learning Tutorial 8 (Tensorflow Tutorial, Keras & Python)

[@codebasics]

Check out our premium machine learning course with 2 Industry projects: codebasics.io/courses/machine-learning-for-data-science-beginners-to-advanced

[@arslanMCL]

Number of views is not doing justice to the quality of content that is created. Learning two weeks content in hardly 20 minutes. Thanks

[@codebasics]

I appreciate you leaving a comment of appreciation

[@abvijaykumar]

Very well articulated, I searched the whole web, nobody explained these concepts in such simple way, without any confusion!!! Thank you

[@JunaidInHenan]

Hats off, I am a PhD student, and I worked on NLP, ML and text analytics, in the last semester of my PhD I am turning to deep learning for my post doc research, and I needed background information on deep learning. Also in my last project somehow I managed to apply deep learning simple classifier, but that instinct to theoretically and technically understand background of deep learning was missing. I read articles, videos etc. a lot but man your videos on deep learning concept is really fulfilling my instinct up till now. Hats off to you Bro. Thank you for your vision of education and these helpful tutorials.

[@aditibhushan19]

May I please get your email ID

[@aadityaprashantwaghulade9666]

Sir do we need Deep Learning for NLP??? Please help me

[@daxalakdawala427]

​@@aadityaprashantwaghulade9666 YES

[@SonHoang-qi9xq]

​@@aadityaprashantwaghulade9666 If you ask that question then I don't really think you need it

[@ansumansatpathy3923]

Very structured and organic build up of concepts, not throwing a bunch in a short timeframe down your throat praying you gobble it up. I appreciate your hard work behind the animations too.Keep it up!

[@MrBasu-iq6md]

I do get valuable information from youtube now and then. However, I did not expect deep learning tutorials to be explained in such simplicity yet highly informative as well. Machine Learning and Deep Learning videos on this channel are highly recommended. Thank you for such contents.

[@karthikc8992]

sir what ah explanation , it seems so easy to learn deep learning,carry on your winning momentum , hope you become one of the great teachers in data science🔥🔥🔥🔥🔥🔥🔥🔥🔥

[@SKumar-Munna]

I am watching your video since beginning. All is amazing Sirji.

[@wishIKnewHowToLove]

The best KZbin teacher!

[@shreyakapadia3735]

I really loved the easy explanation given by your sir. I wish I'd found this series earlier, but will watch the series from now on. Thank you for your efforts.

[@codebasics]

All the best Shreya

[@onlydj-yq3fk]

Shreya Tumi kamon a6o

[@umarnadaf7170]

i am getting more attracted to words deep learning by ur explaination wt a explaination great sir hatsoff

[@mustafizurrahman5699]

BOSS BOSS, one of the best pedagogue

[@shivam6565]

You are awesome. Complex topic explained so clearly that they just stick to brain. These lectures are of the highest quality. Thank you for sharing your knowledge and for free!

[@ChristopherUOnova]

Thank you once again for making Machine Learning simple...God bless.

[@muhammadrizwan727]

Hi Sir, Amazing, I watched many videos in KZbin regarding Deep Learning or Data science, But i failed to find this type of help, lectures, mentoring. Hats off. A bundle of thanks and prayers for you from Rizwan (Pakistan). Keep it up.

[@codebasics]

Thanks Rizwan for your kind words and glad these videos are helping you 😀

[@nikolaynedelchev1644]

Thank you very much! Such a great explanation. Thank you for explaining the pitfalls in the activation functions - it is for the first time I hear them.

[@codebasics]

😊👍

[@gourabkundu7476]

Best Video on KZbin on this topic

[@mallikamehta3928]

this was extremely important, cleared my all doubts and now i think i m able to solve problems myself thank you so much, god bless you

[@mytechwork6351]

sir, you give a good concept of deep learning. Sir i am beginner and one my friend refer your deep learning lectures when i started your lectures i learn so much from it. Sir keep it up for future, thank you sir again..

[@jas13]

Your videos are excellent. Your words and diagrams really help clarify the process. I have recommended your videos to fellow colleagues. Bravo 👍

[@sayochikun3288]

wow this channel has a lot of crucial content. relu activation decreased my loss value from 0.04 to 0.003 even with half of training data!

[@mimohraj1045]

maths parts must be known to the learner because to understand the problem statments , and your lecture help me a lot thanks ,,,,,,

[@hannibalbra1216]

Brother u are a savior god bless you

[@komalteke1248]

Thank you so much .... The way you are teaching big big concepts with so much of easy understanding... it's really very very good... keep going....

[@codebasics]

I am happy this was helpful to you.

[@Breaking_Bold]

GREAT explanation ..this video and all the others in the playlist.

[@KinoFit3]

please, do more videos like this, it's so good for my brain development🧨🧨🧨🧨

[@milchada]

Thank you! Your tutorials are helping me get started with CNNs for my research!

[@codebasics]

😊👍

[@crazykidda5831]

your explaination is great!!!

[@sabarezaeekhavas7227]

I want you know that you are wonderful. I really enjoy watching your tutorials 💟

[@shiv19811]

very nice videos....good work

[@its-me-Padma]

big fan of this tutorials

[@sidduhedaginal]

Your explanations are always classic and very detailed even undergraduate student can start learning DL during his course. Keep it up sir....keep good health.

[@codebasics]

👍😊

[@AliGhavidel-g4d]

Nice series of tutorials. Super easy and time-efficient explanations.

[@goodwork9577]

There is no better explanation i've come across when it comes to Data science/ Machine Learning/Deep Learning, it's a shame that big e-learning companies like edureka are just copying content as mentioned by dhaval sir in one of his recent videos.

[@shreerup9518]

thanks bro that really helped .

[@Nikitawidnicky]

Great explanation sir, I refer to all your videos for explanations.

[@dudefromsa]

This is brilliant indeed Dhaval

[@SaiKiranPatirla]

Hello Sir, Thank you for your tutorials and I found them very interesting and easy. Previously I was very afraid of machine learning but now due to your simple explanations it became my favourite and interesting subject. I have a doubt regarding this activation function tutorial, we are implementing hidden layers as the real world features have a non-linear relationship with the output but if activation functions like ReLU are used which is a linear function how does it capture the non-linearity of the features ? Also another question if I use either sigmoid or tanh function for hidden layers and not for output layer and if there is no vanishing gradient problem for a case, how is it capturing the linking patterns of features/inputs since for any problem we are adjusting it to sigmoid or tanh function. Am I missing something, could you please help me with both the questions sir please.

[@DukeOfCurling]

Great explanation!

[@amitjaiswal781]

Very nice and easy explanation sir.

[@sanobernishat223]

Amazing teacher

[@Xiaoxiaoxiaomao]

love your tutorials ❤❤❤

[@ankkush4898]

Very useful....made it very easy...thank you

[@codebasics]

Glad it helped

[@দেবজিৎসরকার-ঢ৫ব]

SIR HOW YOUR CONCEPT IS TOO CLEAR ON ANY TOPIC? AWESOME Sir🙏🙏

[@61_shivangbhardwaj46]

Very helpful video sir☺

[@juanpablobazan5716]

Thank you so much for all the tutorials! You are the Man!!

[@beautyIsinEverything753]

nice and clear explanations thanks

[@Karthick-s8d]

it's really help full thanks

[@petcristi]

Great work!

[@work-dw2hl]

Awesome explanation plz continue this series

[@unnamednolast7701]

thank you so much i have learned so much

[@quaternion-pi]

Excellent series, clearly explained Thanks.

[@artipunit]

Best explanation ever. Will share for sure

[@codebasics]

Glad it was helpful!

[@chipsafan1]

Great video! Thank you

[@utkarshpandya3155]

very nice concept

[@mechanicalbaba2484]

Thanks you sir, now I am finding deep learning kinda easy

[@codebasics]

Glad to hear that

[@fahadreda3060]

Thanks for the video .. wish you all the best

[@arashnozarinejad3576]

incredibly informative video sir, thank you

[@convergence549]

Thank you brother you explained it very well

[@mithlesh0singh]

Just love the way you explain.

[@codebasics]

thanks mithlesh

[@amandeepsaha]

Sir u r amazing

[@akhiljohnson6019]

Sir, what is the significance of traditional ML algorithms (eg: Linear Regression, Random Forest etc) if deep learning is becoming so popular?

[@karthikc8992]

Use of ml algorithms train data with good accuracy if our data is small . When we have tons of Data , using deep learning can fix with good accuracy If the data is small deep learning cannot fix good accuracy

[@akhiljohnson6019]

@@karthikc8992 Ohh Thanks for the info ☺️

[@priyabratapanda1216]

Also it's very difficult to handle a deeplearning model than a machine learning model. Also you might have noticed deeplearning models aren't quite responsive as compared to ML model as it requires a lot of time for training. Another thing you only go for deeplearning when you have tons of data's otherwise you'll end up overfitting your model.

[@shamsunder5353]

Simply fantastic

[@priyabratapanda1216]

Really very intuitive indeed!🙏🙏🙏🙏

[@codebasics]

I am happy this was helpful to you.

[@shahajadealam9684]

superb video sir 💕💕💕💕💕👍

[@codebasics]

Glad it was helpful!

[@kashishvarshney2225]

really amazing

[@sanooosai]

thank you great work

[@amirhanna6270]

Excellent

[@shafagh_projects]

congrats for your lovely tutorial. is C++ being used for deep learning? or Python is the top list of industries for AI transformation.

[@codebasics]

Python rules the ML world. People use C++ but rarely

[@bangarrajumuppidu8354]

super explanation sir!!

[@codebasics]

Glad you liked it

[@ranakarmakar5141]

thank you for this playlist

[@ishapandey48]

Understood well...thanks sir!!

[@245uday]

Well explained sir...waiting for next video

[@codebasics]

😊👍

[@dhruvkantsharma2955]

Thank you for such an amazing tutorial!

[@codebasics]

Glad it was helpful!

[@SwarnaliMollickA]

Amazing!

[@dec13666]

Nice explanation 😎👍

[@codebasics]

Glad it was helpful!

[@sudhakarm4573]

Dear sir.. request to make videos on Boltzmann machines

[@_AkankshaPatil]

Thanks a lot, sir for such an amazing tutorial

[@NazanTem]

Thank you!

[@soubhikghoshroy7110]

00:00 Activation functions are necessary in neural networks 02:04 Activation functions are necessary for building non-linear equations in neural networks. 04:06 Step function and sigmoid function are activation functions used in classification 05:57 Use sigmoid function in the output layer and 10h function in all other places. 07:54 Derivatives and the problem of vanishing gradients 10:02 The most popular activation function for hidden layers is the sigmoid function. 12:04 Sigmoid and tanh functions are used to convert values into a range of 0 to 1 or -1 to 1 respectively. 14:30 Positive values remain the same, negative values become zero, leaky value function multiplies input by 0.1

[@MAK_3583]

good tutorial

[@jongcheulkim7284]

thank you so much.

[@shubhangiagrawal336]

useful video

[@mayankvekariya8199]

I like your all videos

[@codebasics]

And I like your comment Mayank :)

[@ayushi6424]

Sir please include softmax activation fuction also..can u give me brief of it...because i m using it in my project

[@deepthikiran8345]

amazing tutorial.....right to the point...thanks :)

[@codebasics]

Glad you liked it!

[@tewodrosgebre204]

thank you

[@manishdas6525]

dhasu 🔥

[@mohitb5230]

well done

[@Bulbulgoyal672]

thanku sir

[@md.tahmidulislam5965]

Can you please tell something about Asymmetric Activation Function in Neural Network ?

[@IshaZaka]

sir, i have one question, as before doing machine learning, you said to complete your numpy and pandas tutorials, should we still watch those videos, because they are 6 years old now. will that be okay if we will watch that videos now to jump on machine learning tutorial,

[@shikhasen3981]

Hi sir , I want to be as great as you are at dat science . just a question , is neutral network good for classification or can we forecast the regression as well ?

[@vijayalaxmiyalavigi6232]

Sir, thank you very much.

[@codebasics]

Glad it was helpful!

[@rathnakumarv3956]

Sir, what about softmax activation function, only for multiple classification? any other activation function for time series analysis?

[@saurabhbarasiya4721]

Thanks

[@abizarkhalil]

Sir, Please make a video on BiGAN from scratch along with python code

[@rizalmuhammed7816]

Can you also upload the presentation slide in the github link for quick occasional revision. Thank You

[@anirudhsrivastava3530]

@2:52 Sir, can you explain in detail the non-linearity part of activation function

[@sayantanmitra7897]

This is really helpful. Could you please provide the slides?