Activation Functions | Deep Learning Tutorial 8 (Tensorflow Tutorial, Keras & Python)

Рет қаралды 224,392

Күн бұрын

Activation functions (step, sigmoid, tanh, relu, leaky relu ) are very important in building a non linear model for a given problem. In this video we will cover different activation functions that are used while building a neural network. We will discuss these functions with their pros and cons,
1) Step
2) Sigmoid
3) tanh
4) ReLU (rectified linear unit)
5) Leaky ReLU
We will also write python code to implement these functions and see how they behave for sample inputes.
Github link for code in this tutorial: : github.com/codebasics/deep-le...
Do you want to learn technology from me? Check codebasics.io/?... for my affordable video courses.
🔖 Hashtags 🔖
#activationfunction #activationfunctionneuralnetwork #neuralnetwork #deeplearning
Next video: • Derivatives | Deep Lea...
Previous video: • Neural Network For Han...
Deep learning playlist: • Deep Learning With Ten...
Machine learning playlist : kzfaq.info?list...
Prerequisites for this series:
1: Python tutorials (first 16 videos): kzfaq.info?list...
2: Pandas tutorials(first 8 videos): • Pandas Tutorial (Data ...
3: Machine learning playlist (first 16 videos): kzfaq.info?list...
🌎 My Website For Video Courses: codebasics.io/?...
Need help building software or data analytics and AI solutions? My company www.atliq.com/ can help. Click on the Contact button on that website.
#️⃣ Social Media #️⃣
🔗 Discord: / discord
📸 Dhaval's Personal Instagram: / dhavalsays
📸 Instagram: / codebasicshub
🔊 Facebook: / codebasicshub
📝 Linkedin (Personal): / dhavalsays
📝 Linkedin (Codebasics): / codebasics
📱 Twitter: / codebasicshub
🔗 Patreon: www.patreon.com/codebasics?fa...

Пікірлер: 168

@codebasics 2 жыл бұрын

Do you want to learn technology from me? Check codebasics.io/ for my affordable video courses.

@abvijaykumar Жыл бұрын

Very well articulated, I searched the whole web, nobody explained these concepts in such simple way, without any confusion!!! Thank you

@MrBasu-iq6md Жыл бұрын

I do get valuable information from youtube now and then. However, I did not expect deep learning tutorials to be explained in such simplicity yet highly informative as well. Machine Learning and Deep Learning videos on this channel are highly recommended. Thank you for such contents.

@JunaidInHenan Жыл бұрын

Hats off, I am a PhD student, and I worked on NLP, ML and text analytics, in the last semester of my PhD I am turning to deep learning for my post doc research, and I needed background information on deep learning. Also in my last project somehow I managed to apply deep learning simple classifier, but that instinct to theoretically and technically understand background of deep learning was missing. I read articles, videos etc. a lot but man your videos on deep learning concept is really fulfilling my instinct up till now. Hats off to you Bro. Thank you for your vision of education and these helpful tutorials.

@aditibhushan19 Күн бұрын

May I please get your email ID

@ansumansatpathy3923 5 ай бұрын

Very structured and organic build up of concepts, not throwing a bunch in a short timeframe down your throat praying you gobble it up. I appreciate your hard work behind the animations too.Keep it up!

@shivam6565 3 жыл бұрын

You are awesome. Complex topic explained so clearly that they just stick to brain. These lectures are of the highest quality. Thank you for sharing your knowledge and for free!

@karthikc8992 4 жыл бұрын

sir what ah explanation , it seems so easy to learn deep learning,carry on your winning momentum , hope you become one of the great teachers in data science🔥🔥🔥🔥🔥🔥🔥🔥🔥

@SKumar-Munna 4 жыл бұрын

I am watching your video since beginning. All is amazing Sirji.

@ChristopherUOnova 3 жыл бұрын

Thank you once again for making Machine Learning simple...God bless.

@sayochikun3288 2 жыл бұрын

wow this channel has a lot of crucial content. relu activation decreased my loss value from 0.04 to 0.003 even with half of training data!

@nikolaynedelchev1644 3 жыл бұрын

Thank you very much! Such a great explanation. Thank you for explaining the pitfalls in the activation functions - it is for the first time I hear them.

@codebasics 3 жыл бұрын

😊👍

@shreyakapadia3735 3 жыл бұрын

I really loved the easy explanation given by your sir. I wish I'd found this series earlier, but will watch the series from now on. Thank you for your efforts.

@codebasics 3 жыл бұрын

All the best Shreya

@wishIKnewHowToLove Жыл бұрын

The best KZfaq teacher!

@umarnadaf7170 2 жыл бұрын

i am getting more attracted to words deep learning by ur explaination wt a explaination great sir hatsoff

@mallikamehta3928 Жыл бұрын

this was extremely important, cleared my all doubts and now i think i m able to solve problems myself thank you so much, god bless you

@arslanMCL 3 жыл бұрын

Number of views is not doing justice to the quality of content that is created. Learning two weeks content in hardly 20 minutes. Thanks

@codebasics 3 жыл бұрын

I appreciate you leaving a comment of appreciation

@mytechwork6351 Жыл бұрын

sir, you give a good concept of deep learning. Sir i am beginner and one my friend refer your deep learning lectures when i started your lectures i learn so much from it. Sir keep it up for future, thank you sir again..

@gourabkundu7476 3 ай бұрын

Best Video on KZfaq on this topic

@juanpablobazan5716 3 жыл бұрын

Thank you so much for all the tutorials! You are the Man!!

@jas13 Жыл бұрын

Your videos are excellent. Your words and diagrams really help clarify the process. I have recommended your videos to fellow colleagues. Bravo 👍

@mustafizurrahman5699 8 ай бұрын

BOSS BOSS, one of the best pedagogue

@hannibalbra1216 2 жыл бұрын

Brother u are a savior god bless you

@user-yy3ts5pf8k 11 ай бұрын

Nice series of tutorials. Super easy and time-efficient explanations.

@quaternion-pi 4 жыл бұрын

Excellent series, clearly explained Thanks.

@its-me-Padma Жыл бұрын

big fan of this tutorials

@work-dw2hl 4 жыл бұрын

Awesome explanation plz continue this series

@milchada 2 жыл бұрын

Thank you! Your tutorials are helping me get started with CNNs for my research!

@codebasics 2 жыл бұрын

😊👍

@chipsafan1 Жыл бұрын

Great video! Thank you

@nikitasharma2757 3 жыл бұрын

Great explanation sir, I refer to all your videos for explanations.

@muhammadrizwan727 Жыл бұрын

Hi Sir, Amazing, I watched many videos in KZfaq regarding Deep Learning or Data science, But i failed to find this type of help, lectures, mentoring. Hats off. A bundle of thanks and prayers for you from Rizwan (Pakistan). Keep it up.

@codebasics Жыл бұрын

Thanks Rizwan for your kind words and glad these videos are helping you 😀

@DukeOfCurling Жыл бұрын

Great explanation!

@Xiaoxiaoxiaomao Жыл бұрын

love your tutorials ❤❤❤

@sabarezaeekhavas7227 Жыл бұрын

I want you know that you are wonderful. I really enjoy watching your tutorials 💟

@petcristi 3 ай бұрын

Great work!

@unnamednolast7701 2 жыл бұрын

thank you so much i have learned so much

@arashnozarinejad3576 2 жыл бұрын

incredibly informative video sir, thank you

@ishapandey48 4 жыл бұрын

Understood well...thanks sir!!

@Breaking_Bold 10 ай бұрын

GREAT explanation ..this video and all the others in the playlist.

@sanobernishat223 Жыл бұрын

Amazing teacher

@shamsunder5353 4 жыл бұрын

Simply fantastic

@_AkankshaPatil 2 жыл бұрын

Thanks a lot, sir for such an amazing tutorial

@fahadreda3060 4 жыл бұрын

Thanks for the video .. wish you all the best

@dhruvkantsharma2955 3 жыл бұрын

Thank you for such an amazing tutorial!

@codebasics 3 жыл бұрын

Glad it was helpful!

@sanooosai 6 ай бұрын

thank you great work

@sidduhedaginal 3 жыл бұрын

Your explanations are always classic and very detailed even undergraduate student can start learning DL during his course. Keep it up sir....keep good health.

@codebasics 3 жыл бұрын

👍😊

@convergence549 3 жыл бұрын

Thank you brother you explained it very well

@dudefromsa 2 жыл бұрын

This is brilliant indeed Dhaval

@goodwork9577 2 жыл бұрын

There is no better explanation i've come across when it comes to Data science/ Machine Learning/Deep Learning, it's a shame that big e-learning companies like edureka are just copying content as mentioned by dhaval sir in one of his recent videos.

@mithlesh0singh 3 жыл бұрын

Just love the way you explain.

@codebasics 3 жыл бұрын

thanks mithlesh

@Karthick-s8d 13 күн бұрын

it's really help full thanks

@mimohraj1045 Жыл бұрын

maths parts must be known to the learner because to understand the problem statments , and your lecture help me a lot thanks ,,,,,,

@beautyIsinEverything753 2 жыл бұрын

nice and clear explanations thanks

@ranakarmakar5141 2 жыл бұрын

thank you for this playlist

@shiv19811 2 жыл бұрын

very nice videos....good work

@user-cz6ht4ot7o 2 жыл бұрын

SIR HOW YOUR CONCEPT IS TOO CLEAR ON ANY TOPIC? AWESOME Sir🙏🙏

@komalteke1248 3 жыл бұрын

Thank you so much .... The way you are teaching big big concepts with so much of easy understanding... it's really very very good... keep going....

@codebasics 3 жыл бұрын

I am happy this was helpful to you.

@amitjaiswal781 3 жыл бұрын

Very nice and easy explanation sir.

@amandeepsaha Жыл бұрын

Sir u r amazing

@NazanTem 2 ай бұрын

Thank you!

@SwarnaliMollickA 2 жыл бұрын

Amazing!

@jongcheulkim7284 2 жыл бұрын

thank you so much.

@61_shivangbhardwaj46 2 жыл бұрын

Very helpful video sir☺

@kashishvarshney2225 5 ай бұрын

really amazing

@utkarshpandya3155 Жыл бұрын

very nice concept

@priyabratapanda1216 3 жыл бұрын

Really very intuitive indeed!🙏🙏🙏🙏

@codebasics 3 жыл бұрын

I am happy this was helpful to you.

@amirhanna6270 Жыл бұрын

Excellent

@ankkush4898 2 жыл бұрын

Very useful....made it very easy...thank you

@codebasics 2 жыл бұрын

Glad it helped

@artipunit 3 жыл бұрын

Best explanation ever. Will share for sure

@codebasics 3 жыл бұрын

Glad it was helpful!

@deepthikiran8345 3 жыл бұрын

amazing tutorial.....right to the point...thanks :)

@codebasics 3 жыл бұрын

Glad you liked it!

@darktarifa7200 3 жыл бұрын

Thanks for your explaniation

@codebasics 3 жыл бұрын

Glad it was helpful!

@mechanicalbaba2484 3 жыл бұрын

Thanks you sir, now I am finding deep learning kinda easy

@codebasics 3 жыл бұрын

Glad to hear that

@Bulbulgoyal672 10 ай бұрын

thanku sir

@tewodrosgebre204 2 жыл бұрын

thank you

@MAK_3583 Жыл бұрын

good tutorial

@bangarrajumuppidu8354 2 жыл бұрын

super explanation sir!!

@codebasics 2 жыл бұрын

Glad you liked it

@manishdas6525 2 жыл бұрын

dhasu 🔥

@saurabhbarasiya4721 4 жыл бұрын

Thanks

@245uday 4 жыл бұрын

Well explained sir...waiting for next video

@codebasics 3 жыл бұрын

😊👍

@vijayalaxmiyalavigi6232 3 жыл бұрын

Sir, thank you very much.

@codebasics 3 жыл бұрын

Glad it was helpful!

@mohitb5230 4 жыл бұрын

well done

@mayankvekariya8199 4 жыл бұрын

I like your all videos

@codebasics 4 жыл бұрын

And I like your comment Mayank :)

@debatradas9268 2 жыл бұрын

thanks

@shahajadealam9684 3 жыл бұрын

superb video sir 💕💕💕💕💕👍

@codebasics 3 жыл бұрын

Glad it was helpful!

@dec13666 3 жыл бұрын

Nice explanation 😎👍

@codebasics 3 жыл бұрын

Glad it was helpful!

@shubhangiagrawal336 3 жыл бұрын

useful video

@kirankumarpaturu2239 3 жыл бұрын

sir thank u so much

@codebasics 3 жыл бұрын

Most welcome kiran.

@shikhasen3981 3 жыл бұрын

Hi sir , I want to be as great as you are at dat science . just a question , is neutral network good for classification or can we forecast the regression as well ?

@sayantanmitra7897 3 жыл бұрын

This is really helpful. Could you please provide the slides?

@ayushi6424 3 жыл бұрын

Sir please include softmax activation fuction also..can u give me brief of it...because i m using it in my project

@grandhimanikanta7522 3 жыл бұрын

At what value of "tanh" neuron will activate/fire the output to the next neuron?

@akhiljohnson6019 4 жыл бұрын

Sir, what is the significance of traditional ML algorithms (eg: Linear Regression, Random Forest etc) if deep learning is becoming so popular?

@karthikc8992 4 жыл бұрын

Use of ml algorithms train data with good accuracy if our data is small . When we have tons of Data , using deep learning can fix with good accuracy If the data is small deep learning cannot fix good accuracy

@akhiljohnson6019 4 жыл бұрын

@@karthikc8992 Ohh Thanks for the info ☺️

@priyabratapanda1216 3 жыл бұрын

Also it's very difficult to handle a deeplearning model than a machine learning model. Also you might have noticed deeplearning models aren't quite responsive as compared to ML model as it requires a lot of time for training. Another thing you only go for deeplearning when you have tons of data's otherwise you'll end up overfitting your model.

@rathnakumarv3956 Жыл бұрын

Sir, what about softmax activation function, only for multiple classification? any other activation function for time series analysis?

@SaiKiranPatirla 16 күн бұрын

Hello Sir, Thank you for your tutorials and I found them very interesting and easy. Previously I was very afraid of machine learning but now due to your simple explanations it became my favourite and interesting subject. I have a doubt regarding this activation function tutorial, we are implementing hidden layers as the real world features have a non-linear relationship with the output but if activation functions like ReLU are used which is a linear function how does it capture the non-linearity of the features ? Also another question if I use either sigmoid or tanh function for hidden layers and not for output layer and if there is no vanishing gradient problem for a case, how is it capturing the linking patterns of features/inputs since for any problem we are adjusting it to sigmoid or tanh function. Am I missing something, could you please help me with both the questions sir please.

@sudhakarm4573 2 жыл бұрын

Dear sir.. request to make videos on Boltzmann machines

@anirudhsrivastava3530 Жыл бұрын

@2:52 Sir, can you explain in detail the non-linearity part of activation function

@md.tahmidulislam5965 2 жыл бұрын

Can you please tell something about Asymmetric Activation Function in Neural Network ?

@shivasiddharthnarayanan 3 жыл бұрын

Thanks for the great tutorial.... Not sure if this query is right. Sir, while explaining ReLU the mark of 1 at y-axis is not correct, I guess......Please correct me if I am wrong....:-)