Intuition: Training Set vs. Test Set vs. Validation Set

Рет қаралды 30,774

3 жыл бұрын

The difference between training, test, and validation datasets can be confusing. Especially when you think that testing means to create tests and compare different results between models and validation means to verify those results. That's what I originally thought when I learned it... apparently that's wrong.
More videos: / intuitiveml
Follow:
Twitter: / sentimofficial
Facebook: / sentimofficial
____________________
Learn more:
Details: en.wikipedia.org/wiki/Trainin...
Less details: machinelearningmastery.com/di...
Even less details: stats.stackexchange.com/quest...
#IntuitiveML, #MachineLearning, #AI

Пікірлер: 30

@jamesang7861 3 жыл бұрын

I always remember it this way, to simplify my own understanding. Training set: The effort we put we're studying for an examination (training our brain). Validation set: The sample exam test papers we do to test our understanding on what we have learnt. Test set: The actual final exam that we take. Or course, the 'test set' could also mean real world application of our knowledge/understanding, depending on how we want to put it.

@IntuitiveML 3 жыл бұрын

Well said!

@VFORVICTORY1000 3 жыл бұрын

thx it helps me a lot

@priyalbhardwaj696 2 жыл бұрын

Woah it helped me thnakss ☺️☺️☺️

@lionghanwen257 Ай бұрын

how come the others "expert" cannot explain this in such a simple and easy understand way? You deserve my 5 stars

@daifang2029 2 жыл бұрын

The most clear explanation I have ever seen.

@user-ww2qs3cj9n 2 ай бұрын

Thank you a great video that helped me understand in barley over 2 minutes

@IntuitiveML 3 жыл бұрын

Apologies! I thought I published this a month ago, but I actually forgot to move it from unlisted to publish until now! That's my bad...

@sujayghosh3540 Жыл бұрын

Not a problem

@neelshah1651 Жыл бұрын

The most clear explanation I have ever seen, Keep it up...

@utkarshverma3916 2 жыл бұрын

Short but crisp and effective, crystal clear👍👍

@luzzyommm 2 жыл бұрын

this is the best explanation of validation vs test data!

@mikemihay 3 жыл бұрын

Great video! Thank you for creating it, good visualisations

@NosurfOfficial 3 жыл бұрын

Thank you, please keep making more videos, this was really helpful.

@IntuitiveML 3 жыл бұрын

More to come very soon! I'm making a longer video and I'm a little behind...

@mariap.9768 2 жыл бұрын

Perfectly concise.

@DoubleMagnet 2 жыл бұрын

This video is very helpful, thank you so much

@purple3036 10 ай бұрын

Wonderful explanation, thanks for the video

@md.nobihossen6183 3 жыл бұрын

thanks a lot. my confusion is cleared now after watching your video. best of luck for the future.

@IntuitiveML 3 жыл бұрын

You are most welcome!

@Yassinius 2 жыл бұрын

Great video!

@lucarauchenberger628 2 жыл бұрын

gold! great explanation!!

@IntuitiveML 2 жыл бұрын

@li-pingho1441 2 жыл бұрын

this is amazing

@andreamansi2441 3 жыл бұрын

A nice refresh :)

@IntuitiveML 3 жыл бұрын

I'm glad it was helpful for you!

@darwin6984 Жыл бұрын

Most ppl combine validation and test set. May you kindly advise How to determine how much percent for 3 datasets? and methodology to determine it?

@barax9462 3 жыл бұрын

So basically after training the weights,, I just should pass the validation into forward-probagation and compute the loss??

@IntuitiveML 3 жыл бұрын

Normally you compute the metric you care about with the validation and test sets, such as accuracy, precision, and recall

@biruhandualem9930 2 жыл бұрын

how can I communicate with u individually? like telegram account............