No video

Handling Imbalanced Datasets SMOTE Technique

  Рет қаралды 49,784

DataMites

DataMites

4 жыл бұрын

CODE: github.com/ash...
DATA : github.com/ash...
/ ashokveda

Пікірлер: 232
@pandharpurkar_
@pandharpurkar_ 3 жыл бұрын
best teacher i have ever seen! Explaining in very proper way! in short time explaining exact things!!!
@DataMites
@DataMites 3 жыл бұрын
Thank you!
@JainmiahSk
@JainmiahSk 4 жыл бұрын
Data Mites is a hidden gem now but soon they will be a Brand for Data Science. Keep my note for Future.
@DataMites
@DataMites 4 жыл бұрын
Thank you 😊
@akshiwakoti7851
@akshiwakoti7851 4 жыл бұрын
A real pro! Subbed this channel after watching first 3 minutes. Glad to have found it.
@DataMites
@DataMites 3 жыл бұрын
Thank you so much.
@donaloleary5514
@donaloleary5514 3 жыл бұрын
Thank you, Ashok! This is an outstanding explanation of a complex subject. You make it all feel very intuitive. Awesome stuff - I will look for more DataMites videos in the future!
@DataMites
@DataMites 3 жыл бұрын
"Hi, Donal O'Leary, Thanks for your comment and keep on visiting our channel for more and updated content."
@bhagwatchate7511
@bhagwatchate7511 4 жыл бұрын
Amazing in depth explanation! I was exactly searching for this type of explanation.. Thanks for sharing
@DataMites
@DataMites 3 жыл бұрын
Glad it was helpful!
@SurajSingh-wn4wu
@SurajSingh-wn4wu 4 жыл бұрын
Great Ashok.!! Genuinely liked your way of explanation in depth and the solution... Glad i landed on your page... Thank You..!
@DataMites
@DataMites 3 жыл бұрын
Thanks and welcome
@MLA263
@MLA263 Жыл бұрын
Thanks Ashok, very clear and simple explanation.
@DataMites
@DataMites Жыл бұрын
Thank You
@user-dn8uc5sc8l
@user-dn8uc5sc8l 8 ай бұрын
Wow sir liked u r session .please continue posting such videos
@user-km4hl8lx8x
@user-km4hl8lx8x Жыл бұрын
This is really helpful and thank you again!
@DataMites
@DataMites Жыл бұрын
Glad it was helpful! Keep Watching!
@alisalariyan6676
@alisalariyan6676 3 жыл бұрын
The best smote tutorial I've seen. Thanks
@DataMites
@DataMites 3 жыл бұрын
Glad it was helpful!
@lalithapriya9484
@lalithapriya9484 3 жыл бұрын
extreme clarification really superb teaching skills along with good communications
@DataMites
@DataMites 3 жыл бұрын
Hi lalitha priya, thank you for you comment.
@binoypaul9772
@binoypaul9772 3 жыл бұрын
Nice and informative. Please keep up the good work.
@DataMites
@DataMites 3 жыл бұрын
Thank you.
@milliekim5072
@milliekim5072 3 жыл бұрын
Thank you so much, sir! I hope I see more videos
@DataMites
@DataMites 3 жыл бұрын
Keep watching.
@osamaamir9311
@osamaamir9311 Жыл бұрын
Such an amazing topic
@DataMites
@DataMites Жыл бұрын
Thank You
@b1k1m1
@b1k1m1 4 жыл бұрын
Hello Sir, Thanks for explaining this very clearly.. keep it up....
@DataMites
@DataMites 3 жыл бұрын
You're most welcome
@adeyinkasotunde6870
@adeyinkasotunde6870 4 жыл бұрын
wow...... i am very well impressed. well explained. thanks
@DataMites
@DataMites 3 жыл бұрын
You are most welcome
@ChrisHalden007
@ChrisHalden007 Жыл бұрын
Great video. Thanks
@DataMites
@DataMites Жыл бұрын
Glad you like it! Keep Supporting
@jagannadhareddykalagotla624
@jagannadhareddykalagotla624 3 жыл бұрын
DataMites is like hidden pattern in unsupervised learning thank you so much ashok❤️❤️
@DataMites
@DataMites 3 жыл бұрын
Thank you!
@dewipurnamasari5814
@dewipurnamasari5814 Жыл бұрын
Thank you very much
@DataMites
@DataMites Жыл бұрын
Most welcome! Keep Watching
@inspiritlashi9994
@inspiritlashi9994 3 жыл бұрын
Thank you so much for the great tutorial.. As someone who does not have even the basic knowledge of python, I could learn many things from you, sir.
@DataMites
@DataMites 3 жыл бұрын
Glad it was helpful!
@8sharkey8
@8sharkey8 3 жыл бұрын
Excellent content, brilliantly presented. Thank you. Subscribed.
@DataMites
@DataMites 3 жыл бұрын
Thanks and welcome
@bhanukiran4317
@bhanukiran4317 3 жыл бұрын
Great content sir !! Keep on spreading knowledge
@DataMites
@DataMites 3 жыл бұрын
Thank you, Keep watching
@nasreenbanu2245
@nasreenbanu2245 2 жыл бұрын
Hai sir! thanks a lot for very simple and clear explanation.keep going we expect more videos from you...
@DataMites
@DataMites 2 жыл бұрын
Keep watching
@alishahsaber3795
@alishahsaber3795 3 жыл бұрын
Thank you so much!!! Really helpful. thanks
@DataMites
@DataMites 3 жыл бұрын
Glad it helped!
@Cobra-bo1fy
@Cobra-bo1fy 2 жыл бұрын
excellent explanation!
@DataMites
@DataMites 2 жыл бұрын
Thank you.
@siddhantagarwal274
@siddhantagarwal274 4 жыл бұрын
Nicely explained. Thanks!
@DataMites
@DataMites 3 жыл бұрын
You're welcome!
@niswandi6122
@niswandi6122 Жыл бұрын
Thank you ashok, clear explanation, but howto handle the imbalanced datasets if we have 4 classes?
@DataMites
@DataMites Жыл бұрын
For multiclass also same technique is applied as that of 2 classes
@svitirur1665
@svitirur1665 3 жыл бұрын
very good explanation
@DataMites
@DataMites 3 жыл бұрын
Keep watching
@ombb3576
@ombb3576 3 жыл бұрын
Thank you for your sincere lecture sir
@DataMites
@DataMites 2 жыл бұрын
You are most welcome
@defres15
@defres15 2 жыл бұрын
Great video. Great explanation. Thank you
@DataMites
@DataMites 2 жыл бұрын
You are welcome!
@riorizkiaryanto
@riorizkiaryanto 3 жыл бұрын
Great video and explanation! Thanks.
@DataMites
@DataMites 3 жыл бұрын
You're welcome!
@ringgaershaikhwani3478
@ringgaershaikhwani3478 Жыл бұрын
hello sir, the material that you explain is very easy to understand. I want to ask about my project. I have imbalanced data, then I do smote and I model it with KNN, but why after smote does the accuracy go down? 79% to 78%, is there something wrong with my data? Can you help explain this? I am very grateful if you respond to my comment.
@DataMites
@DataMites Жыл бұрын
Using SMOTE, your model will start detecting more cases of the minority class, which will result in an increased recall, but a decreased precision. Accuracy is not a good measure of performance on unbalanced classes. That's because SMOTE technique puts more weight to the small class, makes the model bias to it. The model will now predict the small class with higher accuracy but the overall accuracy may decrease.
@heenagirdher6443
@heenagirdher6443 3 жыл бұрын
Great tutorial. Very good explanation sir.
@DataMites
@DataMites 3 жыл бұрын
Glad you liked it
@mohamedoutghratine8538
@mohamedoutghratine8538 4 жыл бұрын
Amazing in depth explanation
@DataMites
@DataMites 3 жыл бұрын
Thank you!
@sabbirahmmed7161
@sabbirahmmed7161 2 жыл бұрын
Thanks, nice explanation
@DataMites
@DataMites 2 жыл бұрын
You are welcome
@aftabnaseem
@aftabnaseem 3 жыл бұрын
Great job ....made it look very easy
@DataMites
@DataMites 3 жыл бұрын
Thanks you 👍
@akshayjadhav2213
@akshayjadhav2213 3 жыл бұрын
very nicely explained sir ..thank you
@DataMites
@DataMites 3 жыл бұрын
You are most welcome
@manishbolbanda9872
@manishbolbanda9872 3 жыл бұрын
wonderfully explained.thank you.
@DataMites
@DataMites 3 жыл бұрын
You are welcome!
@dikshitlenka
@dikshitlenka 3 жыл бұрын
Very clear explanation. Thanks
@DataMites
@DataMites 3 жыл бұрын
You are welcome!
@AMITSHARMA-fy4wv
@AMITSHARMA-fy4wv 4 жыл бұрын
Really appreciate sir..Lot off.🙏🏼🙏🏼🙏🏼🙏🏼🤗🤗🤗👌👌👌👌😊😊😊😊
@DataMites
@DataMites 3 жыл бұрын
Thank you!
@nehaurade4917
@nehaurade4917 3 жыл бұрын
Perfect video..thank you
@DataMites
@DataMites 3 жыл бұрын
You are welcome!
@parsayadpa5446
@parsayadpa5446 3 жыл бұрын
thanks alot for this good tutorial.
@DataMites
@DataMites 3 жыл бұрын
You are welcome!
@abhijitkamune3976
@abhijitkamune3976 4 жыл бұрын
Nice explanation .. Looking for more NLP related video
@DataMites
@DataMites 3 жыл бұрын
Sure
@athilakshmir8589
@athilakshmir8589 3 жыл бұрын
nice explanation
@DataMites
@DataMites 3 жыл бұрын
Thank You!
@AsiaMSaeed
@AsiaMSaeed 2 жыл бұрын
Amazing. Thanks a lot.
@DataMites
@DataMites 2 жыл бұрын
You are welcome!
@muhammedalisahan9661
@muhammedalisahan9661 Жыл бұрын
Firstly, Thank you for sharing. I wanna ask something about time series. I have lots of data. But datas are different frequency. I wonder how deal with all datas. And assume that datas edited to same frequency. By the way datas are not fitted normal distribution so imbalanced that's why i am asking. If datas be same frequency, Smote can be appliable for time series? If not how to resample my time series?
@ffckode
@ffckode 4 жыл бұрын
Thanks for sharing. Very helpful
@DataMites
@DataMites 3 жыл бұрын
Glad it was helpful!
@tanvipataskar4597
@tanvipataskar4597 4 жыл бұрын
Amazing Explanation!!! Thankyou.
@DataMites
@DataMites 3 жыл бұрын
You are welcome!
@babukoshy
@babukoshy 3 жыл бұрын
This was a great lesson. Thanks a lot
@DataMites
@DataMites 3 жыл бұрын
You're very welcome!
@perusona_desu5534
@perusona_desu5534 Жыл бұрын
in oversampling do you have to make the minority class instances equals the majority class instances ? for example: can it be 900 nc and 800 c
@DataMites
@DataMites Жыл бұрын
Oversampling is increasing the samples for minority class to match with the majority class. Undersampling is reducing the samples for majority class to match with minority class.
@michaelpanashemudimbu7405
@michaelpanashemudimbu7405 3 жыл бұрын
Awesome video
@DataMites
@DataMites 3 жыл бұрын
Glad you enjoyed it
@swastiknayak5173
@swastiknayak5173 4 жыл бұрын
At 8.15 you have said it is taking the average of centroids which is completely wrong. SMOTE is calculated over the feature space...it goes like this 1. we take the feature vector of the minority class point. 2. we calculate the distance between the neighbours (neighbours=5). 3. we multiply the distance between the neighbours with a random number that is created between 0 &1. 4. Then we create the synthesized point. hope you got it 😀
@DataMites
@DataMites 3 жыл бұрын
SMOTE works by selecting examples that are close in the feature space, drawing a line between the examples in the feature space and drawing a new sample at a point along that line. Specifically, a random example from the minority class is first chosen. Then k of the nearest neighbours for that example are found (typically k=5). A randomly selected neighbour is chosen and a synthetic example is created at a randomly selected point between the two examples in feature space.
@petersq5532
@petersq5532 2 жыл бұрын
how split stratify solves the problem?
@MrMehshankhan
@MrMehshankhan 3 жыл бұрын
thank you so much man. great thumbs up...
@DataMites
@DataMites 3 жыл бұрын
You're welcome!
@seeutube8860
@seeutube8860 2 жыл бұрын
Nice video. After applying smote, balanced data was obtained. But balanced data (X_smote,y_smote) was not split (80:20) in to train n test data sets before reapplying classification model? Is it necessary or not to split the data again? Or orginal dataset itself was considered as test dataset.
@DataMites
@DataMites 2 жыл бұрын
We have already split and then we balanced the data. So not required to split again.
@younesgasmi8518
@younesgasmi8518 6 ай бұрын
Thanks so much bro..i have shown some data scientists used undersampling and oversampling before Splitting the dataset into training and testing..in my research paper we heve used NEARMISS technique to balance the dataset..i have got a good results with using cross validation Splitting and Extra tree classifier as model and also the same model to select the best importance features where my results are : (ACC 0.97 , F1 0.97 and AUC 0.99) are there results may be accepted for publishing?
@DataMites
@DataMites 6 ай бұрын
You achieved good results. However, whether your results are acceptable for publishing depends on several other factors too.
@mozaffarhussain5496
@mozaffarhussain5496 4 жыл бұрын
Best Explanation sir ..............!
@DataMites
@DataMites 3 жыл бұрын
Keep watching
@HarishKumar-qj9pp
@HarishKumar-qj9pp 3 жыл бұрын
getting attribute error: 'SMOTE' object has no attribute 'fit_sample' but I have all the packages requirement satisfied still showing the error
@DataMites
@DataMites 3 жыл бұрын
Hi please check imbalanced-learn.org/stable/over_sampling.html for any update in imbalance learn package
@tahanics901
@tahanics901 2 жыл бұрын
Very good explanation Thanks. but this code, is applicable with text data (tweets) or not?
@DataMites
@DataMites 2 жыл бұрын
yes after converting text to numerical vectors. use fit_resample()
@kurniawandk5078
@kurniawandk5078 2 жыл бұрын
Very informative, i have a question sir, it is possible to set how many synthetic data created by smote ? in example i want to set n_sample increase to 200% so, how to put this parameters in pyhton code ?
@DataMites
@DataMites 2 жыл бұрын
Your question is not clear. Can you elaborate plz?
@amruthakommu4695
@amruthakommu4695 2 жыл бұрын
Great Ashok. That was a well explained video. I tried the same thing on my data set but my accuracy came down from 94 to 86. What could be the cause?
@DataMites
@DataMites 2 жыл бұрын
Hi, we cannot comment until we look in your data and all the approaches that you have taken. One of the possibility might be your prediction was previously overfitted.
@ishan7491
@ishan7491 3 жыл бұрын
Can you please explain this part of the code in the label encoder section:
@DataMites
@DataMites 3 жыл бұрын
Hi Ishan, please reframe your query.
@samhugh9891
@samhugh9891 3 жыл бұрын
great video, thank you!
@DataMites
@DataMites 3 жыл бұрын
You are welcome!
@canancetin7897
@canancetin7897 3 жыл бұрын
Great video! Thanks a lot!!!
@DataMites
@DataMites 3 жыл бұрын
Glad you liked it!
@sasidharansathiyamoorthy6918
@sasidharansathiyamoorthy6918 3 жыл бұрын
Thank you for the informative video! In this video, you have used SMOTE to rectify imbalance in target label. What methods can we use to deal with class imbalance in categorical features( input) in order to make the model more robust?
@DataMites
@DataMites 3 жыл бұрын
Hi Sasidharan Sathiyamoorthy, Its property of input so if u balance the input it might affect the target variable. Make 2 models with and without balancing n check the performance
@RoyalRealReview
@RoyalRealReview 2 жыл бұрын
@@DataMites sir if we have 54% persons cancer patients and 46% non-cancer patients then do we need balancing? If yes then which balancing technique should be selected?
@cliffordtarimo1511
@cliffordtarimo1511 3 жыл бұрын
Great video on SMOTE. Do you have a video on undersampling? Can someone perform both undersampling and oversampling in one line of code??? THANKS.
@DataMites
@DataMites 3 жыл бұрын
The other flavor of SMOTE is SMOTETOMEK which uses undersampling of majority class and upsamping of minority class.
@sushmithajanapati7785
@sushmithajanapati7785 2 жыл бұрын
Does Smote algorithm support Multi output classification?
@DataMites
@DataMites 2 жыл бұрын
Yes, you can use SMOTE.
@sandeshbapu1567
@sandeshbapu1567 4 жыл бұрын
Nicely explained
@DataMites
@DataMites 3 жыл бұрын
Thank you so much 🙂
@JainmiahSk
@JainmiahSk 4 жыл бұрын
you haven't encoded the target variable?
@DataMites
@DataMites 4 жыл бұрын
Target variable needn't require encoding
@lavanyanayak8707
@lavanyanayak8707 3 жыл бұрын
Thank you very much for this video. I have a precipitation dataset containing 4 columns and 8000 rows, each of them has a lot of zeros and only a few continuous values. I would like to know if I can use smote in this case?
@DataMites
@DataMites 3 жыл бұрын
Hi Lavanya Nayak , Github link is provided in the description. please check it out.
@chinedumjoseph9875
@chinedumjoseph9875 3 жыл бұрын
Oh! I got it. Don't worry. Thanks
@DataMites
@DataMites 3 жыл бұрын
You're welcome
@inspiritlashi9994
@inspiritlashi9994 3 жыл бұрын
Hi, can I know how did you correct it? i got the same error message
@rukaiyaa191
@rukaiyaa191 2 жыл бұрын
which module is used for alternative module of imblearn in python sir(for handling imbalance dataset)
@DataMites
@DataMites 2 жыл бұрын
For balancing the dataset we have only imblearn module. But there are other ways to deal with the imbalanced dataset.
@abhimynampati2929
@abhimynampati2929 2 жыл бұрын
Hey Ashok, can u make a video on dsste algorithm for removing class imbalance?
@DataMites
@DataMites 2 жыл бұрын
Will do in future session.
@abhimynampati2929
@abhimynampati2929 2 жыл бұрын
@@DataMites awesome! Will be waiting.
@zakariaabderrahmanesadelao3048
@zakariaabderrahmanesadelao3048 4 жыл бұрын
what a crystal clear explanation. thank you.
@DataMites
@DataMites 3 жыл бұрын
You're very welcome!
@jongcheulkim7284
@jongcheulkim7284 2 жыл бұрын
Thank you so much. ^^
@DataMites
@DataMites 2 жыл бұрын
You're welcome 😊
@insidiousmaximus
@insidiousmaximus 3 жыл бұрын
great video thank you. I am trying to figure out how to use this with a generator flowing from directory?
@DataMites
@DataMites 3 жыл бұрын
"Hi insidiousmaximus, thanks for reaching us with your query. Can you please put your query more precisely so that we can help you?"
@OriginalBernieBro
@OriginalBernieBro 4 жыл бұрын
Running into a problem with sklearn 'support' column still looking unbalanced after smoting on print(classification_report(y_test, y_pred)) what gives?
@DataMites
@DataMites 3 жыл бұрын
The support is the number of samples of the true response that lie in that class.
@ShubhamKumar-id6pf
@ShubhamKumar-id6pf 4 жыл бұрын
SIr, I went on as per the recommended procedures but my jupyter environment giving an AttributeError that SMOTE object has no attribute '_validate_data'. Can you please help me with the.
@DataMites
@DataMites 3 жыл бұрын
You need to upgrade scikit-learn to version 0.23.1.
@oumaimasouid5229
@oumaimasouid5229 3 жыл бұрын
i find this error >> plz help !
@DataMites
@DataMites 3 жыл бұрын
Hi, please use fit_resample
@snehasamadder3790
@snehasamadder3790 2 жыл бұрын
after I resample an imbalance dataset how can I download the resampled dataset from colab?
@DataMites
@DataMites 2 жыл бұрын
Combine the resampled x and y and create a new dataframe, then convert that dataframe to a csv file using to_csv()
@wajeehanaz9115
@wajeehanaz9115 2 жыл бұрын
Hello Sir! can you please tell me how to generate images using smote technique ??? Thanks in advance...
@DataMites
@DataMites 2 жыл бұрын
For image generation we have a different method called Data Augmentation it will newly create synthetic data from existing data.
@kunalgoyal8529
@kunalgoyal8529 4 жыл бұрын
While dividing training and test data shouldn't you be doing "stratify=y" ? To ensure test data and training data set have equal proportion of outcome variable?
@mr.techwhiz4407
@mr.techwhiz4407 4 жыл бұрын
that would be undersampling
@DataMites
@DataMites 3 жыл бұрын
The aim of machine learning model is to generalization on training set so that performance on unseen Data is good.We don't care what the test data consist instead we try to given more generalized pattern to the algorithms.
@wenshanpan8726
@wenshanpan8726 3 жыл бұрын
Excellent!
@DataMites
@DataMites 3 жыл бұрын
Thank You!
@inspiritlashi9994
@inspiritlashi9994 3 жыл бұрын
Sir, Can I know how to run a logistic regression on the oversampled dataset?
@DataMites
@DataMites 3 жыл бұрын
Hi Inspirit Lashi, you can use SMOGN for preprocessing of your dataset. More more information: proceedings.mlr.press/v74/branco17a/branco17a.pdf
@hendripriyambowo1427
@hendripriyambowo1427 4 жыл бұрын
hi sir i have question how did we implement those resampling technique in neural network, let say if we implement embedding layer and work with multiple kind of data is that resampling technique make our data losing such information?
@DataMites
@DataMites 3 жыл бұрын
You can use mini-batch SGD optimizer to handle imbalance dataset.
@dkandasamypandian719
@dkandasamypandian719 3 жыл бұрын
Good
@DataMites
@DataMites 3 жыл бұрын
Thank You!
@sunnyarora4916
@sunnyarora4916 3 жыл бұрын
Any video where we use SMOTE for regression??
@DataMites
@DataMites 3 жыл бұрын
Hi Sunny Arora, you can use SMOGN for it. More more information: proceedings.mlr.press/v74/branco17a/branco17a.pdf
@sunnyarora4916
@sunnyarora4916 3 жыл бұрын
@@DataMites Thank you, is it less likely to use SMOGN?
@aiswaryalakshmi1349
@aiswaryalakshmi1349 Жыл бұрын
Cannot install imblearn. Kindly help me with this
@DataMites
@DataMites Жыл бұрын
Once you install imblearn, restart the kernel. If it doesn't work try any of these codes: "!pip install delayed" or "pip install --user imblearn"
@anaghadamame196
@anaghadamame196 3 жыл бұрын
Thank you sir...👍
@anaghadamame196
@anaghadamame196 3 жыл бұрын
Can you explain which algorithm should be selected for regression problem....it will help me alot
@DataMites
@DataMites 3 жыл бұрын
All the best
@vivekuk4329
@vivekuk4329 3 жыл бұрын
hi sir need to join in ur classes how to approach you
@DataMites
@DataMites 3 жыл бұрын
Hi Vivek uk , please share your email id and contact number. Our educational counselor will share the details. You can contact our counselor directly at 18003133434. For more info datamites.com/
@chinedumjoseph9875
@chinedumjoseph9875 3 жыл бұрын
Thank you for this nice explanation. I was making progress with the codes but when I tried to fit using the command X_train_smote, y_train_smote = smote.fit_sample(X_train.astype('float'),y_train), I got error saying AttributeError: 'SMOTE' object has no attribute 'fit_sample'. I need urgent help please. Thank you
@DataMites
@DataMites 3 жыл бұрын
Hi Chinedum Joseph, can you please list the version of python and scikit learn in your system?
@ObaidoGeorge
@ObaidoGeorge 2 жыл бұрын
Use smote.fit_resample instead of smote.fit_sample.
@AbdulLatif-fu9jz
@AbdulLatif-fu9jz Жыл бұрын
@@ObaidoGeorge Tqvm for your help
@Adinasa2
@Adinasa2 Жыл бұрын
AttributeError: 'SMOTE' object has no attribute 'fit_sample'
@DataMites
@DataMites Жыл бұрын
Use smote.fit_resample
@patrickbormann8103
@patrickbormann8103 4 жыл бұрын
Amazing!
@DataMites
@DataMites 3 жыл бұрын
Thanks!
@terryterry3733
@terryterry3733 3 жыл бұрын
Hi sir what is the data type for outcome ? i think it is in object . Did u convert that into float or int?
@DataMites
@DataMites 3 жыл бұрын
"Hi Terry, thanks for reaching to us regarding your queries. Outcome datatype is in the string and we label encoded it to an integer."
@shivki23
@shivki23 4 жыл бұрын
subscribed for ur content
@DataMites
@DataMites 3 жыл бұрын
Thank you
@patelajay1010
@patelajay1010 3 жыл бұрын
I have one doubt. What if data contains Nan values and you want to do under_sampling? If you impute Nan values with Mean() then there will be information leakage because we impute data before splitting it into train and test dataset. Could you please tell me what should be the possible solution in this case?
@DataMites
@DataMites 3 жыл бұрын
Hi Ajay Patel, if you have a large dataset, you can certainly drop the Nan Values
@patelajay1010
@patelajay1010 3 жыл бұрын
@@DataMites Sir I have continuous data coming from sensors. Dropping few rows will lead to break a pattern.
@DataMites
@DataMites 3 жыл бұрын
@@patelajay1010 In that case without knowing the source and significance of your nan value, we cannot comment on anything.
@patelajay1010
@patelajay1010 3 жыл бұрын
@@DataMites ok sir. Thank you for your response.
@mohan250s
@mohan250s 2 жыл бұрын
ur awesome
@DataMites
@DataMites 2 жыл бұрын
Thank you.
@sanyajain2127
@sanyajain2127 4 жыл бұрын
Getting an error: ValueError: Unknown label type: 'continuous-multioutput'
@DataMites
@DataMites 3 жыл бұрын
It can due to multiple reasons like in logistic-regression doing classification more than 2 classes. Or due to the use of classifier if the target variable is continuous.
@parthasarathyk5476
@parthasarathyk5476 2 жыл бұрын
Hi, did anyone applied this concept to image dataset. please anyone let me know...
@DataMites
@DataMites 2 жыл бұрын
For image generation you can use method called Data Augmentation it will newly create synthetic data from existing data.
@Adinasa2
@Adinasa2 Жыл бұрын
Pls share the notebook and input file
@DataMites
@DataMites Жыл бұрын
@Aditya Gupta Please Check in Description. Its available there.
ML Was Hard Until I Learned These 5 Secrets!
13:11
Boris Meinardus
Рет қаралды 273 М.
Comfortable 🤣 #comedy #funny
00:34
Micky Makeover
Рет қаралды 16 МЛН
天使救了路飞!#天使#小丑#路飞#家庭
00:35
家庭搞笑日记
Рет қаралды 78 МЛН
Survive 100 Days In Nuclear Bunker, Win $500,000
32:21
MrBeast
Рет қаралды 157 МЛН
10 European Cities Destroyed by Overtourism
13:10
Amazing Europe
Рет қаралды 43 М.
UK’s 100 Year Economic Decline - No 1 to Failed State
13:14
Economics Help UK
Рет қаралды 3,1 М.
Why Does Diffusion Work Better than Auto-Regression?
20:18
Algorithmic Simplicity
Рет қаралды 280 М.
XGBOOST in Python (Hyper parameter tuning)
31:11
DataMites
Рет қаралды 56 М.
Comfortable 🤣 #comedy #funny
00:34
Micky Makeover
Рет қаралды 16 МЛН