First of all thanks to you, I learned ffill, bfill and interpolate functions from here. But it's recommended from many professionals that missing values should be imputed with mean, median & mode.

the chill moment when he codes and sips up coffee, cool man great work !!!

This guy is chill af

Bro, you are Doing such great work.. The way you are explaining things is excellent and easy to understand. Kudos to you .

Could you make a tutorial on Big Data as well, for situations with e.g. 500k rows and 200 columns where you don't see all of your data and don't know what kinds of Nan values to expect and therefore can't name them textually? Big thanks in advance :)

I just started watching but I see that you are really good man, thanks

You said everything but but missed the one I am waiting for is filling NaN with mean or media values.

Explain the more concepts like standardizing, matching, consolidation so we get all idea about data cleaning.

This is amazing. I learned a lot. I want to come to India to study Data Analytics

Great tutorial! No need to hesitate on referring to the code snippets btw… I don’t think any sane person watching this has the expectation for you to memorise a to z what you want to articulate…

Thanks Mr. Shah--- I used these commands to prepare a cheat sheet for data cleaning--- regards

thanks for teaching ffill, bfill, interpolate and fillna ...it was a great session

Take the ads off please, thanks, great tutorial by the way.

Learnt something new, THANK YOU!

Nice way of explaining. One request, do make one video on Outlier removal. Thanks.

This video has really me understand the data cleaning process. Thanks Man.

awesome ,good and precise data cleaning please load some more stuff related to pandas

Thanks a lot bro. The way you explained the steps are really helpful.

Can u tell about yourself... The company u are working and can u give some tips to get a job in data science field as a fresher

hats off to you man, you really made my day, you gave me a good confidence today, once again thankyou so much sir

Please explain to fiilna or replace zero with mean value by groupby... Means you have 3 groups in data frame and you want to fillna with respective to group mean

Very useful video keep it up champ

essentially you explained it very well

Great job well done n thanx a lot ...I explained v well

I got lost at the very beginning, from the "print(os.listdir())" what i got as my output is very different from what you got

This video really helped me a lot, but I still got more to understand. I've zero basic knowledge on this. I'm working on a thesis which needs some coding to complete. I've few questions to what you've explained in this video; 1. What if there are lot of dataset and how do you define the missing value for each? 2. What was that in the missing value you defined "np.nan" ? As I said earlier, I'm working on a project which is about human-in-the-loop code. Initially I'll be given the dataset and have to figure out a code to include human for feedback from system (Reinforcement Learning). I would like get your response, and if possible any helpful idea or suggestions on the project mentioned above. Thank you

Great job sir . Thank you so much for great explaining . Can u make more videos on data analytics

Thank you so much. This was really helpful

BRO YOU SHOULD HAVE UPLOADED CSV FILE AS WELL.

Hi,very nice explanation. I am totally new to python. Can you pls make a tutorial on how to install jupyter and all the other required libraries to perform forecasting.

Thanks Soumil, really helpful !!

Great video very helpful

Good and nice explaination

Good job

Superb broo Rock on

Hi...I have na values but tha boxplot is even not showing it null...

Thank you sir. I'm very satisfied

I have a csv file and when i am using concat function it automatically name unnamed group 1,2,3... Also the alignment gets messy with songle line of code How to fix it

Nice tutorial keep it up

Thank you for making this video.

This is a great video😊

Thank you for thr explanation!

How to do interpolation for categorical variable

please donot stop uploading such videos

Would you be able to provide mentorship. I have started learning DS . Want to keep moving in a direction .jyst don't stop due to coding lag.

thankyou very much soumilshah, its help for me

Thank you sir helped me a lot

Sir, please tell me the book from where I can learn all these concepts and programming skills required for this.

So please which do you think is more efficient to be used without changing the accuracy of the data

what is the use of ffill? Isn't it data corruption? filling nulls with values from above rows

overall good tutorial, the only thing that is missing is source code (jupyter notebook)

So helpful 👌

really great

Very helpful

Loved it man

how to handle zero values in csv file and how to fill those values

What if the file is not there on which we want to work?

How to get how many type different type of value is there to put in na_values? I mean to say the value you have mentioned for missing_value.. how you are getting that.. we cant check the file if that has huge data

Can't we add any value to these NaN?

good job

The dataset which you have is having fewer instances what if we have thousands of rows of data how to find Nan, and Na there in the dataset ...? if you see this please respond ASAP

how to cleaning data that is TZAN dataset from kaggle for,music genre classification using cnn?

i have question i wrote print(os.listdir()). but i got many files that is inside my jupyter. may i know how can i import my csv file that i have clean.

5:09 OP

what to mention in na_values if we dont know the missing vlaues or there are hundreds of different missing values

here values in missing_values list are case-sensitive or case-insensitive?

How to save the dataset after cleaning process in python?

why you have used np.nan in the mission_values?

I refer to using mean but thank you it was helpful

How i can handle float values 2.o or 0.04576 kindly let me i am doing a research using a big datasets

Hii Soumil, right now I'm working on language translation project for that I have collected the data, but I'm facing preprocessing data could you please help me with that.

Pls can you tell me that from where you bought that LAPTOP stand? Pls attach link in comment

i can use excel for it right ? my work will be more easy kindly persuade me y i have to use python instead of excel here

I have to say. "Very Helpful". or print("very helpful") 😂😂

Please make a video outlier treatment and detection

Thanks for this video !

This was really useful. Thankyou!

interpolation is basically like average? right?

Hello can you include in this video in cleaning special characters using pandas regular expression?

well explained .

Hello sir, thank you so much for the tutorial. I'm actually stuck since my source in a CSV file. Except that sadly the file I'm working is extremely complex with indefinete columns since my main columns are repeated everyday based on the date. I've been stuck on this problem since over a week. Is there a way I could reach out to you and have your mail to maybe help solve this problem? Thanks a lot in advance.

I need your help please please...how it work in automatically cleaning data?

how can we replace using mean, median & mode

bro, could you please share the dataset in the description ?

I want to replace 4wd with fwd in particular column please help

AttributeError Traceback (most recent call last) Cell In[7], line 1 ----> 1 pd_cleaned = pd.dropna() AttributeError: module 'pandas' has no attribute 'dropna i can't find drop na

What is noisy data

i want messy dataset for practicing do u know where can i find one? or do u have one ?

Sir, by running the data cleaning code in jupyter notebook by following the same code instruction given by u, when i run the code in the output it is not showing unnamed:0 temperature humidity & in my jupyter system it is showing such as v1 &v2 in the output.Why it is so?can u plz explain.

Thanks a lot ❤️

sir, facing a issue in a code to convert the variable from object to integer in jupyter notebook:- it shows the error:-invalid literal for int() with base 10: '-'

Sir, i'm still new in python and this data cleaning thing. And i want to ask what is 11 in df11 ?? is it some kind of function ?? and i also don't understand the snippet concept

yo thanks a lot

How install Android phone Jupiter notebook

from where i can download this dataset can anyone provide me link

thank you

Brother Great video. I need the tea as well. ;)

Where can I get the data set?

nan palce -1 how to clean that

data.fillna({"P11,":NEGATIVE}) NameError: name 'NEGATIVE' is not defined ?? Please help me ?what can I can do??