Exploratory Data Analysis with Pandas Python

Рет қаралды 444,528

Күн бұрын

In this video about exploratory data analysis with pandas and python, Kaggle grandmaster Rob Mulla will teach you the basics of how to explore data using python and pandas. Exploratory Data Analysis it a necessary tool for any data scientist. Pandas is a MUST for anyone getting into data science with python. Python is the #1 coding language for data science and has been growing over the years as an essential tool, with Pandas being the main data wrangling module. Kaggle Grandmaster Rob goes over it all in this video. In this video we discuss the basics of how to use explore data including...
Timestamps:
00:00 Introduction
01:00 Imports and reading data
03:35 Data Understanding
06:40 Data Preparation
20:57 Feature Understanding
27:35 Feature Relationships
35:30 Asking a Question about the Data
40:00 Final Thoughts
Follow me on twitch for live coding streams: / medallionstallion_
Intro to Pandas video: • A Gentle Introduction ...
Link to kaggle notebook used in the tutorial: www.kaggle.com/robikscube/int...
* KZfaq: / @robmulla
* Twitch: / medallionstallion_
* Twitter: / medalliondata
* Kaggle: www.kaggle.com/robikscube
#Python #Coding #DataScience #Kaggle

Пікірлер: 450

@robmulla 2 жыл бұрын

Chapters don't appear to be working for my videos for some reason. Here are the timestamps for the video: 00:00 Introduction 01:00 Imports and reading data 03:35 Data Understanding 06:40 Data Preparation 20:57 Feature Understanding 27:35 Feature Relationships 35:30 Asking a Question about the Data 40:00 Final Thoughts

@oshogweikekhai5499 Жыл бұрын

amazing video, please can you make available the dataset used? thank you

@Pluvo2for1 Жыл бұрын

Hi Rob. I'm new to notebooks. Could you plese explain why you don't need an explicit print statement to view cell output?

@cocgamingstar6990 9 ай бұрын

This was one of the bad video and non industry knowledge

@ABYHYDROS 8 ай бұрын

😮

@grandselenium296 6 ай бұрын

- import data Data understanding - filter columns by need - convert dtype of certain columns - rename columns - check isna in columns and dropna on row or column accordingly - locate duplicated rows in single or multiple columns - drop duplicated rows from dataset and reset index Data prep -univariate analysis of features - kde, histogram, box plot - use value counts to determine duplicates and unique values in feature - he creates bar plot for top 10 years introduced to highest # of coasters - he creates histogram to bin speeds of roller coaster and view their frequency distribution Feature understanding - scatterplot, pairplot, correlation, groupby - he creates scatterplot for speed and height with year based hue of points - he create pairplot to compare correlation between features, alongside hue from material type - creates a correlation heatmap for selected features Ask question - he uses groupby and query to create bar plot with sorted descending data on mean speed of roller coasters by location.

@saintsaens3517 Жыл бұрын

As a begginer in data this really opend my eyes as to how things works. Your explanations are very clear and I can feel how passionate you are. Great video

@robmulla Жыл бұрын

Glad it was helpful! I am passionate about it, and excited when I hear people are learning from my videos.

@arunkumark6351 Жыл бұрын

So true,, though there are many projects and training videos outside. The way you think, step by step approach and the reason for doing so, is so relatable and feels very natural. Awesome video, Thank you so much

@saptarshidey7672 11 ай бұрын

There are a ton of EDA videos on KZfaq. This is one of the best I have ever come across. You just nailed it, Rob.

@robmulla 11 ай бұрын

Thanks so much!

@nigelkiernan1321 4 ай бұрын

This is a great refresher guide! Very nice coding style and I appreciate you using a simple Kaggle dataset to follow along. Great stuff - thanks!

@romanrodin5669 Жыл бұрын

Great channel! Very helpful for beginners and for those who' re digging deeper and moving forward into DS industry as myself! Thanks Rob!

@silver_soul98 Жыл бұрын

I have tried plenty of tutorials by now. This is the most precise and to-the-point tutorial so far. Well done.

@Aarron-io3pm Жыл бұрын

Hi Rob, this was super useful to me as a tired Excel veteran and python beginner. You explain and demonstrate everything so clearly, thank you

@chrisosomo2856 Жыл бұрын

I can’t get enough of your videos, especially the very hands-on practical approach to learning. Your explanations are clear and easy to follow along with. Please make more of these types of videos. You are definitely makes a change and contributing to the KZfaq knowledge pool. Thank you so much.

@jackgarn8392 Жыл бұрын

This is such an amazing guide! I’m new to data analysis and had limited python exposure and have taught myself most of these things so far by googling or just reading the pandas documentation. Watching someone familiar with the process do it all together was really helpful and gave me a lot of insights as to how I can improve my skills and workflow. Thank you so so much!

@Eysh2009 10 ай бұрын

This video makes me feel glad to be alive. Great explanation, amazingly fast and on point. Thank you!

@lindyhopwithliz 8 ай бұрын

Great video: informative and fun; easy to follow along. Helped me feel motivated to tackle more Python Pandas. Thanks so much!

@adamvoltemar420 4 ай бұрын

This is one of the best content related to Data Analysis and Python/Pandas, I am really glad I found it! Thanks!

@sheshankjoshi Жыл бұрын

This is perfect for my interview tomorrow. I just needed a refresher on how to approach the problem, ask right questions and then come up with exploratory options. Thank You so much for this video

@user-et7zv5rs3q Жыл бұрын

this is absolutely amazing! Follow your video step by step actually make me more confident of my coding!

@itm1996 5 ай бұрын

Hands down one of the best tutorial I ever saw. Basic enough to follow as a newbie but demanding enough to be useful. ❤

@jmmj5018 7 ай бұрын

thank you so much, you have made my EDA analysis easier and faster. :) also, it's easy to digest as I go along with the data you are working. thanks a lot. you are helping a lot of analysts or people who wants to study in data analytics. Great video, keep them coming.

@alikakavand3165 8 ай бұрын

It was fantastic. Every step you took was kind of amazing, specially the last bit where you visualized average coaster speed by location. Thanks.

@jcgdt94 8 ай бұрын

Thank you for sharing this, Rob! This is wonderful content. Keep up the good work. Cheers!

@vietndk5437 2 ай бұрын

I did not practise pandas usually then I almost forgot the syntax or its application. Now I find your video with very clear instructions, it helps me remember better. Thanks alot

@Rantalytics 7 ай бұрын

wow... thank you so much rob. I come from a frontend background but just began a data analytics bachelor at SJSU. I was trying to grasp at a high level what DA might look like as it pertains to conducting an explorative project. This tutorial completely cleared up those questions!

@SearchingforScraps Жыл бұрын

Wow ! this is such a clean run through. You make it look so easy and easy to learn ! Thank you so much. This is giving me the confidence to finally start something on my own.

@darshantawte7435 2 ай бұрын

Lucidly explained. One thing i have learned that in order to be a great Data scientist what matters is your problem solving skills, understanding the business requirements and curiosity to dive deep into data (true to the name data scientist) . There is no need in remembering these codes as long as you know what to look for.

@sa-pt3kf Жыл бұрын

By far one of the most clear and concise ways of teaching in a computer science related field I've come across in a while. I'll be binging all your tutorials for sure!

@robmulla Жыл бұрын

Whoa. I love this feedback. I'll try my best to keep them coming.

@TrendingUpdateCentral Ай бұрын

It's really hard to find good videos on this topic. This was fantastic. Thank you.

@wahabamin6946 Жыл бұрын

Thanks Rob, you’re doing a great job for the data science community. Your videos here and on TikTok is helping me a lot in this journey. Thank you.

@robmulla Жыл бұрын

Love to hear that Wahab! Glad you learned something, and thanks for posting the feedback.

@Thorne2610 2 ай бұрын

I have watched more than 5 times its really eye opener and step by step teaching. Well done Boss

@khushi1385 12 күн бұрын

Amazing, within a short time you taught so many helpful features for meaningful analysis. Really appreciate.

@user-ei9jd7pw4s 5 ай бұрын

Thank you for the video. You have combined all my knowledge into one comprehensible picture.

@9jorge Жыл бұрын

Thanks a lot, you explain concepts like no one, subscribed!

@tomparatube6506 8 ай бұрын

I dabbled in this 4 years ago at EDX. This is a wonderful refresher. Thanks Rob!

@wesleyweel8007 Жыл бұрын

The quality of your content is only surpassed by the ease at which it is to assimilate it, keep up the great content Rob, cheers!

@robmulla Жыл бұрын

Wow. Thanks for the positive feedback!

@yjgg5882 Жыл бұрын

@@robmulla bi L😅

@yjgg5882 Жыл бұрын

🎉😊

@JHornsby89 Жыл бұрын

This is the second one of these I have now watched and coded along with! Genuinely awesome content, so precise and simple to follow. You make daunting tasks (for beginners getting into data) really accessible which is a sign of a great teacher!

@robmulla Жыл бұрын

Comments like this make me really happy that I made this video. So happy it helped you in your coding journey. Did you use the Kaggle notebook when you followed along?

@chrismagee5845 Жыл бұрын

This is the best reference guide. I always find myself rewatching this whenever I'm cleaning a dataset.

@robmulla Жыл бұрын

So glad you find it helpful.

@walterpark8824 Жыл бұрын

well organized, concise, very helpful to get grounded in Pandas. my explorations will continue. Thanks!

@robmulla Жыл бұрын

Glad it helped! Thanks for watching. Share with anyone else you think might also learn from it.

@walterpark8824 Жыл бұрын

Terrific introductory survey that answered so many of my questions, moving from SQL. Looks extremely efficient. Now, to plug into my data! Thanks.

@robmulla Жыл бұрын

Glad you liked it. Sql still has a place but when working with the data for EDA pandas can’t be beat.

@vishwathapa6626 11 ай бұрын

Pair-plot looked absolutely beautiful!

@Anarky35 Жыл бұрын

Great! Thanks a lot for this tuorial, so helpful for me as a beginner!

@rdatta 11 ай бұрын

Excellent work and introduction. Very well done!

@ZeuSonRed 10 ай бұрын

This was the greatest Tutorial I ever had. Thank you. Here I get to cnow about the corelation and some panda functions and ploting. But for Power counting and Corelation between Variables was very pleasend and satisfied my expectations. From Bulgaria Volga Sauvete! Thaank you ! 👑👑👑👑👑👑

@iiN1GH7M4R3ii Жыл бұрын

Great stuff man, thanks so much for this. Youre great at teaching beginners!!!!

@aayaanhasnain5143 Жыл бұрын

Hey Rob, really admired the way you explained complicated topics with ease!! Looking forward to learning from you more :)

@robmulla Жыл бұрын

Thanks so much for that feedback. I really apprecaite it.

@aydanlopresti2879 9 ай бұрын

Clear and applicable to any type of analysis. Thank you

@ricardorockthem3339 7 ай бұрын

Very well explained and quite nice difficulty level! Brilliant!

@TheMonieray 2 ай бұрын

Really loved seeing the pairplot. Will definitely try this out this week

@deneskalnoky7939 7 ай бұрын

This is a really good tutorial. I am new to Python and data analysis, and was completely lost. It was so hard to find a good, reliable source about it. This source just clarifies the basics for beginners so that I can start off with my own project.

@muhammadfadliaktsar7172 Жыл бұрын

Thank you Rob for your explanation, before this it was hard for me to study and my mind just start pressured me of how to do EDA with Python language. And this video just open my mind to study it!

@Jack-bs2mx Жыл бұрын

you are the best teacher ever, I'm not good at English but I try to write down this sentence to show my appreciate to you. Im still waiting for new lesson using pandas for Data Analyst

@Dongnanjie 6 ай бұрын

Definitely amazing. Thank you so much, Rob!

@bradleyfrueh2761 2 жыл бұрын

Thank you so much. I appreciate the work you put into your videos. It shows.

@robmulla 2 жыл бұрын

I really appreciate the feedback! Please share with anyone you think might also learn from it.

@thaanathaana4522 6 ай бұрын

Clear explanation for beginners.. will follow you more for tutorials

@siddhant0701 Жыл бұрын

This was a really nice tutorial, Rob. Had fun coding along, thanks for doing it :)

@robmulla Жыл бұрын

Thanks for watching and providing feedback. Feel free to share with anyone else you think might also learn from it.

@pdrcouto Жыл бұрын

It has been great to refresh some topics and learn new ones. Thanks a lot :)

@robmulla Жыл бұрын

Thanks Pedro. So glad you’ve found these as a good refresher.

@kmvkmv3433 11 ай бұрын

Great stuff - thank you, Rob!

@hardikacharya2664 2 жыл бұрын

Great video. Look forward to your twitch streams!!

@robmulla 2 жыл бұрын

Thanks so much. Hope to see you during one of the twitch streams soon.

@ranahuzaifa147 Жыл бұрын

I was smiling at 39:23 . How easily you answered the question. Thanks for this amazing video tutorial.

@robmulla Жыл бұрын

My pleasure 😊 Glad you liked seeing it all come together at the end.

@sergiopellitero4136 11 ай бұрын

This video is.... PERFECT! Thanks ^^

@shihaosun6861 Жыл бұрын

Thank you very much Rob for this wonderful walkthrough and explanation! Really Appreciate it!!!!

@robmulla Жыл бұрын

Thanks for the feedback! Glad to hear you learned something from it.

@NeerajKumardeaf 6 ай бұрын

Thank you so much. I am happy for your teaching about EDA with data analysis for pandas. I am clearly explaining to you. I can continue my hands-on experience for EDA

@jsplayground241 Жыл бұрын

You are the best coach. Thank you, sir!

@leonrobinson2053 10 ай бұрын

Late to the party but this is really really good. Helps you dig in to the detail (rather than you thinking, how do I do what I'm thinking I need to do). This should be a template to use as it general enough for you to pick it up but specific enough with examples to be used elsewhere

@ilmankhairusidqi9146 8 ай бұрын

Your explanation is easy to understand and also show how the things work, ThankYou please make more videos about EDA in python Rob!!

@chess6802 Жыл бұрын

Perfect stuff what I love about this video is the simplicity and the clearness of the way you talk

@robmulla Жыл бұрын

I appreciate that! Thats how I learn best so it's also how I try to explain things.

@chess6802 Жыл бұрын

@@robmulla your response reflect your both knowldge and wisdom please keep on 💞

@rrestituti Жыл бұрын

#1 Data science youtuber!!! You made easy to understand the basic commands e sintaxes. Thank you a lot, Rob. 😉

@robmulla Жыл бұрын

Tell all your friends. 😆

@lashlarue7924 Жыл бұрын

Agreed, this is the best Python content on the entire internet, hands down. I'm going to be carefully watching these videos over and over for a long time.

@adamsleep3028 8 ай бұрын

I almost never comment, but I had to with this one. the video was amazing. I'll be checking more of your videos.

@fabiolasilva6623 7 ай бұрын

Amazing, Thank you so much, the best tutorial!! :)

@mario1ua 6 ай бұрын

Really cool and looks so easy now, thank you Rob

@guilhermedesanctis Жыл бұрын

Thanks for this lesson. It’s much valuable.

@olusolafatoye9691 2 ай бұрын

Great video. Clear explanation! You just earned a new subscriber

@panneerselvamposangu9929 10 ай бұрын

This is very helpful. Thank you, Rob!

@linux2350 Жыл бұрын

Thank you! that was very informative!

@soumyadrip 2 жыл бұрын

Wow so many things are covered, its a great tutorial for getting started with EDA.

@robmulla 2 жыл бұрын

Thanks @somuSan. Glad you liked the tutorial. It took me waaaaay longer to film than I expected but I'm happy with the result. I hope more people in the future find it helpful.

@naderbazyari2 10 ай бұрын

one of the most awesome videos about data cleaning and analysis ever. Many thanks

@robmulla 10 ай бұрын

Wow, thanks! Glad you learned from it.

@MCMMADDOGXCV 10 ай бұрын

This is GOLD! Thank you

@ShiNguyenchu 5 ай бұрын

very useful tutorial video, 😍 this makes me less scared of learning Python than before thank you for your great work !!

@Al-Ahdal 2 ай бұрын

@Rob Mulla: Excellent video on EDA

@alisonhenley2551 Жыл бұрын

Wow, what an informative fun tutorial. Thanks Rob!

@robmulla Жыл бұрын

Glad you learned from it and I appreciate the comment.

@hotbit7327 Жыл бұрын

Some of your other videos I found too fast paced, like about pandas mistakes, this one here has great content and also fantastic presentation. Thank you.

@robmulla Жыл бұрын

Thanks for the feedback. I’ve been experimenting with different editing styles so it’s nice to hear you prefer slower paced like this video. I’ll keep that in mind in the future.

@AbdullahKhan-dl9lm 7 ай бұрын

Very crisp and concise explanation. Sometimes youtube videos can be better than paid courses.

@edusheffer 10 ай бұрын

I'm impressed! your videos are excellent. Thanks, Rob

@mschuer100 Жыл бұрын

Awesome video! Thanks for putting the time into this. Very helpful

@robmulla Жыл бұрын

Glad it was helpful! Share with a friend!

@mschuer100 Жыл бұрын

@@robmulla I certainly will. Thanks

@xiaoyangshawnhuang1251 10 ай бұрын

it's a super great video, just enjoy the way you explained, it's long video but every part is so useful and informative, thanks a lot for sharing it, well done.

@jikarun 5 ай бұрын

Great Job Rob. I got vast knowledge about pandas from this video

@shoaibahmed5616 5 ай бұрын

I completed my certification in data science but could not figure out where to start. Thanks for such a detailed and easy to understand instructions with very useful commands. It helps a lot. Keep it up

@anishkumaranjan 7 ай бұрын

Just completed it along with coding it all!

@zhaozheng7704 Жыл бұрын

Excellent tutorial and immediately useful. Thank you!

@robmulla Жыл бұрын

Glad it was helpful! Thanks for watching Zhao.

@kapamagicman 3 ай бұрын

Awesome! Love the method chaining

@adarshtiwari7395 Жыл бұрын

I have been grinding through your videos lately in preperation for my data science job and you have been an absolute blessing! Thanks a bunch!!

@robmulla Жыл бұрын

Wonderful! Glad I could help.

@hmx21 Жыл бұрын

Hey Adarsh! Other than this what else are you learning that will help you in the data science job, I'm also preparing for the same but kinda new to data science so any guidance would be appreciated. Cheers!

@adarshtiwari7395 Жыл бұрын

@@hmx21 Hi Hemang. I'm a fresher in data science as well. I started with Python and statistics. Then moved on to EDA followed by Machine Learning algorithms. I then made a few projects on ML. Also tools like SQL, Power BI, Excel are preferred

@hmx21 Жыл бұрын

@@adarshtiwari7395 Hey Adarsh! Thnaks for the reply, I'm done with EDA and made a dashboard using Power BI, and don't know how much machine learning or SQL is required for the role as I've studied SQL in college and know how to work with joins,etc. Any tips or resources you'd like to share would be a great help. Also from where did you learn stats for ds, whenver I try to learn stats online I get overwhelmed with the magnitude of tutorials.

@adarshtiwari7395 Жыл бұрын

@@hmx21 depends on what you're going for. If you are interested in a data analyst position, EDA through Power BI is great but if you want to go done the data scientist or machine learning route you need to be hands on with Python. EDA using python is much more nuanced as compared to visualisation tools like Power BI. SQL is essential in all contexts so it's a must. But whether you should study machine learning depends on your career goal.

@nunolopes3910 Жыл бұрын

This type of videos are amazing to follow, i am starting to use python for data analysis and i could not happier! Your channel is helping me alot, thank you!

@robmulla Жыл бұрын

So happy to hear this. Let me know what you would like to see in future videos.

@nunolopes3910 Жыл бұрын

@@robmulla One question i have is about the safety of using jupyter while working with company data. I am just starting to use jupyter and that is a big question that i'm sure other begginers would like to know to! Can you give your opinion on it? Thanks in advance

@elu1 Жыл бұрын

I enjoyed this very much. Thanks for teaching!

@robmulla Жыл бұрын

You're very welcome! Thanks for watching.

@alasdairmunro1953 Жыл бұрын

Really great video. Clear and well presented. Thank you.

@robmulla Жыл бұрын

Glad you enjoyed it!

@irfanshaikh262 9 ай бұрын

This is really an eye opener stuff for rookies like me. Thank you Rob

@robmulla 9 ай бұрын

Thanks for watching!

@ganesanperumal9931 6 ай бұрын

Late to arrive at this video tutorial; however, better be late than never. It was a very enjoyable video tutorial. Took note of each statement for ready reference. Thank you very much.