Basic Guide to Pandas! Tricks, Shortcuts, Must Know Commands! Python for Beginners

Рет қаралды 164,215

Күн бұрын

🛑 Quick Correction to DATA MANIPULATION 🛑
data["bmi"] = data["weight"]/(data["height"]**2)
No need for a "for" loop! it's slower and wastes resources - while the above example is perfect!
Hi everyone! Today we will talk about all the useful things we can do with Pandas! 🐼🐼🐼
Pandas is a Python library that's all about data structures and tables. In this video we will cover its important methods as well as all the tricks and shortcuts to get you to pro level within 20 minutes! 💪🤩
If you're curious about my IDE - I'm using Wayscript which is now available for the wide public! you no longer need an invitation, you can simply sign up with the following link: app.wayscript.com
⭐ Clone Complete Lesson Code: ⭐
app.wayscript.com/lairs/61300...
⭐ Wayscript X QuickStart Guide ⭐
wsxdocs.wayscript.com/quickstart
⏰ TIME STAMPS ⏰
**********************************
00:00 - intro
00:24 - install and import Pandas
00:38 - create a Data Frame
02:00 - add column name
02:37 - add new columns
03:52 - select column in Data Frame
04:17 - select value in Data Frame
04:37 - select row in Data Frame
05:30 - manipulate data
07:30 - save Data Frame to csv file
07:58 - comma delimited vs tab delimited
08:49 - save Data Frame to text file
09:11 - load Data Frame from file
10:33 - load SQL database to Data Frame
11:57 - head and tail methods
12:53 - filter data entries
14:00 - replace data entries
14:48 - remove columns
16:20 - add new rows to Data Frame
18:00 - remove duplicates
20:33 - thanks for watching!
**********************************
💻 IMPORTANT VIDEOS 💻
**********************************
⭐ Make SQLite Database of GTA games:
• SQLite Backend for Beg...
⭐ Pandas Read HTML Web Scraping Method:
• Much Better Web Scrapi...
⭐ Make graphs with Pandas:
• Professional Pandas Li...
🙏 THANK YOU 🙏
**********************************
Thank you so much for watching! 😀
Thank you to Zapsplat for the "swoosh" sound effect: zapsplat.com
Thank you to Flaticon for the thumbnail icon: www.flaticon.com

Пікірлер: 271

@phsopher 2 жыл бұрын

Python for-loops are very slow so you should avoid them whenever possible. Luckily pandas supports doing math directly on columns. So to add the BMI column you just need data['bmi'] = data['height']/data['weight']**2 For example, for a dataframe with 300000 rows this is over 1000 times faster on my machine than the video's method.

@aohov3248 2 жыл бұрын

Thank you

@user-bf5zq8bq1k 2 жыл бұрын

or data['bmi'] = data.weight.div(data.height.pow(2))

@PythonSimplified 2 жыл бұрын

You're absolutely right Phsopher!! 😀 I totally messed up on this one! it's not just about speed - but also resources! aaaand 5 lines of code that you just reduced into one! 😊 Thank you so much for your comment and for letting me know - I will film a quick correction tutorial shortly, my apologies for not catching that! (it's funny how I'm instructing folks to avoid for loops in "drop_duplicates()" but encouraging them in data manipulation... 🙃 I can't even use the "brain fart" excuse because of that hahahahaha 🤣🤣🤣) Sorry once again - I'll make sure everybody knows there's a MUCH better way! 😉

@phsopher 2 жыл бұрын

@@PythonSimplified No worries :) Thanks for great content!

@SolidBuildersInc 2 жыл бұрын

@@PythonSimplified I wish there was a Code Jam platform that is constantly offering the Best Pythonic Way to do something in real time, where somebody catches the flow of code while in production so it consumes less Brain resources, just like a computer, lol. Any ideas ? Do you know of any camps that nuture Best practices other than the typical ? I would enjoy more live interaction on the code.

@bhagavathyr8540 2 жыл бұрын

Thank you Mariya. Your tutorials are really simplified and awesome!!!

@iansjackson 2 жыл бұрын

Just adding my own appreciation for a well architected video, and well done too for taking on the suggestion of others for improving the code.❤

@Zenoandturtle 9 ай бұрын

This is the tutorial I was after for some time. Thanks a million. Fantastic presentation (as always)

@nodrogguod Жыл бұрын

Love your videos. Well presented and clear. Thanks for taking the time to make this.

@evamakri9694 11 ай бұрын

Your for loop really helped me with some things that I couldn't do with standard pandas calculations! Thanks! Great video!

@charliefulton7304 2 жыл бұрын

This is such a great video thank you. I have been getting up to speed on pandas the past few days and this is one of the best I've seen. Thank you!

@PythonSimplified 2 жыл бұрын

Thank you so much Charlie! 😀 I have one correction to the code I presented in this tutorial, it should have been: data["bmi"] = data["weight"]/(data["height"]**2) This saves typing, doesn't waste resources and runs much faster! (especially when dealing with enormous amounts of data)

@CurrentElectrical 2 жыл бұрын

Love the pandas tutorials! Thank you from bitterly cold Ontario, I hope you're keeping warm.

@johnkelty4001 Жыл бұрын

Great video, thanks... fun examples and attitude made it quite interesting throughout in a way that many tech tutorials are not, and paced at what I thought was exactly the right speed..

@Hxxligan 9 ай бұрын

I love ur videos. They're well structured with great explanations and are very engaging.

@jakeambrose4294 Жыл бұрын

Excellent! Clear, efficient, simple and well explained and demonstrated.

@ExcelTutorials1 2 жыл бұрын

This is a great video! I use excel a lot, but I am trying to use Python more so I can work with larger sets of data :) Thanks for the great tutorial!

@joudfamily7531 2 жыл бұрын

Thank you for all the details in this video. Jumping to the previous video and codes (GTA stuff) was confusing, but "pandas" material was awesome!

@charlescollins9119 2 жыл бұрын

I hope everyone appreciates the amount of time and effort you put into your videos! I know I do! Thank you very much.

@sudhakarank2474 2 жыл бұрын

Really cool tricks Mariya. Especially the bot removing trick for code-jam, that really got me... Great work...

@federicobravin2052 2 жыл бұрын

Nice video. This is the kind of guide that is handy in almost every situation with pandas. I've learned new tricks. Thanks you.

@manometer7854 2 жыл бұрын

Great video presented with so much joy! Thanks a million!

@solomononuchefaruna5022 7 ай бұрын

I am already in love with you. 😂😂😂😂 You are an incredible and amazing teacher. The smile on your face and your sense of humor makes me want to learn more. I want to be your friend.

@devnull711 2 жыл бұрын

I am an experienced developer and Big Data practitioner and this kind of simple introduction is just what I needed to accelerate into Python/Pandas. It also helps that the host is very pretty :)

@josrey 2 жыл бұрын

In fact I was working in a project last night, automating an excel file that contains supply levels for Xerox printers, and reading about pandas, great video

@JoseLuis-zx2lp 2 жыл бұрын

And there you go, this is how a magnificent video is made. Thanks for so much all tricks.

@amoorinet.. 9 ай бұрын

I'm new to programming, but I can swear the way of this explains it works for me perfectly.

@user-iv9zu4oh8i 5 ай бұрын

I'm new in Python, but with your video I got it so fast and clear.....Thank you so much. Keep the great work on!

@viniciusalves-zn9lj 2 жыл бұрын

Muito obrigado, sigo sempre seu canal, cada vez mais conteúdos interessantes e úteis no dia a dia, Your Channel is the best congrats for your hard work, thanks from Brazil

@ronaltonho3322 2 жыл бұрын

Great tutorial I like the sound made by your keyboard when u were typing. It sound great too.

@lucian1511 2 жыл бұрын

Thank you! Very nice video, and since I got to see this video I also checked your channel.... I subscribed Keep up the good work! :)

@kennethstephani692 Жыл бұрын

Great video, Mariya. Keep up the great work!!

@kycdoe Жыл бұрын

Thank you. Good pace and really friendly 👌

@witness1013 2 жыл бұрын

Wow! I have no idea what Pythons is, or why I'd want to use it, but I'm going to learn now!!!!

@H-yi6jf Жыл бұрын

Hi Mariya, This video helped me with creating a budgeting app for an assignment in a programming course. Pandas was used in my app for outputting tables of expense data. Thank you for posting videos. - Henry

@CitizenCS Жыл бұрын

2 minutes into the video I realize we think alike when problem solving. Look forward to exploring your content!

@JorgeEscobarMX 2 жыл бұрын

You sold me on learning pandas. Looks like a great alternative to ETL tools like informatica. I'll learn it well.

@kecoma 2 жыл бұрын

I didn't know that you can do querys in a database with pandas! Super-mega-ultra-useful jajaja Gracias jefa

@Sstratos94 10 ай бұрын

Continue the good work. Your help is unique and inspiring :)

@Headlikeanorange84 2 жыл бұрын

Very well explained; especially for a beginner like me!

@KonradTamas 11 ай бұрын

"There you go", another great tutorial ! Thx!

@joshuaarmando7765 9 ай бұрын

Wow you are a hero, you saved my project. Thank you so much!

@fredoh2768 Жыл бұрын

Nice video. I am new to Pandas and this video has thought me a lot. Thanks!

@petelogiudice8202 2 жыл бұрын

Binge watching your channel today getting solutions for my TODO list on my current project. (Refactor and Mobile version of my Clownfish Genetics Calculator) Now, I'll be able to refactor my results phenotype data with Pandas. It's current a nasty spaghetti if statement...uggh! Thoroughly enjoying your channel and learning a lot (more kivyMD and adb)!

@hand-eye4517 2 жыл бұрын

Thank you , for all the useful and informative content.

@PythonSimplified 2 жыл бұрын

Thank you so much for your lovely comment! 😃

@ZarabyZara 2 жыл бұрын

You are amazing!! thank you so much,really appreciate your help

@metaphyzxx 11 ай бұрын

How am I just discovering you?! This is glorious!

@user-vd1km3dw2w 2 жыл бұрын

Mariya, I I really thank you for your tutorials!

@phil5293 Жыл бұрын

Amazing tutorial as usual. Thanks again Mariya

@lopher70 2 жыл бұрын

You have a gift for explain, thank you, I would love to know about pandas and data analytics

@axelgonzalez5165 2 жыл бұрын

I like so much your explanation. Thank you for the information :D.

@PythonSimplified 2 жыл бұрын

Thank you so much for the lovely comment Axel! 😃

@jeffegg2 8 ай бұрын

just what i was looking for!!!

@blackcloudgeeks6439 Жыл бұрын

Your content is amazing. I really enjoy your channel.

@soultribe9 2 жыл бұрын

There you go M !! always amazing !!!

@AbdulREHMAN-co2kd Жыл бұрын

u teach super good keep uploading data science videos in your plaYLIST I LOVE IT

@cag6825 2 жыл бұрын

Love the Stich pullover!

@kadel2322 Жыл бұрын

You are so great!!!! Please do another tutorial, for pyspark this time. 😊

@Dev-Phantom 2 жыл бұрын

very insight full .....i love this

@py_aytopuebla7996 2 жыл бұрын

you are the best!!! , great job. Thank you.

@Secopsgeek_code 2 ай бұрын

This is dope am digging these pandas 🐼

@davidpimental6704 Жыл бұрын

Mariya, have you looked into the Polars library for Python? It's supposed to be much faster than Pandas? It might be helpful to do a comparison video on Pandas vs Polars - strengths and weaknesses. What do you think?

@jameelabduljalil25 2 жыл бұрын

Awesome!! I liked this video and the girl as well. She speaks and move hands as my MSc supervisor.

@bubelerasmeni1846 2 жыл бұрын

Well explained 👌🏿. What do you use to make your videos?

@whatwherethere Жыл бұрын

Great video. Makes me appreciate R so much more.

@Asgallu 2 жыл бұрын

Great video. Congrats for your channel

@mitaly_Onlineshop 7 ай бұрын

Thank you so much for caring and teaching python which is so sweet , you are so professional and affable.I'm following your youtube channel and telling my friends to follow you, Good Luck :)

@AaronMT Жыл бұрын

This was a helpful tutorial, thanks.

@kimuyu 2 жыл бұрын

You are a very gifted teacher Mariya.

@djladieslove1 Жыл бұрын

You're the best mentor of all time 🎉

@daylon907 Жыл бұрын

Great! Thank you!

@Conceptcenter-ut4yi Ай бұрын

Thank you mariya for your lecture it was really helpful

@juany4355 2 жыл бұрын

What a great explanation!!! Thxxx!

@PythonSimplified 2 жыл бұрын

Thank you so much Juan! 😊

@adventuresoftext Жыл бұрын

Trying to think of a use case with pandas for my Open World Text Adventure lol. Not sure if I'd benefit from it or not since I don't need to know what data exists and where, nor do I need to see it printed out (it's printed but in a more user-friendly way). But I still enjoyed watching this tutorial and will try some things out in the future! Right now I just use for loops to detect what the game is asking for in the player inventory either by selection (viewing the inventory and highlighting the item with the arrow keys) or by action (like trying to mine for Iron, we know we need a pickaxe so a for loop will check for one equipped). I want to see if pandas has anything interesting I can do with my inventory dictionaries, but like I said I have no need to know what is where or how many the player has, it is just handled with my functions and for loops.

@kevcritc 2 жыл бұрын

I wouldn’t have bothered with the for loop for the bmi you can calculate the bmi by using: data[“BMI”]=data[“weight”]/data[“height]**2 Great overview though, enjoy all the videos.

@mohamedelsoul501 2 жыл бұрын

Go on Mariya you are the best!!

@luismarrero9293 2 жыл бұрын

hello belle, thanks for all good information you shared with us. I am a new python learner and i would like to know how or the best way to extract data from a pdf file that has inside date, numbers and letters. i would like to see how we can sort them and delete what we don't need. if it is possible . thanks

@CaribouDataScience Жыл бұрын

Thanks , there is a lot of good information in this video!!

@PythonSimplified Жыл бұрын

Thank you so much! I'm glad you found it useful! 😀😀😀

@anabelberumen Жыл бұрын

I love you so much, I like a lot you're humor and you're sarcasms jajajaj

@elastvd7503 2 жыл бұрын

Brilliant, thank you

@robertbaszczyk3068 2 жыл бұрын

Great stuff. One question though: what is faster: filtering data from db with pandas/python of just sql command select XXX where xxxx ?

@gmozx Жыл бұрын

Great tutorial!

@semtex2987 2 жыл бұрын

adding rows also can be done via pd.Series and passing a list

@rafaelrojoperez1176 2 жыл бұрын

Muy buenos ejemplos como siempre 👏

@PythonSimplified 2 жыл бұрын

Muchas gracias mi amigo!! 😀

@kobourou Ай бұрын

You are a great teacher.

@k.ballajiaxe6403 2 жыл бұрын

thanks it's very useful for us :) love you

@PythonSimplified 2 жыл бұрын

Thank you so much!! super happy to hear! 😁

@mcrkira1 2 жыл бұрын

Muy buen video. Muchas gracias

@zedzpan Ай бұрын

Your content is gold.

@kushanmadusankha5227 Жыл бұрын

Thanx and highly appreciate ❤ Create more content about ML and DL

@user-xj4wj9zb7k Жыл бұрын

Thia was really helpful. I just joined an advanced deep learning course. But I found out i was missing some background.

@Super_VooDo0 Жыл бұрын

Super well explained video

@taschfogster223 2 жыл бұрын

Your Stitch t-shirt is awesome! :D

@munivoltarc 10 ай бұрын

ur amazing always , can u do any video on stock market data manipulation using pandas and numpy ?

@newsjuice7404 2 жыл бұрын

The queen is back

@rickeyestes Жыл бұрын

Keep it up! 👍❤️

@rashidhajiyev2089 2 жыл бұрын

Great video with details. I would suggest you to make the same kind of videos about Numpy, matplotlib and other visualisation libraries. Also SQL)

@PythonSimplified 2 жыл бұрын

Thank you so much Rashid! Will do! both Numpy and Matplotlib are definitley on my list! 😉

@philipberthiaume2314 2 жыл бұрын

I learned a couple of tricks, that's good. I believe the documentation does not recommend iteration on data frames. You're better off to use the apply, map etc functions which I use regularly. They're quick and efficient compared to iteration, especially if you're dealing with million plus lines of data.

@PythonSimplified 2 жыл бұрын

You're absolutely right Philip! 😀 The method I've shown is not only taking up waaay too many lines of code - but its also time costly and wastes lots of resources! It should have been: data["bmi"] = data["weight"]/(data["height"]**2) instead of the unnecessary for loop, the appending and all that jazz 😟 My apologies on the mess-up, I will film a short correction video very soon! And thank you so much for your comment! I really appreciate you letting me know! 😊

@bonilaz 2 жыл бұрын

Hello Mariya, I'm regularly following your videos, it's very informative and understandable. Could you please make a video on MongoDB. I would like to hear from you. Thanks in Advance

@freezoulou 2 жыл бұрын

now i love pandas :)

@oluwadunsinoladipo2956 2 жыл бұрын

Thank you so much

@vincentAhi 2 жыл бұрын

Hey, this is amazing. Also, what IDE is that ?

@naigsoft 2 жыл бұрын

Hola, great job!.. thank you. I recommend learn typing (mechanography). Bye!

@esauchinkalata976 Жыл бұрын

Well done 👌

@humamchoudhary6272 2 жыл бұрын

A quick tip for the face cam video problems ... record both on seprately . record the screen as you do and record your facecam with a seprate camera or use a seprate recorder for the facecma