Automate with Python - Full Course for Beginners

Рет қаралды 1,460,066

Күн бұрын

Learn how to automate your life with Python! You will learn how to automate boring and repetitive tasks such as creating an Excel report, sending text messages, extracting tables from websites, interacting with websites, and more. You will learn how to use a few different Python libraries to help with automation such as Path, Selenium, XPath, and more.
💻 Source Code & Datasets: github.com/ifrankandrade/auto...
✏️ Course from Frank Andrade. Check out his KZfaq Channel: / frankandrade5
🔗 Automation Cheat Sheet: artificialcorner.com/p/redeem...
🔗 Frank's 11-Hour Automation Course in Python: www.udemy.com/course/automate...
🔗 Frank's Discord Server: / discord
⭐️ Course Contents ⭐️
⌨️ (0:00:00) Intro
⌨️ (0:00:31) Project #1 Table Extraction - Extract Tables from Websites
⌨️ (0:02:53) Table Extraction - Extract CSV Files from Websites
⌨️ (0:09:38) Table Extraction - Extract Tables from PDFs
⌨️ (0:13:06) Project #2 - Web Automation & Web Scraping - HTML Basics - Tags and Elements
⌨️ (0:20:57) Web Automation & Web Scraping - HTML Basics - Tree Structure
⌨️ (0:24:22) Web Automation & Web Scraping - XPath - Syntax, Functions and Operators
⌨️ (0:28:06) Web Automation & Web Scraping - XPath - Test Your XPath
⌨️ (0:33:38) Web Automation & Web Scraping - XPath - Special Characters and Syntax
⌨️ (0:38:17) Automate The News - Installing Selenium and ChromeDriver
⌨️ (0:40:34) Automate The News - Creating The Driver
⌨️ (0:44:46) Automate The News - Finding Elements
⌨️ (1:04:34) Automate The News - Exporting Data to a CSV File
⌨️ (1:12:34) Automate The News - Headless mode
⌨️ (1:18:18) Automate The News - Preparing Script to Be Run Everyday
⌨️ (1:30:17) Automate The News - Convert py to exe
⌨️ (1:37:18) Automate The News - Schedule Python Script with crontab (macOS)
⌨️ (1:42:16) Project #3 - Automate Excel Report - Create a Pivot Table with Python
⌨️ (1:49:42) Automate Excel Report - Add a Bar Chart
⌨️ (2:05:02) Automate Excel Report - Write Excel Formulas with Python
⌨️ (2:19:18) Automate Excel Report - Format Cells
⌨️ (2:23:04) Automate Excel Report - Convert Pivot Table to Excel Report
⌨️ (2:25:32) Automate Excel Report - Generate Excel Reports with One Click (py to exe)
⌨️ (2:33:22) Project #4 - Automate WhatsApp
🎉 Thanks to our Champion and Sponsor supporters:
👾 Raymond Odero
👾 Agustín Kussrow
👾 aldo ferretti
👾 Otis Morgan
👾 DeezMaster
--
Learn to code for free and get a developer job: www.freecodecamp.org
Read hundreds of articles on programming: freecodecamp.org/news

Пікірлер: 331

@juandavidtorovelez5979 Жыл бұрын

Please keep this excellent job up! As someone who loves python and currently learning it, this material is pure diamond!!

@nazimgolaurb618 Жыл бұрын

I want to thank freeCodeCamp and Frank for demonstrating this. I am taking a course and just learning syntax and to be honest it was difficult to hold my attention. But with the first few minutes of watching this video I feel like your way is so much more effective. I'm learning how to do something that is modern and that I can follow right away. Please keep these videos coming!

@shikug6939 Жыл бұрын

Yo this helped so much and I always appreciate the content and when i found the channel and got the energy from you from the previous video, you've been nothing but real and can vouch for the amazing content and how down to earth you are with everything! All the most love, respect, and appreciation

@williamthatsmyname Жыл бұрын

This is way batter than I expected. Kudos.

@narbiraymond8375 Жыл бұрын

This is the best I have seen on python automation. Kudos for the good job

@carloseduardocorreacoimbra4040 Жыл бұрын

Dear Frank Andrade, thanks a lot for sharing the Automation Cheat Sheet. Congrats for this class that is amazing!

@vamshikittu8635 19 күн бұрын

hi i'm a student can you share me the cheetsheet please.

@limwei2634 Жыл бұрын

Thank you!!! Previously when I was learning Python, all the past references were for older version Selenium 3. I was facing difficulty with launching selenium. Now we have a proper guide thank you!

@Educationsupport Күн бұрын

I agree with many comments that say this is not for beginners. Beginner implies someone with no experience could do it. Its not a full beginner course.

@ccy920 Жыл бұрын

OMG!!!! This is the course that I have always hoping for.😆 Thank you for the whole tutorial 🫡

@nikhilanandpandit8644 Жыл бұрын

⌨️ (0:00:00) Intro ⌨️ (0:00:31) Project #1 Table Extraction - Extract Tables from Websites ⌨️ (0:02:53) Table Extraction - Extract CSV Files from Websites ⌨️ (0:09:38) Table Extraction - Extract Tables from PDFs ⌨️ (0:13:06) Project #2 - Web Automation & Web Scraping - HTML Basics - Tags and Elements ⌨️ (0:20:57) Web Automation & Web Scraping - HTML Basics - Tree Structure ⌨️ (0:24:22) Web Automation & Web Scraping - XPath - Syntax, Functions and Operators ⌨️ (0:28:06) Web Automation & Web Scraping - XPath - Test Your XPath ⌨️ (0:33:38) Web Automation & Web Scraping - XPath - Special Characters and Syntax ⌨️ (0:38:17) Automate The News - Installing Selenium and ChromeDriver ⌨️ (0:40:34) Automate The News - Creating The Driver ⌨️ (0:44:46) Automate The News - Finding Elements ⌨️ (1:04:34) Automate The News - Exporting Data to a CSV File ⌨️ (1:12:34) Automate The News - Headless mode ⌨️ (1:18:18) Automate The News - Preparing Script to Be Run Everyday ⌨️ (1:30:17) Automate The News - Convert py to exe ⌨️ (1:37:18) Automate The News - Schedule Python Script with crontab (masOS) ⌨️ (1:42:16) Project #3 - Automate Excel Report - Create a Pivot Table with Python ⌨️ (1:49:42) Automate Excel Report - Add a Barchart ⌨️ (2:05:02) Automate Excel Report - Write Excel Formulas with Python ⌨️ (2:19:18) Automate Excel Report - Format Cells ⌨️ (2:23:04) Automate Excel Report - Convert Pivot Table to Excel Report ⌨️ (2:25:32) Automate Excel Report - Generate Excel Reports with One Click (py to exe) ⌨️ (2:33:22) Project #4 - Automate WhatsApp

@sanathkumarshenoy9955 Жыл бұрын

Thanks mate

@sleepstorm1192 Жыл бұрын

Thanks

@hassaan_bm Жыл бұрын

Thank you..

@josephlee6865 Жыл бұрын

Hey, is this something that you typed out manually or is it something you were able to use code to get?

@bringbackdislikes3195 7 ай бұрын

@@josephlee6865 He copy pasted it from the description...

@d.weltenbummler1535 Жыл бұрын

Well done, I could binge it. Easy to use framework, perfect explained. I feel like I can replicate it without knowing anything about python code before. Automate loops like Dr. Frankenstein and call it Cleon 1.0

@gautammenariya8292 Жыл бұрын

yet another great tutorial, love this

@arturocdb Жыл бұрын

Great explanation, thank so much!

@CaptainJuiccy Жыл бұрын

This is actually insane, thank you!!!

@endermaster08 Жыл бұрын

Perfect timing, Im gonna listen to this like a podcast

@tofuboy9269 Жыл бұрын

Awesome, this channel is one of the best learning sources on the internet.

@maxcohen13 Жыл бұрын

FYI: unless using JUPYTER, you'll need to print out the tables. Typing _len(simpsons)_ on it's own won't produce any results. Instead, type _print(simpsons)._

@hasanmougharbel8030 Жыл бұрын

God bless your great efforts in this channel. I have a simple question to ask as a newbie sql learner. Could i manage to channel or extract all sql data generated from an accounting program (based on sql) to our new sql server. The reason that we are bounded with the graphical interface of this accounting software as we cant come up with any solutions regarding analytics and automation, unless we can tailor and rearrange this sql database based to our specific needs. Thanks for helping me.

@rfsnjn Жыл бұрын

what a perfect time, i just started python

@dnyaneshwar53 Жыл бұрын

Same here ✌️✌️✌️✌️

@helloworldfromvn Жыл бұрын

same here, really need this 😂

@AkramBazina Жыл бұрын

Welcome to the club

@lunarbonito Жыл бұрын

Woot! Thank goodness, I needed this back on my computer! Thank you!! :D

@alvaroszi Жыл бұрын

Awesome video! Will definitely get to do some of these :D

@ayushroy3514 Жыл бұрын

Wow. I am currently learning automation, great timing for the vid

@dansierrasam79 9 ай бұрын

Thank you, sir. Excellent work!

@codingtech2502 Жыл бұрын

I never skip add on this channel because it help the channel that provides priceless video

@muhammednihal2410 Жыл бұрын

Awesome!!! Thank you ❤

@ghassanjenainaty4212 Жыл бұрын

Now am learning the basics of Python like variables & inputs & loops, classes, dictionaries, etc. I guess i have to build good background before moving to Automation

@SmallMindEd69 10 күн бұрын

This code instructor is amazing!!!

@labinotsulejmani1137 8 ай бұрын

Hi everyone! First of all, thank you guys for this amazing content that you keep delivering! You are the world's No 1 free school for learning Tech! Now to my question: i run the first 2 programs with success but it doesn't give me the output as in the video. Doesn't matter if i rung it from VS Code, git bash or cmd. The program runs successful but the output is not as expected with the lists. Can you someone help?

@sanjananayak6326 Жыл бұрын

This is what I needed. Thank u❤️

@matthewsteele1671 Жыл бұрын

Thank you for the amazing content! It would be very helpful if you mentioned which code editors or ide's you use when you switch from jupyter though. I tried to download the cheat sheet but it sent me in circles. Thanks again!

@braxindor4153 Жыл бұрын

He said it multiple times though? It's called pycharm. It's the jetbrains option. You can use visual studio code or similar and that'll be great as well though.

@Martin-yo8wh Жыл бұрын

When you are describing something that is shown in the screen, it would be easier for the viewers to follow if you use some kind of pointer (e.g. a highlighted mouse pointer) instead of just plainly saying the description -- noticed this in explanation of xpath syntax; too many descriptions that didn't stick to mind.

@Mr0rris0 Жыл бұрын

What about LASERS!!!@!@@@@ And duck hunt. This can be solved with over engineering SUBSCRIPTION LASERS!!!!!!!

@dhruvpandey3642 9 ай бұрын

Agreed, Finally someone telling it like it is instead of fanboying

@BillyT83 Жыл бұрын

Finally a Python Automation Course from freeCodeCamp!!! 👍

@user-bf5os3fo9m Жыл бұрын

Excellent content, thanks. How can i implement the new functionality in Python 3.10 os.startfile(path[, operation][, arguments][, cwd][, show_cmd])? I want to open a file in a minimized window.

@sonamohialdin3376 Жыл бұрын

Amazing tutorial thank you

@sab311 Жыл бұрын

I must jump on this. So inspiring. Thank you

@sigfigronath Жыл бұрын

Wow so easy ! great course

@NovaTech2010 Жыл бұрын

Thank you for this tutorial!

@kakafrost 8 ай бұрын

Hey thanks! In the scraping part, what do you do with this error: "ERROR: Couldn't read tbsCertificate as SEQUENCE" "ERROR: Failed parsing Certificate" ?

@iDarkXY Жыл бұрын

this helped tremendously. THANK U

@sanjith_sambath Жыл бұрын

For those of you getting a certificate error : import ssl ssl._create_default_https_context = ssl._create_unverified_context ^ Worked for me :D

@aashishmalhotra Жыл бұрын

Wow very useful i will complete it after finishing with 8 sem exams

@cheybrown2076 2 ай бұрын

Nice video to just binge. Thanks for this

@mehdismaeili3743 Жыл бұрын

Excellent, thanks.

@vijayalakshmiraj7528 Жыл бұрын

TNice tutorials was an amazing tutorial. You are a great teacher

@iggaming948 Жыл бұрын

After learning from 12hrs. Video now I think 2hrs. Video is shorter for me I can easily learn from them ♥️😀🖐️

@theobaldigberaese4572 Жыл бұрын

Awesome work mentor... I hope to meet you someday

@othnieldavidson7579 Жыл бұрын

nice tutorials sir i wanted to ask if there is a library to fetch images online...

@TiagrajI Жыл бұрын

Great one. I love it. It helps in daily life

@imnedmonton Жыл бұрын

I'm hooked. A thousand years away from assembler, COBOL, Fortran, Pascal. Champagne vs. cheap beer.

@marcelborg1821 Жыл бұрын

This is really good. However, I get an error message when trying the Automate the News code that the executable_path has deprecated

@sanketsaboo6567 Жыл бұрын

Is there any way to put the formula for the entire column from row7 to row n without for loop in openpxl or pandas ?

@yatsilmatt4256 Жыл бұрын

great course! but i am using win 11 and chromedriver have only a 32 version, what should i do?

@dnyaneshwar53 Жыл бұрын

Your are awesome... Thank you so much for this course 😍✌️✌️✌️✌️

@mohammadashrafbinizham7985 Жыл бұрын

although i am new, it's understandable explanation 👍👍

@hammadmohammadanees1391 Жыл бұрын

For the projects . Can they be converted as an API or a tool . if they can , How to do it?

@jitendratiwari6886 Жыл бұрын

Wow thank you for sharing this to us.

@ss0ulzz Жыл бұрын

at 11:14, who do you get pycharm to show the side mini window expanded , to show parameters etc... ? thanks

@SpwnTheBitcoinOverlord Жыл бұрын

A tutorial regarding Filemaker?? It would be pretty useful!

@marianrusu7580 Жыл бұрын

Hi, I don't know if I have chance to get an aswer but I still ask. I just finished my web scrapping automation in python using selenium. The automation should search for some items and extract the data like price, date etc. The scrapped data should be exported in an excel file and also is a exception when the data for an item is not found the item needs to be exported with "No data" . I run some test but from 5 runs only 3 are correct, sometimes the items are skipped even though the data is availbale for them. I tried to slow the code, to increase the load page time, to use different methods to locate the element from which I need the data to be extracted, but nothing seems to work very good. Any advice? Thanks!

@TheOnlyEpsilonAlpha 6 ай бұрын

I‘m at 1:17 and first i have to say something: THANK YOU FOR USING A PROPER MIC!❤ Cheeses crisis, the last 5 Videos I watched before, there have been people, without proper English speaking or the worse mic quality or a combination of both. Or a lady which hammered her keyboard right beside the microphone. How should someone proper learn from that content? 1:52 Okay the CTRL Key seems to be right beside your mic right? Each time to copy or paste something it‘s clear you pressed a key very loud. 3:00 what happened? You sound so much quieter 8:53 But if i turn it up it‘s okay. Anyway it‘s a way better video than the other ones i watched before! 19:29 i love that someone really specifies all the tags you find in that chaos of a modern website, very well explained 👍 Gone through the whole video and it was VERY interesting 😮 thanks for that tutorial

@SinarJourney Жыл бұрын

Hi, thanks for this amazing tutorial. I have 1 question about the path in executable files 1:36:45 , when i try to run directly in IDE (VsCode) it worked, but somehow when i try to run it on exe file it failed to recognized the chromedriver path ('chromedriver' executable needs to be in path). I appreciate any feedback, thank you

@ambivert_sigma_motivation Жыл бұрын

Awesome, thanks!

@manikandanshanmugam7480 6 ай бұрын

Nothing but ❤ for this course

@mikhailkalashnik0v Жыл бұрын

Do you guys have a video on automating w bash or golang by chance?

@leonelsalah8950 11 ай бұрын

Hi, tks for your lectures After finishing lesson Automate the news- exporting data at 1:30, file headline.csv only shows many the same contents in all rows, could u tell me how to fix it. Tks

@healthadvice3091 7 ай бұрын

9:29 correct me if im wrong but you can do this easily in excel right?

@jacquacooper Жыл бұрын

Just what I needed

@mecreature Жыл бұрын

Awesome 😍😍😍

@fmictsang8874 Жыл бұрын

This is amazing.

@mahendranath2504 Жыл бұрын

Thank you so much 😊👌👍👋👍

@abnbablwaftkher Жыл бұрын

thank you bro for this informations. I have a question and I hope you can answer it : I get an error message telling me that I am using a proxy when I open one of my short links via rdp developed by Azure, is there a way to resolve this error message and create rdp with a real IP address. Thanks in advance

@reindeermosseater Жыл бұрын

but how about scaping web pages requiring auth?

@themuhammad1 Жыл бұрын

Thank you so much 😭😭❤️❤️❤️😍😍😍

@Lorendrawn 7 ай бұрын

About to end all my teammates' careers with the learnings from this video ayyyy

@jagadeeshkumar5814 Жыл бұрын

Can u please teach ,how to scan a barcode and insert data into a database along with timestamp of login and logout.

@hayat_soft_skills Жыл бұрын

Cool !!!! Thanks!

@donsurlylyte Жыл бұрын

these kind of real world applications of python are real gold, i look forward to them

@sidstar593 8 ай бұрын

Is this enough for python scripting for semiconductor domain professionals curious to know.

@jheandaza7334 Жыл бұрын

Wow!! Beatiful content!

@gameplay6751 Жыл бұрын

Thanks a lot ❤️, if you record video how to automat wordpress after we scrap the data

@romanshrestha1292 Жыл бұрын

I generally use brave and firefox instead of Chrome. Is it possible to do 'automate the news' project without chrome?

@parthasarathyvenkatachari2617 Жыл бұрын

super video pls continue other topics of any other language

@nocopyrightgameplaystockvi231 Жыл бұрын

are the libraries installable on python 3.11 ? My work laptop has python 3.11 with the NodeJS i got installed.

@aliakbarakbari3802 Жыл бұрын

Hi all, I am using Python 3.7 and pycharm, installed pandas, entered the code for the first project (table Extraction) it is showing "Process finished with exit code 0 " but not showing the extracted tables, any idea? regards

@mikerobin8410 Жыл бұрын

print the output to your console

@uttkarshtewari2532 4 ай бұрын

well idk about pycharm but printing a dataframe in colab becomes hella messy it only properly prints out if u just type the dataframe variable name@@mikerobin8410

@immanuelsuleiman7550 Жыл бұрын

This channel is awesome

@aadarsh8306 Жыл бұрын

agreed

@aivoirung969 Жыл бұрын

Great, many thanks, but I got some errors: 1) at 54:53, it changes from h2 to h3, doesn't it? 2) When I run it, it appears some errors: Traceback (most recent call last): File "H:\Download\selen 2 learn.py", line 15, in driver = webdriver.Chrome(service=service) File "C:\Users\Admin\anaconda3\lib\site-packages\selenium\webdriver\chrome\webdriver.py", line 80, in __init__ super().__init__( File "C:\Users\Admin\anaconda3\lib\site-packages\selenium\webdriver\chromium\webdriver.py", line 101, in __init__ self.service.start() File "C:\Users\Admin\anaconda3\lib\site-packages\selenium\webdriver\common\service.py", line 104, in start self.assert_process_still_running() File "C:\Users\Admin\anaconda3\lib\site-packages\selenium\webdriver\common\service.py", line 115, in assert_process_still_running return_code = self.process.poll() AttributeError: 'Service' object has no attribute 'process'

@cardozarate2826 Жыл бұрын

what modules do we need for this course? I keep having errors from the intro with pandas.

@annanariyeva6172 Жыл бұрын

meee tooo!! I don't get it. I 've tried everything. Please, someone help me.

@sanjith_sambath Жыл бұрын

same

@jovanvasic3434 Жыл бұрын

I guess some good basic to medium python skill is needed for this course.

@sprinter5901 Жыл бұрын

In command prompt do pip install pandas

@reneramirez7777 Жыл бұрын

THKS!!!!! I WILL CHECK THIS VIEO AFTER MY OFFICE HRS!!!

@kopytko9558 8 ай бұрын

at 44:00 i got everything like in your example, yet chrome opens with no page

@just_ab01 3 ай бұрын

Thanks!

@gn4587 Жыл бұрын

Well thanks a lot for this course, but you should mention that cronjobs can only be run for Mac and Linux. I have been trying to run crontab -e for a couple of hrs now!

@ananjohar8248 Жыл бұрын

Hello Is this course still valid for 2023 april

@gn4587 Жыл бұрын

@@ananjohar8248 Yes why won't it be valid?

@ananjohar8248 Жыл бұрын

@gn4587 I mean it will work or I got some errors cause of updates in 2023 because this course is 9 months ago

@ananjohar8248 Жыл бұрын

@@gn4587 thanks for replying me I will try this

@gn4587 Жыл бұрын

@@ananjohar8248 I tried this 4 months ago and it worked for me. Only the cronjob part didn't give proper results. Try it out yourself. Recent updates shouldn't hamper the process much.