Python Automation Tutorial - How to Automate Tasks for Beginners [Full Course]
Рет қаралды 1,065,408
Күн бұрынLearn how to use Python automation to perform common tasks. In this full course you will learn how to build the following automation projects:
- Hacker News Headlines Emailer
- TED Talk Downloader
- Table Extractor from PDF
- Automated Bulk Resume Parser
- Image Type Converter
- Building an Automated News Summarizer
💻 Code: github.com/amrrs/build_tools_...
✏️ Course from 1littlecoder. Check out his channel: / 1littlecoder
⭐️ Course Contents ⭐️
⌨️ (0:00:00) Introduction
⌨️ (0:00:29) Hacker News Headlines Emailer - Tutorial 1
⌨️ (0:01:13) Introduction to Web Scraping
⌨️ (0:03:08) Setting up the Environment
⌨️ (0:06:30) Project Script
⌨️ (0:11:00) Website Structure of Hacker News FrontPage
⌨️ (0:21:00) Sending Email from Python
⌨️ (0:35:15) Building the Headlines Email Module
⌨️ (0:39:07) TED Talk Downloader - Tutorial 2
⌨️ (0:39:49) Installation and Introduction to requests package
⌨️ (0:41:25) Installation and Introduction to BeautifulSoup
⌨️ (0:43:25) Building the basic script to download the video
⌨️ (0:49:37) Generalising the Script to get Arguments
⌨️ (0:53:49) Table Extractor from PDF - Tutorial 3
⌨️ (0:54:44) Basics of PDF Format
⌨️ (0:57:05) Installing required Python Modules
⌨️ (1:02:16) Extracting Table from PDF
⌨️ (1:06:51) Quick Introduction to Jupyter Notebook
⌨️ (1:08:29) PDF Extraction on Jupyter Notebook
⌨️ (1:15:29) Pandas and Write Table as CSV Excel
⌨️ (1:21:02) Automated Bulk Resume Parser - Tutorial 4
⌨️ (1:22:15) Different Formats of Resumes and marking relevant Information
⌨️ (1:25:50) Project Architecture and Brief Overview of the required packages and installations
⌨️ (1:34:48) Basics of Regular Expression in Python
⌨️ (1:41:38) Basic Overview of Spacy Functions
⌨️ (1:49:55) Extracting Relevant Information from the Resumes
⌨️ (2:16:46) Completing the script to make it a one-click CLI
⌨️ (2:28:09) Image Type Converter - Tutorial 5
⌨️ (2:29:09) Different type of Image Formats
⌨️ (2:31:33) What is an Image type convertor
⌨️ (2:33:04) Introduction to Image Manipulation in Python
⌨️ (2:34:51) Building an Image type converting Script
⌨️ (2:40:03) Converting the script into a CLI Tool
⌨️ (2:44:27) Building an Automated News Summarizer - Tutorial 6
⌨️ (2:46:27) What is Text Summarization
⌨️ (2:47:46) Installing Gensim and other Python Modules
⌨️ (2:52:43) Extracting the required News Source
⌨️ (2:59:38) Building the News Summarizer
⌨️ (3:07:14) Scheduling the News Summarizer
⌨️ (3:10:25) Thank you
🎉 Thanks to our Champion and Sponsor supporters:
👾 Wong Voon jinq
👾 hexploitation
👾 Katia Moran
👾 BlckPhantom
👾 Nick Raker
👾 Otis Morgan
👾 DeezMaster
👾 AppWrite
--
Learn to code for free and get a developer job: www.freecodecamp.org
Read hundreds of articles on programming: freecodecamp.org/news
@1littlecoder 2 жыл бұрын
Thank you very much FCC for publishing my course. It's an honor. This project-based learning should help beginners to improve their portfolio. Happy to help!
@FindMultiBagger 2 жыл бұрын
Great 👍 keeep going bro
@1littlecoder 2 жыл бұрын
@@FindMultiBagger Thanks Bro :)
@sparshgarg8362 2 жыл бұрын
Thank you!
@tech_ox4976 2 жыл бұрын
Thanks for making this available for free.
@carllewis6745 2 жыл бұрын
Thank you!
@notknowthething 2 жыл бұрын
Thanks for being a free version of Udemy
@lakshyasharma7448 2 жыл бұрын
*better
@Epipedobatideo 2 жыл бұрын
*substantially better
@akshaykumarsharma 2 жыл бұрын
*best
@Jose_T131 2 жыл бұрын
most of the time is very cheap, but yeah excellent free content!
@mlondymadida3427 2 жыл бұрын
Broooo!!
@theoreticalphysics3644 2 жыл бұрын
Literally I just wrote a python script to automate reading pdfs using just few lines of regex. Saved hours of copy-pasting work.
@keepgrindingkeepwinning9237 2 жыл бұрын
Can you show me how? I need to do the same thing
@jiberuba8856 2 жыл бұрын
Please can you share your method.
@raymondqiu8202 2 жыл бұрын
I'm just curious but could you explain why you would need to automate reading PDFs, like what situation requires you to read pdf
@theoreticalphysics3644 2 жыл бұрын
@@raymondqiu8202 well, in my case, I'm putting my comp physics degree to such great use by working in a data entry job. Part of my job is I get a bunch of documents containing data and am expected to copy-paste the relevant data into spreadsheets. Rather than doing that though, ofc I'm going to put my overqualification to use. I use regular expressions tailored to whatever documents I'm looking at to extract the data with findall() and use pandas and openpyxl to export the data into a spreadsheet. Also, I don't actually read the pdf directly, I read the pdf as converted into a text-accessible file.
@raymondqiu8202 2 жыл бұрын
@@theoreticalphysics3644 ah right yeh thanks for that, now I understand more. python is so great for this sort of stuff ain't it
@sythonslays 2 жыл бұрын
Typically I have a hard time comprehending Indian instructors, however this is probably one of the best instructional videos I have watched even if the instructor was a native english speaker. You do an incredible job explaining every element of what you are doing and even repeat yourself clearly to help the end user understand what is being accomplished. Excellent Instructor!
@1littlecoder 2 жыл бұрын
Thank you for the kind words and feedback. It helps me focus on the attributes that are impactful!
@karshanbhaihumbal9164 2 жыл бұрын
The guy is Indian he isn't westner
@mounikakulkarni6389 2 жыл бұрын
I can't begin to describe how amazing I found this video. Thank you so much.
@1littlecoder 2 жыл бұрын
Thanks Mounika. Means a lot 🙏🏽
@brunogamboa8681 2 жыл бұрын
This KZfaq channel is amazing! Grateful for this quality of FREE online resources. 🙌
@ccuny1 2 жыл бұрын
Another winner. Thank you so much.
@theencryptedpartition4633 2 жыл бұрын
You guys are the best🔥. Please stay so and don’t delete videos unless they get really old and you got another one but newer
@saikrishnach777 2 жыл бұрын
Thanks for bringing such amazing content. Good work 1littlecoder !
@1littlecoder 2 жыл бұрын
Thank you Sai :)
@sonhills2750 2 жыл бұрын
Omg, this cant come at a better time than now. Thank you
@oleksandrarsentiev7152 2 жыл бұрын
Good stuff! Especially the resume parser project and the news summarizer! Thank you!
@1littlecoder 2 жыл бұрын
Thanks for the feedback. Glad you liked it :)
@the_positivity_pulse 2 жыл бұрын
I swear the best channel in the entire youtube❤️❤️🙏
@bjorgrosenquist2490 Жыл бұрын
Holy this is absolute banger of a video, I also thought I wouldn't be able to understand the accent for the entire video but this is the best programming video i've ever watched explained all the functions and methods so well thanks so much
@Sam-jg5zv 2 жыл бұрын
Excellent tutorial that goes through various useful libraries in Python.
@eugenepashch5213 2 жыл бұрын
Been looking forward to it. Cheers!
@1littlecoder 2 жыл бұрын
Great!
@phoenixyt124 2 жыл бұрын
This is amazing, thanks!
@oamarkanji3153 2 жыл бұрын
Free code camp is killing it with these courses, thank you!
@nikitokpo12 2 жыл бұрын
I don't know much English and sometimes I even have a hard time understanding a native speaker, but I still understood 90% of the things you said, don't worry about your accent, great course ^^
@jasonborucki4420 2 жыл бұрын
Yall are coming out with rapidfire Python content and I am HERE for it
@drakouzdrowiciel9237 Жыл бұрын
You provided people with foundational knownalge of data transformation, thank you.
@deeper_soundfy5528 2 жыл бұрын
Guardado para una próxima visualización y estudio! Gracias y Saludos desde Argentina
@Despe4er 2 жыл бұрын
Огромное Вам спасибо ребятушки
@tech_ox4976 2 жыл бұрын
Thanks alot FCC. You're legends
@christopherreif3624 2 жыл бұрын
Very useful, I greatly appreciate this!
@1littlecoder 2 жыл бұрын
Thanks for the feedback!
@retrofutur1st 2 жыл бұрын
Thanks for this free knowledge, have a like 👍
@irshadtarsoo7734 2 жыл бұрын
Great content as always 😍❤️💯
@banyarnaing2597 2 жыл бұрын
You guys are the best!!
@pranavaher6036 2 жыл бұрын
Thanks for everything ❤️
@postpiratesgaming 2 жыл бұрын
Special thanks for the tutorial, 💚, I was looking something like that
@mehrozbaig8444 2 жыл бұрын
You guys doing such great work. May Allah (swt) bless you.! Love from Pakistan.
@polarishex3055 2 жыл бұрын
In the last project, the news summarizer (3:00:11), you can no longer use Gensim for summarization, as the line 'from gensim.summarization.summarizer import summarize' no longer works. the summarization package was removed from gensim after the 4.0 version, so you would have to downgrade to a 3.x version. I ran into a different error when trying to do that and ended up just skipping that proyect, but I hope the info helps someone
@1littlecoder 2 жыл бұрын
Thanks for sharing this. I saw this recently, you need to use a lower version of gensim to do summarization as they've completely moved into topic modelling.
@GurmeetSingh-fr8uo Жыл бұрын
@@1littlecoder what do you mean by lower version?
@Prabash_Prabhu Жыл бұрын
@@1littlecoder where can you download the older version?
@chumkiisrat3065 2 жыл бұрын
Absolutely amazing
@mohammedmouizuddin4403 2 жыл бұрын
Amazing 🔥
@AreebAmir 2 жыл бұрын
Thank you so much!
@WeirdDev69 2 жыл бұрын
Wow thankyou 🙏❤️
@omkarghodvinde4910 Жыл бұрын
Thank you so very much !!
@laus-thecurious4120 2 жыл бұрын
Dude it went above my head
@legendarystuff69 2 жыл бұрын
@1littlecoder That last part was fire broooOooO!
@MrKareem722 2 жыл бұрын
For those who got the error "'charmap' codec can't decode byte 0x9d in position 1290: character maps to " just add encoding='utf8' inside the return open statement within convert_pdf function
@HH-io9vh 2 жыл бұрын
man thanks for your comment, it makes my day better when I see people help others without being asked to
@MrKareem722 2 жыл бұрын
This is how it should be ;)
@Prabash_Prabhu Жыл бұрын
Thank you, I was getting that error and tried everything until I finally saw your comment and it worked! thank you so much
@Greyisheep 2 жыл бұрын
Amazing video. My python keeps getting better thanks to free code camp
@1littlecoder 2 жыл бұрын
Thank you Claret!
@chibimentor 2 жыл бұрын
Thanks!
@captainakelees 2 жыл бұрын
Y'all literally can't do this to me for the 5th time man. I was about to learn about automation with python and this shows up at my home page saiuodfhisuhdqiuh love y'all
@justapugontheinternet 2 жыл бұрын
This channel I better than university for sure.
@segujatwaib7033 Жыл бұрын
Thanks for the program
@Firoz900 2 жыл бұрын
Thanks a lot.
@austinduer471 2 жыл бұрын
i always appreciate this guy. great tutorial
@AbuFaizal 2 жыл бұрын
Thanks for amazing Stuff
@vivekan97 2 жыл бұрын
Nice Concepts .Camelot is what I am doing now. Vera level nanbaa Thamizhan 🔥🔥🔥 Explanation was smooth and interesting.
@1littlecoder 2 жыл бұрын
Thanks nanba, Namma channel pakkamum vaanga :)
@Candy-sh4qs 2 жыл бұрын
@@1littlecoder Bro neega tamil ah, super bro....... Congratulations
@1littlecoder 2 жыл бұрын
@@Candy-sh4qs Yes bro, Thank you :)
@anuraagpandey8316 2 жыл бұрын
hi. I am getting error. "AttributeError: module 'camelot' has no attribute 'read_pdf'". got any tips for me? Danke.
@1littlecoder 2 жыл бұрын
@@anuraagpandey8316 What's the code you are trying?
@ayeshabanu368 2 жыл бұрын
Very nice explanation Abdul sir. Thank you so much
@1littlecoder 2 жыл бұрын
Thank you Ayesha :)
@Kayumov 2 жыл бұрын
Thanks 👍
@kararohatinovici3761 2 жыл бұрын
good performance 🏆🥇
@sonyabayas5732 2 жыл бұрын
Thanks a lot
@ytdavide 2 жыл бұрын
💯 thanks 😉
@baleshj 2 жыл бұрын
To support the channel I never skip any ads that show up
@matthewlavancher7978 2 жыл бұрын
awesome thing
@oscarmbwale2011 2 жыл бұрын
thank you very big
@hoangthaibcr1942 Жыл бұрын
Hay quá anh
@__________________________6910 2 жыл бұрын
Thanks
@Machconsults 2 жыл бұрын
This is I neeeeeeeed !!!!!!
@1littlecoder 2 жыл бұрын
Great to hear!
@turtlesarecool1488 2 жыл бұрын
30:38 the gmail setting "Less secure app access" is no longer supported by google as of May 30, 2022 (edit) enable duel-factor authentication on you email and generate an app password. Here's a video if you don't know how to generate an app password: kzfaq.info/get/bejne/ZuCGramSydypiZ8.html&ab_channel=LotHillSolutions
@vmarzein 2 жыл бұрын
thank you
@seanoddy9275 2 жыл бұрын
Now that is how you start a video: "IN THIS COURSE YOU WILL LEARN.."
@LoadsofLOL 2 жыл бұрын
google no longer has 'less secure login' if you are going to use a gmail account for the Hacker News part of the tutorial. Create a App Password (16 charector long, set it and forget it) and use it as your gmail password instead of your regular password to bypass the autentication part.
@thisx8914 2 жыл бұрын
reply: b'535-5.7.8 Username and Password not accepted I still get the problem, after changing the password to the app password, can you explain more?
@johnqpublic770 Жыл бұрын
You created an app password in your Google settings?
@AlvaroVR8 2 жыл бұрын
The first project is outdate, with that code you get an error sending an email with gmail.
@malkhaz.jokhadze Жыл бұрын
11/10... Additional credit for proper indian accent.
@haroon1287 Жыл бұрын
Whoever is using python 3.11.1. If the email lib is not getting installed try "pip install email_validator".
@maxwellblander 6 ай бұрын
this did something I appreciate it haroon
@kragrrr 2 жыл бұрын
I see a Lego Mindstorms EV3 in the back. Is there any upcoming course for that?
@mdsumonrana9647 2 жыл бұрын
Nice video
@qtipti 2 жыл бұрын
Köszönöm!
@snakerex Жыл бұрын
May 30, 2022 Google discontinued allowing 'less secure apps'. Does anyone have a work-around?
@anastasiatsoukala306 Жыл бұрын
kzfaq.info/get/bejne/qamjgMl9y5exhJs.html check this video!it solves the problem!
@manikantaprudhvijami600 2 жыл бұрын
Thank you sir
@1littlecoder 2 жыл бұрын
Glad you found it useful Jami!
@pontz5978 2 жыл бұрын
nice
@manishcodeshala9639 2 жыл бұрын
great video
@1littlecoder 2 жыл бұрын
Thank you Manish!
@beniaminocogoi5806 2 жыл бұрын
Hello, sorry complete beginner here, I ve got Python 3 installed. Question: at the very beginning, when running 'pip3 install requests' and 'pip3 install beuatifulsoup4' i get the error message 'File "", line1'. I ve tried running it on the shell, on the Powershell, and on my editor (I use Atom). ANy ideas? thx
@jeffjupiter9475 2 жыл бұрын
If you're attempting to clear the terminal on Windows the command is "cls" --> Enter
@hemanth6951 2 жыл бұрын
Google ads won't show in your website if you arer scrapping contents from another website
@dhruvgupta2171 Жыл бұрын
In the Resume parsing tutorial, what if I have to extract the name of the college, how will I be able to do that?
@monixwilliams9329 2 жыл бұрын
During the webscraper project; Im getting the message 'Username and Password not accepted'. Does anyone know how to go about this?
@autarivloger 2 жыл бұрын
please make hacking bootcamp with python. lots of love from nepal
@samiruddin8094 2 жыл бұрын
Fire
@PANDURANG99 Жыл бұрын
I am going to build a desktop app, should I make code in single python file or make different files for ui, admin, user ?
@MrCOPYPASTE 2 жыл бұрын
Even if I was a beginner I never wanted to take a class from this person... I just can't...
@shulinyang5312 2 жыл бұрын
Tagggggggged!
@alifia276 2 жыл бұрын
Thank you @1littlecoder, for sharing your knowledge
@1littlecoder 2 жыл бұрын
My pleasure Alifia :)
@Ricocase 2 жыл бұрын
How does this connect to an actual site?
@ChrisBMobiusman 5 ай бұрын
How do I write a script that just shows my reels and updates them as I post on a monitor I have connected with raspberry pi? I need it for an art show
@mohanmsn5157 Жыл бұрын
What is the difference between c framework and python framework ? Which one is better if python or c then why ?
@storiesshubham4145 2 жыл бұрын
As of date 19-May-2022, I am at 14:18 on this video and I can't find the exact thing that the instructor is saying. Has the coding structure changed inside the "inspect element" box ??
@guy1407 2 жыл бұрын
thanks for this great demo. Would like to ask - what OS are you using, what Terminal is it?
@1littlecoder 2 жыл бұрын
Mac OS and Terminal is iTerm2
@1littlecoder 2 жыл бұрын
Thanks for the kind demo
@bbb55590 2 жыл бұрын
Amazing tutorial. I am picking up Python and this is exactly what I needed. Can anybody address exactly why the attribute 'valign' was included in the soup? I only know very surface level HTML and i am struggling to understand this aspect of the code. Any help would be greatly appreciated! Cheers, Stephan 'Emilio' Haraldsson
@1littlecoder 2 жыл бұрын
Thanks for the kind words. Can you share the timestamp where you saw this ?
@AA-mq2jb 2 жыл бұрын
@@1littlecoder Likely referring to 18:45 Line 29
@emilylynn238 2 жыл бұрын
cool
@coefficient1359 2 жыл бұрын
Need a golang fiber tutorial
@rocky23x32 2 жыл бұрын
heyyyyyyyyyyyyyy , I got an "AttributeError: 'list' object has no attribute 'encode' " on the first program when I tried to add an list
@manikantapunnam1189 2 жыл бұрын
Awesome explanation sir.
@bhavyalodaya1086 Жыл бұрын
Hi I just want to ask a simple question. I make scraping scripts using python and other libraries which helps me to gather the data in required format. What is my profession? Tester Developer Guide me on this Thanks
@SouNin_ 5 ай бұрын
okay so we're on minute 8, and we just went from basic imports, into a full blown function for a scraper. and i dont know if its just me but i much prefer videos that do a code a long with me and actually explain each part that they put on there isntead of just not bothering to explain what they are.
@guy1407 2 жыл бұрын
Thanks for the complete demo. Time = 02:13:42, How come it worked for you? This line: name = [entity.text for entity in doc.ents if entity.label_ is "PERSON"][0] is problematic, it should be == "PERSON" :)
@AB42069 2 жыл бұрын
is and == do the same
@PainDive1 2 жыл бұрын
If you're watching this, don't do like this guy. First, create a virtual environment, and then install the required packages. mkdir , cd , python -m venv , in windows to activate do \Scripts\activate.bat. Once activated you can do your pip install requests, etc.
@gokusaiyan6809 2 жыл бұрын
why do i have to download pdf2text separately and why not the pdfminer package is installing that. plus even if i download it its not working.
@infamousprince88 2 жыл бұрын
any advice if you're struggling with pip install requests? Think there is something that needs to be done in VSCode before building a project?
@1littlecoder 2 жыл бұрын
Have you installed Python on VSCode? If you have Python on your machine, pip install requests should work fine.
@wafeealkevy1181 2 жыл бұрын
@@1littlecoder When i try to import it states that there is no module named 'requests', even though i have installed them and it states 'requirement already satisfied' when i try do 'pip3 install requests'. I am using anaconda python powershell
@shahedmarleen8757 2 жыл бұрын
@@wafeealkevy1181 Same issue using pycharm community edition .