No video

Al Sweigart, "Automating Your Browser and Desktop Apps", PyBay2016

  Рет қаралды 358,271

SF Python

SF Python

8 жыл бұрын

There's a lot of data on the web and in your desktop apps, but accessing it can involve a lot of tedious typing and clicking. This talk is an introduction to the Selenium and PyAutoGUI modules, with live demos straight from the interactive shell. Al Sweigart explains web scraping techniques and programmatically controlling the keyboard and mouse to automate these tasks for you.

Abstract
The internet and personal computer are central tools in many jobs, including professions outside of engineering. This makes web scraping and GUI automation are relevant to not just developers and QA testers, but academics, organizers, and office workers. This talk is an introduction to Selenium and PyAutoGUI modules. and programatically controlling your browser and desktop applications from Python.
Web scraping and GUI automation frameworks have an intimidating reputation for a steep learning curve. While they do have many sophisticated features, the basics that most folks will ever need can be covered in a single presentation.
This presentation has multiple live demos to showcase these modules straight from the interactive shell.
The content from this talk is derived from Automate the Boring Stuff with Python, a beginner's Python book freely available under a Creative Commons license at automatetheboringstuff.com
Bio
Al Sweigart is a software developer and the author of Automate the Boring Stuff with Python, Invent Your Own Computer Games with Python, Making Games with Python & Pygame, and Hacking Secret Ciphers with Python. These books are freely available under a Creative Commons license at inventwithpython.com. Al enjoys haunting coffee shops, writing educational materials, cat whispering, and making useful software. He lives in San Francisco.
speakerdeck.com/pybay/2016-al...

Пікірлер: 228
@WordbreweryLanguages
@WordbreweryLanguages 7 жыл бұрын
I highly recommend his book. It got me back into programming after a 17-year hiatus.
@hongren99
@hongren99 6 жыл бұрын
You encourage me as well. I felt dummy on programming.
@percys8774
@percys8774 Жыл бұрын
For us beginners watching in 2022, at the 6:30 minute mark the selenium commands are out of date. It now looks like: driver.find_element(By.ID," "). Here's a recent short tutorial video with the new commands: kzfaq.info/get/bejne/pphkdsJhyZ6qk4U.html&t
@davidkayode2737
@davidkayode2737 4 жыл бұрын
This is my very humble teacher. I leant virtually everything I know in python from him.
@vasudevgouda256
@vasudevgouda256 Жыл бұрын
True
@inspired4more
@inspired4more 2 жыл бұрын
My very first programming class used one of his books as a textbook called "Invent Your Own Computer Games with Python." I just recently started using pyautogui and literally just found out he also wrote it. Pretty low-key humble guy.
@coolmcdude
@coolmcdude 2 жыл бұрын
Great video. After I watched this I got the motivation to really dig in to both selenium and pyautogui and I have already automated so much.
@mkhpd8158
@mkhpd8158 3 жыл бұрын
I've just built a program to extract FX data automatically from MT5 using this PyAutoGUI. It took about 2 hours to write the code as there are no keyboard short cuts in the popup window. Works like a charm. It 'automates the boring stuff', as I need to do this task monthly! thanks Al
@FW-jq1ox
@FW-jq1ox 3 жыл бұрын
Awesome guy. I love people that legitimately want to help others learn with few or no strings attached.
@Mikey-nh9jf
@Mikey-nh9jf 5 жыл бұрын
Al Sweigart, Hero. Thank you for writing such an awesome book(s)!
@yoericktv9610
@yoericktv9610 3 жыл бұрын
Al thank you so much for making PyAutoGui. You're a real hero.
@imtiazshahed944
@imtiazshahed944 5 жыл бұрын
I used to hate coding before reading Automate Boring stuff with Python, it was fun though and Now I am watching videos on Selenium!! thank you, Mr. Albert, for making fun from boring bits!!
@counterculturecocks
@counterculturecocks 5 жыл бұрын
His book is killer! One of my all time favorites when I'm trying to show someone why they should be interested in Python.
@ayeshavlogsfun
@ayeshavlogsfun 3 жыл бұрын
Which book ? Please mention name ?
@varun_4125
@varun_4125 2 жыл бұрын
@@ayeshavlogsfun Automate the boring stuff with Python
@shanepython
@shanepython 6 жыл бұрын
Great book. Great talk. What kind of person "thumbs down" this video? I hope you choose to pass on more of your knowledge in such a manner. You are a very good instructor. Thank you!
@WinterSnowism
@WinterSnowism 7 жыл бұрын
This man's voice is really soothing.
@ronaldokun
@ronaldokun 6 жыл бұрын
I thought the same too.
@darkdevil2720
@darkdevil2720 6 жыл бұрын
Me too!
@mr_jacklu8014
@mr_jacklu8014 4 жыл бұрын
It makes me feel good about life.
@omollofredrick
@omollofredrick 5 жыл бұрын
I owe this man everything... I learnt how to code from his book, 'Invent Your Own Games With Python' back when I was a kid.
@fy1000000
@fy1000000 4 жыл бұрын
Al, you are an amazing teacher! Thank you.
@pimpirisnais
@pimpirisnais 5 жыл бұрын
Thanks, I really enjoyed this talk, a remember me to have fun and remove from my mind the cliché of "everybody should learn to code".
@Acephotoandvideo
@Acephotoandvideo 5 жыл бұрын
Thank for the great info, I'm just learning Python and found this and got it working. I'll be looking at your book.
@thequiethunt3352
@thequiethunt3352 6 жыл бұрын
Al is an excellent teacher!
@MarkJay
@MarkJay 7 жыл бұрын
super cool talk. Selenium looks awesome. will be trying it out. Thanks!
@braxtonec
@braxtonec 4 жыл бұрын
Great presentation! Live demo rockstar! I read the book as an intro. Very well written! Thanks!
@bopon4090
@bopon4090 4 жыл бұрын
this is the video I am searching for years
@KowboyUSA
@KowboyUSA 6 жыл бұрын
"Hi, I'm AI." Whoa! That's some good AI. At first I was convinced you were an organic human.
@davidkayode2737
@davidkayode2737 4 жыл бұрын
Greatest programming teacher.
@techstacker5361
@techstacker5361 7 жыл бұрын
Great talk!
@twnfaem
@twnfaem 4 жыл бұрын
I was trying to do some desktop automation with tools like pywinauto... It was h a r d. With pyautogui I achieved what I needed literally within 5 minutes... Thanks Al!
@aasutossh
@aasutossh 4 жыл бұрын
Beautiful talk.
@tannerbarcelos6880
@tannerbarcelos6880 4 жыл бұрын
I love python so much. So much to learn in it yet so much fun to learn. It’s simple, sweet, efficient and fun to use. I was so interested in front end but now I’m basically sold on being a backend with python or an engineer in general rocking python in my career
@PradeepChauhan17
@PradeepChauhan17 6 жыл бұрын
Wow! I have used selenium, but this is awesome stuff! Thanks!
@oliviageorge464
@oliviageorge464 4 жыл бұрын
Thank you Al for your videos, This was very helpful
@krishnanshudey3831
@krishnanshudey3831 5 жыл бұрын
U r awesome sir love that. Tnx for those all u done with python using selenium and pyautogui. It's help me a lot to get deep into python. Make more videos related this. I'll be greatful to you.
@dazhouliu9437
@dazhouliu9437 5 жыл бұрын
Great talk. A very interesting presentation.
@sameerk12982
@sameerk12982 6 жыл бұрын
Thank you very much for sharing such an informative and interesting video.
@newleontube
@newleontube 7 жыл бұрын
Great talk. There is an interesting live demo using MS Paint at time 17:30. Do not miss it.
@Officialjadenwilliams
@Officialjadenwilliams 6 жыл бұрын
I have installed Python and PIP correctly, all showing up in the CMD, updated and everything. Installed selenium using PIP, fully set and everything, even in the python folder, it's showing up. Though, after all of that, the python script does not run properly and shows this as the error message. Any help would be appreciated! Code > from selenium import webdriver driver = webdriver.Chrome() Error Message > Traceback (most recent call last): File "C:/Users/MyName/PycharmProjects/Test project/Test Script Selenium.py", line 1, in from selenium import webdriver ModuleNotFoundError: No module named 'selenium'
@thomasb2865
@thomasb2865 6 жыл бұрын
I assume that you are running Python 3.x As a mac user, I know that any command where you want to affect Python 3.x instead of saying python you say python3. So try running pip3 install selenium.
@sakshamkumar9191
@sakshamkumar9191 3 жыл бұрын
Amazing module! Al is awesome!!
@adamhollings7957
@adamhollings7957 4 жыл бұрын
Great demos
@aleksagordic9593
@aleksagordic9593 5 жыл бұрын
Nice talk! Thanks!
@michaelmclean2363
@michaelmclean2363 Жыл бұрын
I liek the attention to detail as well. Its my favourite part.
@magica2z
@magica2z 6 жыл бұрын
Your book is awesome.,.
@skimpylemon8034
@skimpylemon8034 Жыл бұрын
I would highly recommend his book, I bought it and its simple to follow and read.
@jeanchristophe15
@jeanchristophe15 3 жыл бұрын
Thank you Al!
@0x656e
@0x656e 4 жыл бұрын
I finished your book today it was one of the greatest book I've ever read, Thank you for this amazing book.❤❤❤
@connectingthedots5987
@connectingthedots5987 2 жыл бұрын
Bought his book. Have to start reading it.
@DigitalicaEG
@DigitalicaEG 5 жыл бұрын
Thank you, very helpful
@ronaldokun
@ronaldokun 6 жыл бұрын
AI is a great teacher. He teaches awesome programming to everyone, most wouldn't even be programming if it wasn't for him.
@veganath
@veganath 6 жыл бұрын
I use AutoIt to automate the boring stuff, but only for Windows and it can be used to scrape stuff from the internet as well, not to be underestimated one can also create fully fledged GUI's. To avoid mouse move/click and sorcerers apprentice phenomena autoit is able to locate Windows program controls and programmatically activate them.
@perryshos8439
@perryshos8439 7 жыл бұрын
Firefox 45 and Selenium 2.53.1 will work with auto-install. Took me two days to figure it out! Windows 10 Python Firefox.
@torque6389
@torque6389 4 жыл бұрын
Al is great!
@jeffreyl9829
@jeffreyl9829 6 жыл бұрын
AI is getting me really interested in learning Python.
@riazr88
@riazr88 5 жыл бұрын
Look I'm not the one to write replies or even reviews, but I can't help myself after discovering this man and reading your comment. I was on /r/python on reddit, looking into what resources were out there to start learning. I came across MITs OCW program and figured what a blessing...and MIT education for free. I went through about 3-4 lecture's before going back on the subreddit and came across someone mentioning his book "How to automate the boring stuff." If you've ever asked yourself where to get started on learning how to code, sign up for his course on Udemy. It's $10 if you use his discount code on www.automatetheboringstuff.com. If you are unable to afford that, you can read the text for free. He does move very quickly through the video's but he makes it SO easy to understand. What took me a week with the MIT course, I learned in a few hours with Al. I am amazed that this man is not the face of coding in general. Do yourself a favor this year and sign up, you will get lifetime access. I started today and am already halfway through his course. I never would have thought it was this easy nor would I be this intrigued. Thanks, Al.
@falseego99
@falseego99 4 жыл бұрын
python = plain english
@unlockwithjsr
@unlockwithjsr 4 жыл бұрын
It's the reason I program in Python
@punyashlokpurohit9734
@punyashlokpurohit9734 4 жыл бұрын
Same
@Zero11_ss
@Zero11_ss 5 жыл бұрын
Thanks for the free book, i lost my job so free stuff helps ^-^
@adammeziti9480
@adammeziti9480 4 жыл бұрын
This guy is AMAZING
@crenshawik
@crenshawik 4 жыл бұрын
nice video mate. thoroughly enjoyed it as well as your udemy course.
@WisomofHal
@WisomofHal 5 жыл бұрын
AMAZING!
@devloper4474
@devloper4474 5 жыл бұрын
I read the book and it is really a great python book, beginners should read it
@kuybrochebrey1153
@kuybrochebrey1153 7 жыл бұрын
I Like your video. Thanks you so much.
@abcdkousik1
@abcdkousik1 5 жыл бұрын
Master in programming..
@willman18696
@willman18696 Жыл бұрын
protect this guy at all costs!
@roberttillotson4889
@roberttillotson4889 4 жыл бұрын
Good presentation. You've made some great stuff. I've experimented a bit with pyautogui and I wanted to know if with displayMousePosition is it supposed to return Nan for the RGB values if you use it with extended screens in a two monitor setup?
@artaway6647
@artaway6647 5 жыл бұрын
Wow! he wrote the Automate the Boring Stuff! That's my favorite book, I don't think I'd be here if I didn't read that book haha.
@RomuloMagalhaesAutoTOPO
@RomuloMagalhaesAutoTOPO 3 жыл бұрын
Clear, concise, simple. Thank you.
@hazamakuro8174
@hazamakuro8174 6 жыл бұрын
You are amazing
@sssh024
@sssh024 6 жыл бұрын
Another Great GUI Programming tool:Sikuli
@jagadeeshakanihal
@jagadeeshakanihal 6 жыл бұрын
learnt a lot. really nice talk.
@mikeph712
@mikeph712 7 жыл бұрын
Now i can practice programming while playing games! will flash games :(
@rajeshn8533
@rajeshn8533 6 жыл бұрын
I done Webgui automation on 2014 it has been uploaded in KZfaq. Am expecting more and more flexible way.
@user-to1qg2tj8n
@user-to1qg2tj8n 5 жыл бұрын
Thanks
@Unregistered007
@Unregistered007 7 жыл бұрын
This guy is really awesome :)
@damiangrobler9135
@damiangrobler9135 7 жыл бұрын
Instructions for installing, for those who are beginning with pyautogui: Go to pypi.python.org/pypi and search for "pyautogui" from there download "PyAutoGUI-0.9.36.tar" then (if not already) drag to download files (easy way for me)from the left side of file explorer, then Left shift-right click on downloads then click on "open command window here" then type where you have your python file (bear in mind that it only works well on python versions that are 3.4 or lower) e.g C:/python27/Scripts/pip install py(press tab) then once the full name pops up ("PyAutoGUI-0.9.36.tar") press "Enter" on your key board, it should be installing/downloading from there(it usually takes a minute or two on a slow system) This is for windows but other users should get an idea of what they should do with this info.
@charlesparker6167
@charlesparker6167 4 жыл бұрын
Nice!
@BenjinaJenkinsky
@BenjinaJenkinsky 4 жыл бұрын
What a legend
@manjunagoudahombaradi4190
@manjunagoudahombaradi4190 4 жыл бұрын
Just felt happy by seeing below letter on your laptop. There is meaning for below letters. ಠ_ಠ. ಠ is one of the Consonant letter in Kannada Language.
@MaNoJKuMaR-gv4ex
@MaNoJKuMaR-gv4ex 6 жыл бұрын
How to install PythonAutoGui in Python 3+ (Anaconda environment)?
@voidskiz
@voidskiz 7 жыл бұрын
how would you search for certain information in a page source with sellenium? like an url
@davetaylor7664
@davetaylor7664 3 жыл бұрын
Started watching this & I'm reading the book without realising this is the author!
@JonathanRintala
@JonathanRintala 5 жыл бұрын
Cool!
@stephaniehartland6526
@stephaniehartland6526 6 жыл бұрын
Nice talk. As someone that works in QA my advice for anyone serious about automation would be to use or create your own framework. Simply automating a web browser with a few scripts is kinda...pointless really. And very tedious. I've never needed to automate a web browser for anything other than testing so perhaps I'm missing something here. If you're interested in web testing and automation I'd recommend researching the Page Object Pattern.
@stephenjackson5628
@stephenjackson5628 Жыл бұрын
Here's where you could automate personal web browsing: If you bank online and want to monitor your books without doing the majority of the work, you can create a file structure that would have an encryption key for your passwords to your bank accounts, that would then go to the different locations, find your expenses and plug them into a spreadsheet, providing an expense report for the month.
@MaxGoddur
@MaxGoddur 6 жыл бұрын
Bought Al's books for the simplicity and audience he addresses which is me, hobbyist. Don't want to be a programmer just looking for tools to make my life simpler and not in need of a semester to remember how I did something. My ideas are easy for me to formulate finding out if there is a way to carry out such an idea not so much. I am constantly storing away nuggets (URLs) for my review or as reference material, unfortunately, it is rather a labor-intensive to find them based on a simple search (of course unless I have missed some rudimentary method for doing so). There are times when I can not remember the names of the URL's in question but only basic parts of the subject matter embedded in the reference material. How does one go about this search with in ones bookmarks(where my nuggets reside)?
@ardram5296
@ardram5296 6 жыл бұрын
DoEs pyautogui can read values from desktop app based on objects available in app ?
@Aleph-Zero
@Aleph-Zero 6 жыл бұрын
I hope we can laugh at ourselves: 8:02 Good content!
@PerroConChaleco
@PerroConChaleco 5 жыл бұрын
can you use pyautogui with full screen applications?
@jomarnavarro7
@jomarnavarro7 7 жыл бұрын
very nice tool, but there's pywinauto that works directly on win controls.
@EuanBuch
@EuanBuch 7 жыл бұрын
PYwinauto is windows only. He wanted something cross platform.
@wangdadong
@wangdadong 7 жыл бұрын
It cool!
@vijayrajput3297
@vijayrajput3297 3 жыл бұрын
I also learnt python from this book.. 🤖 And today's I'm a python Django developer .
@VladSuperKat
@VladSuperKat 4 жыл бұрын
I think it can be usefull to trace pictures in illustrator from normal drawings using OPEN CV :D
@thegoatpear4209
@thegoatpear4209 5 жыл бұрын
Cool guy Learned python from his book
@kongzilla2897
@kongzilla2897 3 жыл бұрын
Nice :)
@anileapen9813
@anileapen9813 3 жыл бұрын
Very good video. I wanted to use Pyautogui to automate my desktop application. It works fine with pyautogui. I wanted to know how I can get the test results logged to a report or something with a Pass or Fail. I also like to know whether I can use a Test Framework for this using pyautogui. Thanks
@wackowyatt00
@wackowyatt00 6 жыл бұрын
If you Ctrl + Alt + Del then it will also stop the program, so in a way this is a hot key to stop all pyautogui programs too.
@lakhwinder108
@lakhwinder108 6 жыл бұрын
Grate demo by you. Can you resolve auto search multiple, word from checklist and highlight in word. And reverse check whole document against list and highlight in list. This will be most useful for researchers. Fro cross check this task manually takes many days for 500 pages. Your help will be much valuable to me and to the world.
@leestons
@leestons 4 жыл бұрын
Do it yourself.
@pahkapah9520
@pahkapah9520 4 жыл бұрын
what happens if i resize the apps afterward, can it still detect the button that i screenshot before?
@pritamsaha241
@pritamsaha241 5 жыл бұрын
Hi, i have been playing around with pyautogui and selenium with python and also completed an automation project for sap but i could not figure out as to how run the pyautogui script in background, that is I am unable to do some other activity while the script runs. Is there any solution?
@shyamjs3586
@shyamjs3586 4 жыл бұрын
Hii..sir how to work with function keys(f1,f2...etc) Please help me out with this.
@brijyotchawla3247
@brijyotchawla3247 5 жыл бұрын
PyAutoGui supports .Net applications ?
@mrkhan-rl2zo
@mrkhan-rl2zo 5 жыл бұрын
I got an WebDriverException how to fix it
@lancetschirhart7676
@lancetschirhart7676 3 жыл бұрын
I love his wallpaper. Bet he took that picture himself.
@rrrr-nu8ct
@rrrr-nu8ct 4 жыл бұрын
does puautogui still work? i just tried to do the thing he shows off at 14:50 but the pip install of pyautogui seems to be broken
@bluemushroom415
@bluemushroom415 6 жыл бұрын
How do you webdriver.Firefox without getting 10 million lines of error code?
@DavidLuu
@DavidLuu 6 жыл бұрын
Thought I'd mention this since this the talk covers browser and desktop - it would be nice to use same API/protocol to automate both cases. You can for some stuff on Windows with MS WinAppDriver. I would think it would make a better integration with Selenium to have a JSONWireProtocol wrapper for PyAutoGUI. Can based off my work for a similar Python tool: github.com/daluu/autopydriverserver
@berfbuggers1333
@berfbuggers1333 5 жыл бұрын
No matter what else was said, I can't get over how he pronounced it heighth at 23:43
@jonathanfriz4410
@jonathanfriz4410 3 жыл бұрын
...I' really like the attention to detail that programming required", and miss type Like as Liek, what a legend!!, pretty sure was on purpose.
@chriss2295
@chriss2295 5 жыл бұрын
Big fan. Be sure to checkout his KZfaq.
Я не голоден
01:00
К-Media
Рет қаралды 10 МЛН
Kind Waiter's Gesture to Homeless Boy #shorts
00:32
I migliori trucchetti di Fabiosa
Рет қаралды 2,4 МЛН
My Cheetos🍕PIZZA #cooking #shorts
00:43
BANKII
Рет қаралды 19 МЛН
I've Read Over 100 Books on Python. Here are the Top 3
9:26
Python Programmer
Рет қаралды 333 М.
PyScript is officially here!🚀 Build web apps with Python & HTML
17:10
Top 18 Most Useful Python Modules
10:50
Tech With Tim
Рет қаралды 927 М.
"Become an Excel Wizard Using Python Scripting" by Al Sweigart
55:52
Introduction to Web Scraping with Python and Beautiful Soup
33:31
Data Science Dojo
Рет қаралды 1,4 МЛН
Create Stunning Python GUIs in 10 Minutes With Drag & Drop
11:38
Coding Is Fun
Рет қаралды 45 М.
PyScript - Run Python in the Browser! THE END of JavaScript???
8:21
Patrick Loeber
Рет қаралды 365 М.
How to Automate Google Sheets with Python
19:24
JakeEh
Рет қаралды 5 М.
Я не голоден
01:00
К-Media
Рет қаралды 10 МЛН