Selenium Browser Automation in Python

Рет қаралды 208,320

Жыл бұрын

In this video, we learn how to automate website interaction using Selenium in Python.
◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾
📚 Programming Books & Merch 📚
🐍 The Python Bible Book: www.neuralnine.com/books/
💻 The Algorithm Bible Book: www.neuralnine.com/books/
👕 Programming Merch: www.neuralnine.com/shop
🌐 Social Media & Contact 🌐
📱 Website: www.neuralnine.com/
📷 Instagram: / neuralnine
🐦 Twitter: / neuralnine
🤵 LinkedIn: / neuralnine
📁 GitHub: github.com/NeuralNine
🎙 Discord: / discord
🎵 Outro Music From: www.bensound.com/

Пікірлер: 141

@alex59292 Жыл бұрын

(pin this) you can use sellenium undetected driver since most websites detect normal selenium, this uses your normal chrome and not fresh private chrome

@okrq Жыл бұрын

How do you do that

@coding1806 Жыл бұрын

@@okrq fcking go make research

@krishlorend.sinevasan6945 11 ай бұрын

how?

@tangoalpha1905 9 ай бұрын

I have been searching around trying to find a solution for this. Someone come and bless us with the knowledge!

@ImTheRealCam 4 ай бұрын

You do know it’s so easy to search pip’s for python… btw the thing you 3 have been looking for is selenium_stealth.

@garyhottinger7384 Жыл бұрын

Excellent! Clear and concise. I just retired and can't wait to see if I can automate some of my hobby web work.

@knalsgtes6684 10 ай бұрын

I have search so many tutorials on selenium as reference for our automation project,, and this is the best ever tutorial.

@koupohroyandredavid2639 3 ай бұрын

the best ever

@TH-nl1sb Жыл бұрын

I always had a difficult time finding the right HTML elements by myself. I wish I had known you earlier. I will continue to watch all your videos. Thank you! You are a great teacher!

@knalsgtes6684 10 ай бұрын

same here

@suavisgiramata8802 8 ай бұрын

He is a very good teacher!!!

@imanthiu Жыл бұрын

I learned a great deal from this video. It didn't help me do what I was I looking for but I always like learning new things.

@neatcomrade8537 Жыл бұрын

Dude! this video is exactly what i needed! thank you!

@ibrahimib9020 Жыл бұрын

thanks man... it helped me a lot. I was starting to learn this but cannot find the right syntax to view the page. but this worked for me

@lamar2658 Жыл бұрын

Hey if you could do a video on XPATH and maybe the professional ways to load and sync tabs that would be great! Very helpful and useful video!! Going to use this for sure! Thanks

@Delirium132231 Жыл бұрын

For selenium users: Action Chains is a nice discovery for those who didn't know before. Ofcource if FrontEnd developer was a nice guy

@ghefley Жыл бұрын

Well done and thank you for sharing this.

@heyalejandro175 Жыл бұрын

So cool...thank you very much for this...Yes an XPATH video would be amazing! Thanks again!

@mr_cupcakes1808 3 ай бұрын

bro's teaching is awesome thank you!

@Relderf Жыл бұрын

What a professional video, neat.

@HAInett Жыл бұрын

that is what I needed :)))) thank you so much

@ucxanguyen2395 Жыл бұрын

What a great video. Super well explained, thanks! Any video in your channel on how to record yourself with soft soft? I'm under the

@nabilpro1662 Жыл бұрын

The best as normal ❤

@mkhadka123 Жыл бұрын

This is nice to get a kick-off

@DKMRFCBrlz 6 ай бұрын

Amazing video!

@mehdismaeili3743 Жыл бұрын

Excellent, thanks.

@JacobJavor Ай бұрын

Thank you, was good introduction

@soumyaranjandash3597 10 ай бұрын

Thanks this is helpful 🔥

@pruzylo Жыл бұрын

Perfect video length.

@codehokage1977 Жыл бұрын

Question when finding the "7 in 1" button why don't you just copy the xpath off the inspector tool?

@fakhruddindahodwala6816 Жыл бұрын

How were you able to format the html elements in your output terminal window? i get all the characters showing up line by line

@sonerkocak5058 Жыл бұрын

Thank you! I am your fan❤️🫣!

@faridalijani1578 Жыл бұрын

are u running Chrome as administrator or user in ur machine? I open the browser but nothing is shown and it crashes after a while! I use conda btw

@sever5859 Жыл бұрын

Interesting video

@JontheRippa 11 ай бұрын

Wow thank you 👍

@doudline2662 8 ай бұрын

Thank you sir.

@Vibeness1 Жыл бұрын

why use xpath to find the object names instead of e.g. EC.text_to_be_present_in_element ?

@jw200 Жыл бұрын

thanks, subbed.

@thefunnyvlogger8218 Жыл бұрын

Please can you tell me which framework we are using here?

@xxjblexx Жыл бұрын

I Hope You Do A Video On XPATH Asap... That is The Core in Selenium Library To Find And Search Elements

@petrokey Жыл бұрын

Hello, can you please advise on classic web scripting on python? Any resource or link..

@karlybyrd1551 6 ай бұрын

I apologize if this is a dumb question, but why would you not just search for the link you're trying to find instead of searching for the link inside the correct div? That seems like an extra unnecessary step that just led to finding the link anyway.

@mrrl37 Жыл бұрын

Thank you

@amerismartin2854 11 ай бұрын

How do I make selenium open default chrome profile? Or desired chrome profile?

@ToobaNaseem-pe7kn 24 күн бұрын

please guide us how can i automate the process of connect wallet(metamask). in my chrome browser i have installed metamask extension while in the process of automation, automated chrome driver do not have wallet extension. please guide us regarding this process.

@freecreator6426 4 ай бұрын

I applied one by one, but when clicking "run" it says that the module is not defined. Tried many times.

@GabrielAGilO 3 ай бұрын

do ahve you encounter this error before "NoSuchWindowException: Message: no such window: target window already closed from unknown error: web view not found" I have try to put many URLs but I keep getting the same error. i have looked only and I thought by adding the Service and Options would work but it did not, Any help

@musicarroll Жыл бұрын

I think your selenium tutorial became an XPath tutorial.

@swordart802 Жыл бұрын

i want to use in real browser not in chormedriver how can i when i tried it doesnt get the url after browser opened

@hesam8845 Жыл бұрын

how can I scrape google map to get contact info in specific city?

@RocketLR Жыл бұрын

Aah wish i found this earlier. Had a site that needed java script render for the tables to get populated with the data.. The online solutions did not work for some reason.. Got a bunch of chromium errors and stuff.

@ArneSchwarck Жыл бұрын

Do you know why even if detach is true the chrome window will close if a KeyboardInterrupt is sent in the Terminal window?

@jamievercetti 10 ай бұрын

is there a more explanatory version of this video

@szwyr8380 Жыл бұрын

Why don't you just click the element to get the copy of the xpath ?, i mean u just right click on the div tag or another tag and then copy the xpath... Or it would be a better way to just read on the inspect element ??? Because i new to this and didn't understand about this xpath things

@your_butter_chicken 6 ай бұрын

Hi, how to capture Screenshot in this new selenium IDE? Pls help :)

@jamesmoisesllalleperez3079 8 ай бұрын

y si quisiera que guarde información en la misma página?

@aleterra 10 ай бұрын

is there any way to solve the captcha?

@66abady Жыл бұрын

thanks man. I really wanna know if we can use this method when we don't have a browser installed. lets say if I was to deploy this script on a sever.

@codaq4043 Жыл бұрын

Yup, you need to make it headless and host the script on aws

@truealpha718 Жыл бұрын

+1 subscriber____thanks a lot

@ShahzadAli-zr4ro Жыл бұрын

you are great teacher of this century on youtube please let me know if anything i can do for you

@philtoa334 Жыл бұрын

Nice_very.Nice

@madalinam5418 Ай бұрын

how can you deploy it and run recurrent on a server?

@TestSubject-ik4oq 3 ай бұрын

For the site i am trying to do i get handshake failed

@hansilsepp 10 ай бұрын

Es scheint, dass es ein Problem mit dem Webdriver-Manager gibt, der versucht, eine nicht vorhandene Version des ChromeDrivers herunterzuladen. Ich habe Chrome 117.0.5938.92 gibt es da eine Lösung?

@isro3085 Ай бұрын

Hab auch das Problem, hast du es lösen können?

@hansilsepp Ай бұрын

bin mir nicht ganz sicher, ob das die lösung war oder ob ich das problem nicht lösen konnte: man kann den webdriver auch sonst manuell ohne das managermodul von python instllieren (exe herunterladen), link der website weiss ich leider nicht mehr, allerdings muss man das nach ca. 1/2 Jahr immer wieder manuell update (neuer driver installieren)

@Zhacker0927 10 ай бұрын

I got error WebElement object is not iterable > help please!

@humpalestine 10 ай бұрын

It would be better if you share the python script you are describing.

@robertharrison1601 Жыл бұрын

As in QUORUM of NINE¿?

@adisonfryman144 Жыл бұрын

OK why do you put the install in there, I just ran this code and got .....Downloading: 100%|██████████| 6.79M/6.79M [00:00

@adisonfryman144 Жыл бұрын

also the window did notstay open

@aswathvanan3833 Жыл бұрын

make video on pupeteer

@guilherme5094 Жыл бұрын

👍

@BrickToTheHeadOfficial Жыл бұрын

i installed selenium and its in my scripts folder for python and everything but i keep getting "ModuleNotFoundError: No module named 'selenium'"

@Vkdride 8 ай бұрын

i have same issue

@awadecoco12 6 ай бұрын

its because you are dowloading it in another interpreter

@wėb3ĆryptO51 7 ай бұрын

Which code editor are you using?

@awadecoco12 6 ай бұрын

pycharm

@neatcomrade8537 Жыл бұрын

also how do i get past the captchas?

@tinaperry8632 Жыл бұрын

I don't have a good answer to this. The only option I know of is to use a service that gets frelancers to solve the chptchas for you. But idk how to do that it also matters what type of captcha you get/are talking about plus since it's an arms race something that might work now might not in the future, atleast untill ai gets so powerful it can pass as a human in basically an situation if it does get to that point. The easiest capcha is the one you just click with no pictures or audio or math (yes i have seen a captcha that uses math) or anything else and it will accept or denie your request based on your browser activity and mouse movment.

@tulasisanjay 8 ай бұрын

How can I automate the process of claiming Binance Crypto Boxes on their webpage using code extracted from Telegram?

@tulasisanjay 8 ай бұрын

Make video please 🙏

@kwameappiahkumi5833 Жыл бұрын

Does selenium work only on Google Chrome❓

@mkhadka123 Жыл бұрын

no it has drivers for other popular browsers as well e.g. geckodriver for firefox

@sonerkocak5058 Жыл бұрын

Will there be an Instagram entry in the next video?

@CanlDersler10SnfPrivate Жыл бұрын

Selam

@sonerkocak7392 Жыл бұрын

@@CanlDersler10SnfPrivate selam

@bhasim4299 Жыл бұрын

Chrome driver didnt work, but firefox did. just saying

@user-uw5qc5vq6w 5 ай бұрын

Which platform is that in which you are coding??

@browserautomate 4 ай бұрын

PyCharm

@qutaibabs1 5 ай бұрын

which IDE you are using ?

@santisanchez4413 4 ай бұрын

pycharm

@nouhailafarajy6475 5 ай бұрын

hllo can we use selenium for downold file pdf from gmail and tnx in advance

@browserautomate 4 ай бұрын

yes

@Vkdride 8 ай бұрын

I get attribute error: none type object has no attribute split

@browserautomate 8 ай бұрын

embed code

@bilalsadiq6995 26 күн бұрын

what is the software name you run sofware

@unveiling_visuals 18 күн бұрын

Pycharm I think

@waljoshamarsphost6820 9 ай бұрын

Why not simply copy the xpath of the element?

@browserautomate 8 ай бұрын

ui vision is also easy

@ultraracer Жыл бұрын

damnn

@nikolinawillette9849 Жыл бұрын

I followed all the steps, but the browser still shut down 2 seconds later. What could be the problem?

@notoriousfly9260 Жыл бұрын

13:00

@ultraracer Жыл бұрын

@NationalistsRuinAmerica Жыл бұрын

Nacho?

@joshuaoliverantony138 4 ай бұрын

ModuleNotFoundError: No module named 'webdriver_manager'

@browserautomate 4 ай бұрын

its missing lib 'webdriver_manager' so just run before pip install webdriver_manager

@browserautomate Жыл бұрын

if anyone have issue with bot detection i can solve your issue

@mohamedelhousany4960 10 ай бұрын

share the script

@timothyo718 Жыл бұрын

Was German your first language? You don’t seem to have any accent whatsoever.

@chickenrage940 8 ай бұрын

doesn't work anymore.

@browserautomate 8 ай бұрын

specify your problem?

@chickenrage940 7 ай бұрын

@@browserautomate thanks, but i worked it out. it still works, but I didn't have chrome installed. after i installed chrome, it works again.

@abulfazhasanov2100 8 ай бұрын

Everything is ok. But why you talking like you have something in your mouth

@poornachanduchalla5651 Жыл бұрын

I am getting this error "Message: unknown error: cannot find Chrome binary" Could u tell me what to for this @NeurallNine

@firstandlast4435 Жыл бұрын

I don't know. My browser just closes right after finishing script. I use from selenium.webdriver.chrome.options import Options chrome_options = Options() chrome_options.add_experimental_option("detach", True) browser = webdriver.Chrome(service=Service(ChromeDriverManager().install()), options=chrome_options) but it doesn't help at all

@buzzark9133 Жыл бұрын

Same, and no matter what I do it always closes after whatever script i put down. If you find a solution please let me know.

@buzzark9133 Жыл бұрын

Hey i just found a solution, let me know if you wanna hear it

@firstandlast4435 Жыл бұрын

@@buzzark9133 it'd be nice)

@firstandlast4435 Жыл бұрын

@79_22_16 M for now i found that you can place infinite loop after code, so your script won't be finished and browser won't close, but that's definitely awful decision)

@buzzark9133 Жыл бұрын

@@firstandlast4435 ^ you too, check the reply above

@browserautomate Жыл бұрын

if anyone have issue with bot detection i can solve your issue

@vemulapraneeth6975 Жыл бұрын

i need ur help

@browserautomate Жыл бұрын

@@vemulapraneeth6975 hi

@vemulapraneeth6975 Жыл бұрын

@@browserautomate how to bypass bot detection

@browserautomate Жыл бұрын

@@vemulapraneeth6975 pic me about from my channel