This Channel is soo underrated, all the support and love

Best channel I came across. Period!

This is absolutely brilliant - I did not realize you have the HTML parsing as part of importing only HTMLSession from requests_html. One little tip - You can make it even more concise and still readable by reducing the last four lines of code to a single line list comprehension: asins = [product.attrs['data-asin'] for product in products if product.attrs['data-asin'] != ' '] Cheers!

Lovely explanations from this channel... keep going.

I like your vim setup

Thanks Dear John 👏

Awesome video, keep up the amazing work! :)

Amazing video ! Great work !

Great work mate, glad to see consistent material I can come to and learn from such a great teacher. I don't know if I've been very vocal over the last several months on here letting you know how much I really appreciate your videos but they have helped me along my Python journey SO much.. I have a request, and I do apologize if this has already been covered but I am working within Scrapy and am curious how you use the middlewares.py for proxies? Switching IP addresses so not to get blacklisted and such. Your latest video on user-agents was very cool and I am currently on a project for bypassing reCaptcha v3 which is a whole other game I am assuming lol But for now the proxy thing in Scrapy I think would be very cool.... If you are looking for suggestions, Thanks again mate! Looking forward to more amazing content

Best ever. Keep it up

this a good tutor i love it, thank john

Have you tried combining the requests library with NLTK? I recently tried the newspaper3k library and it's a joy to use.

Hey John! As always, fantastic video... I'm curious as to what interesting analyses I can do with some of the webscraping data i've collected... other than opening it up in Excel and sorting them through using the basic in-built tools and functions in there. Perhaps, that's an idea to consider for a future video? Cheers!

Hi, John. Congratulations for the video, is very good. Did you try scrap many ASIN's in a short time or something? Can Amazon block the requests? Thank you for the video.

please makes videos to solve captcha and pagination websites to scrape for beginners

Awesome. Thank you very much.

Hi John, thank you for the great content! Regarding the blank ASINs. In my own code I find blank ASINs to be from not yet rated products- which seems to be in line with the code you posted as well. A close look at the html shows that these not yet rated products do have an ASIN but seem to not be included in the content from the request. Just wanted to ask if you or anyone subscribed may have had success in having these ASINs included in the parser. Thanks!

Hi John, thank you for the great content! . I'd like to know how can I get "Monthly Sales".. Do you have any idea ? Thanks bro I'm from Brazil :)

Hey. I have an issue wit the line r.html.render(sleep=1)Traceback (most recent call last): File "/mnt/c/Users/Thomas/Desktop/scraper/scraper2.py", line 8, in r.html.render(sleep=1) File "/home/thomas/.local/lib/python3.9/site-packages/requests_html.py", line 586, in render self.browser = self.session.browser

Whenever writing the code, in the output it comes "ModuleNotFoundError: No module named 'request_html'

Is there any other alternative library for "requests_html.HTMLSession"? in my windows machine I am not able to use it.

Is there any chance to combine scraping javasciript pages, that need to be rendered with concurrent.futures? Everytime I try so, my skript does not continue after the rendering. In a for loop it works

Hi John. Hope you are doing well. Can you please tell me how to get just 1st asin that matches our search?

Actually I saw your video on web scraping a shopify website and I can create my own patterns from that. Now I am just looking if there are similar way to create some pattern with a website made with prestashop

Error in line r.html.render(timeout=20) pyppeter.error.TimeoutError: Navigation Timeout Exceeded: 8000 ms exceeded. Please help soon.

Great tutorial. I tried your code out from Canada and for some reason when I Inspect a product Element I don't see an exact rendering as yours and thus I get no results in running the code. However, the div data-asin elements show up when viewing the Source page. How do I work the Page Source data into the code?

I always get trouble with pyppeter in this render thing. I use miniconda and Python 3.9.1, it keep said, render time too long. Maybe I should try await.

This is nice video. How to scrape all of information amazon .

can you make a video shows how to scrap products ranks and title at amazon best sellers pages

Hi John! Been studying your vids for the past several days, great content! I'm wondering if there is a way to deal with a page with a "read more" modal using requests-HTML. I'm looking for something to replace the .click() function in Selenium. Unfortunately, the modal I'm working with doesn't open a new url, it just adds a div to the page, and so it's impossible to retrieve a full description without clicking "read more." Any ideas?

Hey John. Is there some patterns we can use to scrape a website made with prestashop and shopify? Thanks

Great video as usual! (pls check code on github)

h thanks great content man how we can create a post on Facebook using this libraby?

how to scrap the title and price along with the asin as well?