How to Scrape 4 Sites with 1 Script (code along)

Check Out ProxyScrapy here: proxyscrape.com/?ref=jhnwr
➡ WORK WITH ME
johnwr.com
➡ COMMUNITY
/ discord
/ johnwatsonrooney
➡ PROXIES
proxyscrape.com/?ref=jhnwr
➡ HOSTING
m.do.co/c/c7c90f161ff6
If you are new, welcome. I'm John, a self taught Python developer working in the web and data space. I specialize in data extraction and automation. If you like programming and web content as much as I do, you can subscribe for weekly content.
⚠ DISCLAIMER
Some/all of the links above are affiliate links. By clicking on these links I receive a small commission should you chose to purchase any services or items.

[@mainakseal5027]

can you scrape some complex websites using scrapy that require maybe clicking SSO button to login and stuffs? thanks for the videos tho! learnt a lot

[@899]

Just found your channel. Can’t wait to take a deep-dive. I have been automating and scraping for 20+ years and I’m hoping joining a community will step up my game into the future. Looking forward to learning w/ you.

[@JohnWatsonRooney]

Thank you and welcome in!

[@georgeciolac7789]

Can you do a video using fuzzywuzzy scrapping 3 websites saving results in csv/json and merging results in one csv/json from each website using 2 columns from each csv/json as merging criteria?

[@mariss622]

Hi. Can you show how to scrape dynamic web tables where figures (prices and order volumes for example) are toping up in columns? How to extract this data to excel, so I could sum up figures and do analysis..?

[@domenechj]

Great video as always!Have you tried crawlee for Python?

[@JohnWatsonRooney]

I haven't - is it worth looking at? have you tested it?

[@naradakandawala4278]

Awesome!

[@JohnWatsonRooney]

Thank you! Cheers!