Web Scraping with ChatGPT is mind blowing 🤯
Вставка
- Опубліковано 29 вер 2024
- Unleash the potential of web scraping with ChatGPT Code Interpreter in this all-encompassing tutorial. We dive deep into the nitty-gritty of extracting specific data from HTML files, using real-life examples from popular websites like Amazon and Glassdoor. Get a handle on identifying HTML elements, dealing with missing data, and exporting your results into a neat CSV file. We also touch on the crucial aspect of data verification and offer handy solutions for common hiccups such as data duplication.
This video is a treasure trove of insights and practical advice, perfect for data analysts with a wealth of experience or beginners just dipping their toes into the world of web scraping. So, come aboard and kickstart your web scraping adventure today!
Don't forget to like, comment, and subscribe if you find this video helpful. Let us know in the comments if you're interested in learning more about automating the scraping process or have any other topics you'd like us to cover. Stay tuned for more exciting content. Until next time, happy scraping
#WebScraping #ChatGPT #DataExtraction #HTML #DataAnalysis #OpenAI #DataScience #MachineLearning #AI #Python #Coding #Tutorial #BigData #DataMining #WebCrawling #DataCollection #DataCleaning
How would you handle scraping dynamically generated websites?
Looking to scrape a website with infinite scroll. Any help ?
Great info & useful !
Hi, very interesting. Am looking for an option to scrape profile information from approx. 90k profiles from Linkedin.
Any thoughts I could "transfer" your example to a Linkedin scraping?
this is interesting
Web scrapping while saving page to your hard drive is kind of misleading, don't you think?
- Save the webpage you want to scrape data from. 0:41
- Upload the saved webpage to Chat GPT using the upload button. 0:55
- Frame a clear and direct prompt for Chat GPT to extract the desired data. 1:08
- Download the CSV file provided by Chat GPT containing the extracted data. 1:59
- Modify your request to Chat GPT if additional data extraction is needed (e.g., product links and ratings). 2:19
- Provide Chat GPT with examples if specific data is not being retrieved correctly. 2:58
- Instruct Chat GPT to correct any errors in the data extraction process (e.g., incorrect segments in product links). 3:34
- Execute a bit of code to automate the process for scraping data from multiple pages if needed. 4:19
- Investigate the structure of URLs for websites with multiple pages to facilitate automated data extraction across all pages. 5:47
- Utilize a programming environment like Visual Studio Code to execute the code provided by Chat GPT for automated data scraping. 6:29
- Adjust the code as necessary to scrape data for the correct number of pages/sites you're targeting. 7:18
Legend
What if you want to scrape all products in a certain search term, instead of on a certain page.
Very interesting, thank you. Why is it neccessary to first download the web page? Is ChatGPT not able to retrieve the data directly from the web page?
this is incredible! more scraping videos with ChatGPT please!
I don't believe in it's accuracy. I won't go for that
Scrape skool community group members data with name and LinkedIn
Bless it digital heart ❤😂
A wonderful video that we've used as a reference for our recent additions. Your sharing is highly appreciated!
Can we do the same using OpenAI, like we provide the prompts, let's say "Which phone having best rating" after providing the webpage url, it will crawl the data from website and produce the output?
Amazing, more please
why did you start with amazon and didnt finish the whole process?
I think you need to use some service to change your IP address as Amazon probably blocks extensive web scraping.
is it possible to scraping other language website like hindi , Japanese, or other language ?
Very interesting! In your quote example, what would you do with that info?
this is very useful straight to point
Amazing 🎉thank plz more
The bear is strong on this one...good job
Does this data update itself?
Sweeeeet! Thanks for real!
Better than bright data ❤
Killed it…”Teaching others knowledge in the “show” of life, really show’s true character and that character just so, happens to be the producer, writer, and main lead not only in their life, but the lives of others and that’s why teaching others is the purest thing on earth and is the key to true happiness”