How To Parse Data Scraped from SCRIPT tags
Вставка
- Опубліковано 3 жов 2024
- Grab IPRoyal Proxies with a 30% discount while it lasts! Click here to find the 30% off coupon code: 03:37 Find out more at iproyal.club/JohnWatsonRooney
It's easy to get carried away and forget to check all the obvious signs that the data is right there for you.. this video demonstrates the web scraping method of parsing information from inside the script tag on the page.
This is usually passed into the HTML by the JavaScript framework.
github.com/Nyk...
github.com/jhn...
Scraper API www.scrapingbe...
Patreon: / johnwatsonrooney
Donations: www.paypal.com...
Proxies: iproyal.club/JohnWatsonRooney
Hosting: Digital Ocean: m.do.co/c/c7c9...
Gear I use: www.amazon.co....
Omg your channel is by far one of the rare channels that doesn't have a 40 min intro! Thank you so much for the amazing content ❤
thanks i appreciate it!
Binge watching your videos and it's great to watch you transition around from VS code/Windows/Pycharm to NeoVim/Linux/Some sort of window manager as well. Don't tell me you are a Arch user as well?
Haha thanks… but no not arch. It’s Ubuntu with i3 and basic customisation. I couldn’t live without i3 now
This is awesome
Thanks for start point. it does not work for me. What i did is I got indexes of [ ] (square brackets) and cut off all symbols before and after and with json.load(text_which left) got valid json. Maybe somebody will use it too.
Thats great, i have just one request can you make a video on how to switch frames in between for e.g Take html response data from a popup window using selenium
Thanx John for sharing this👍I wish I will remember about this when I will need it😉
Thank you, John!
Thank you very much! Appreciated!
What should we use instead of try: except ?
Sorry i should have been more clear - of you use try/except make sure you handle the specific error (key error etc) rather than just “pass”
@@JohnWatsonRooney 🙏
I'd probably just check if script.text() == "" (or None, idk if .text() returns None or an empty string) and then continue to the next iteration
Great tutorial. Thanks!
Very nice solution .
Thank you! Cheers!
Iam getting error when installing chompjs
How to earn money from python web scraping
2:01 Reminder for you @JohnWatsonRooney (I forgot 😅)
And thanks for this tutorial!