How To Parse Data Scraped from SCRIPT tags

Поділитися
Вставка
  • Опубліковано 3 жов 2024
  • Grab IPRoyal Proxies with a 30% discount while it lasts! Click here to find the 30% off coupon code: 03:37 Find out more at iproyal.club/JohnWatsonRooney
    It's easy to get carried away and forget to check all the obvious signs that the data is right there for you.. this video demonstrates the web scraping method of parsing information from inside the script tag on the page.
    This is usually passed into the HTML by the JavaScript framework.
    github.com/Nyk...
    github.com/jhn...
    Scraper API www.scrapingbe...
    Patreon: / johnwatsonrooney
    Donations: www.paypal.com...
    Proxies: iproyal.club/JohnWatsonRooney
    Hosting: Digital Ocean: m.do.co/c/c7c9...
    Gear I use: www.amazon.co....

КОМЕНТАРІ • 22

  • @2ru2pacFan
    @2ru2pacFan Рік тому +9

    Omg your channel is by far one of the rare channels that doesn't have a 40 min intro! Thank you so much for the amazing content ❤

  • @skandashaktis
    @skandashaktis Рік тому +3

    Binge watching your videos and it's great to watch you transition around from VS code/Windows/Pycharm to NeoVim/Linux/Some sort of window manager as well. Don't tell me you are a Arch user as well?

    • @JohnWatsonRooney
      @JohnWatsonRooney  Рік тому +2

      Haha thanks… but no not arch. It’s Ubuntu with i3 and basic customisation. I couldn’t live without i3 now

  • @prohacker5086
    @prohacker5086 11 місяців тому +1

    This is awesome

  • @MsAdmin32
    @MsAdmin32 6 місяців тому

    Thanks for start point. it does not work for me. What i did is I got indexes of [ ] (square brackets) and cut off all symbols before and after and with json.load(text_which left) got valid json. Maybe somebody will use it too.

  • @mandarraut9565
    @mandarraut9565 Рік тому +2

    Thats great, i have just one request can you make a video on how to switch frames in between for e.g Take html response data from a popup window using selenium

  • @graczew
    @graczew Рік тому +1

    Thanx John for sharing this👍I wish I will remember about this when I will need it😉

  • @mihailazarescu1297
    @mihailazarescu1297 Рік тому +2

    Thank you, John!

  • @Yagnik_Sojitra
    @Yagnik_Sojitra Рік тому +1

    What should we use instead of try: except ?

    • @JohnWatsonRooney
      @JohnWatsonRooney  Рік тому +3

      Sorry i should have been more clear - of you use try/except make sure you handle the specific error (key error etc) rather than just “pass”

    • @Yagnik_Sojitra
      @Yagnik_Sojitra Рік тому +1

      @@JohnWatsonRooney 🙏

    • @JustSomeAussie1
      @JustSomeAussie1 Рік тому +1

      I'd probably just check if script.text() == "" (or None, idk if .text() returns None or an empty string) and then continue to the next iteration

  • @СаняСаня-з2т
    @СаняСаня-з2т Рік тому

    Great tutorial. Thanks!

  • @CrYpt001
    @CrYpt001 Рік тому +1

    Very nice solution .

  • @hariniavula5748
    @hariniavula5748 Рік тому

    Iam getting error when installing chompjs

  • @maxee5908
    @maxee5908 Рік тому +1

    How to earn money from python web scraping

  • @silkogelman
    @silkogelman Рік тому

    2:01 Reminder for you @JohnWatsonRooney (I forgot 😅)
    And thanks for this tutorial!