Web Scraping with Node.js and Cheerio

Поділитися
Вставка
  • Опубліковано 7 лис 2024

КОМЕНТАРІ • 60

  • @hellfishii
    @hellfishii 3 роки тому +1

    My left ear is very well documented now thx for the content.

  • @newcode7847
    @newcode7847 2 роки тому

    Hello James, great tutorial. Helped me to build an API that scrapes news from a certain webpage. Thank you !

  • @0xbitbybit
    @0xbitbybit 4 роки тому

    Hooray! First video or guide that ACTUALLY worked for me! Thank you!

  • @k.t.1594
    @k.t.1594 4 роки тому

    2 min on the video and you are so good at explaining to beginner what is all about awesome.
    Subscribed

  • @carlossouza94
    @carlossouza94 3 роки тому

    Very good!! I have a question ... In the description field, you didn't get the full text and the word "more" was added. I would like to know how to get the full text? Please!!

  • @GeraldTrost
    @GeraldTrost 2 роки тому

    looks fine
    I need some DPMParser to load the html and to enable me
    querySelectorAll() - dom syntax instead of jquery syntax.
    Any Ideas?
    thx, Gerald

  • @vieirapereira1298
    @vieirapereira1298 2 роки тому

    what theme in vscode turns the functional => to a arrow ? rly liked that!

    • @JamesQQuick
      @JamesQQuick  2 роки тому +1

      Font ligatures. You can get them with certain fonts like cascadia code which is free

  • @ryan_roga
    @ryan_roga 2 роки тому

    If I have some data to scrape from (what I'm going to incorrectly term) "child pages", is there a way to click into each blog post to, say, get a table of data from within each page? Maybe the preview doesn't show the table, so you'd have to click into each post to get to the table for each. Is that doable?

  • @PodDropBits
    @PodDropBits 2 роки тому

    I had to put up the volume for this one and listen real closely with my left ear hah!
    hey James can you do a part 2 of this where you use package puppeteer to crawl the entire site?

    • @JamesQQuick
      @JamesQQuick  2 роки тому

      Yeah audio is messed up sorry!

    • @PodDropBits
      @PodDropBits 2 роки тому

      @@JamesQQuick Yea its all good- and to my question, can you do a part 2 of this where you use puppeteer or something to crawl the entire site?

  • @MichaelRubillo
    @MichaelRubillo 4 роки тому

    Great video. Thank you. QQ though. This maybe a newbie question but I need to login to the website before I can get to the data I need. How do you enter a username and password on a page then then click on the submit button?

  • @hawaiian_guy
    @hawaiian_guy 3 роки тому +2

    Great tutorial thank you! What do you do with that data on the terminal? Is there a chance to automate the scraping and sending the values to our HTML page?

  • @chrisconnelly6742
    @chrisconnelly6742 4 роки тому

    As always a killer tutorial my dude! Much appreciated

  • @cokhikmah2082
    @cokhikmah2082 3 роки тому

    is it possible to scrape with class='ml-item' because my js said wrong when I type ml-item (variable)
    thanks

  • @wuanimator
    @wuanimator 5 років тому +1

    Amazing video, I've been through a few and I didn't get it until now!

  • @MaxOnMaxxer90
    @MaxOnMaxxer90 4 роки тому

    Great video James, thumbs up!
    I do have a question: how would you implement this in an http request of a callable function ? Then i can deploy it to a firebase cloud function and whenever I go to the link of the floud function I see the scraped information (using what you explained in this video) that I need. Thanks if anyone can help!!

  • @Qors1314
    @Qors1314 4 роки тому

    Nice tut, clean!

  • @bridanig
    @bridanig 5 років тому +2

    Thank you ! Detailed and Succinct! ❤️

  • @sumitshelar25
    @sumitshelar25 3 роки тому

    when I want to export data in csv format comma " , " in any text create issue with csv format how to fix this?

  • @ZTF666
    @ZTF666 4 роки тому

    Thank you , that was very informative!

  • @caizza3
    @caizza3 4 роки тому

    My left ear enjoyed that

  • @eltrolado5764
    @eltrolado5764 2 роки тому

    my left ear enjoyed this tutorial

    • @JamesQQuick
      @JamesQQuick  2 роки тому

      hehe yeah i botched the audio for that one

  • @tdq1r
    @tdq1r 2 роки тому

    Thank you very much

  • @wxIyz
    @wxIyz 4 роки тому

    Excellent, thank you!

  • @hellfishii
    @hellfishii 3 роки тому

    18:49 Almost 2 years and yes the html of ur page changed :)

  • @greendsnow
    @greendsnow 2 роки тому

    I don't know jQuery...

  • @emptymeta5849
    @emptymeta5849 3 роки тому

    document.querySelector(".talk") doesn't show a talk class,
    Has website been updated since then?
    following along but with .card class
    i use this for now
    ```
    $("div.card--content").each( (index, element) => {
    console.log("------ELEMENTS------
    ")
    console.log($(element).children().first().text());
    } )
    ```

    • @JamesQQuick
      @JamesQQuick  3 роки тому

      Yes I’ve made some changes :) looks like you’ve got it figured out

  • @Wael100
    @Wael100 5 років тому

    Thanks, buddy I really appreciate your knowledge and, efforts. Could you please share with me your VScode theme :)

    • @JamesQQuick
      @JamesQQuick  5 років тому +1

      Thanks :) and I use cobalt 2

    • @JamesQQuick
      @JamesQQuick  5 років тому

      @@Wael100 Whew, interesting idea. When you say first 10 pages, are those different html pages? You'd have to query each one of those individually. From there, you can probably just do a string replace to replace the specific word with that word and a color. THat make any sense?

  • @elninomalabiga9631
    @elninomalabiga9631 4 роки тому

    Thank you very much sir!

  • @msdhaliwal
    @msdhaliwal 4 роки тому

    saved the day, thanks man!
    sub++

  • @lijemmu4417
    @lijemmu4417 4 роки тому

    thank you sir

  • @Rynxie
    @Rynxie 3 роки тому

    man your voice is stereo but using one channel that is tilting

    • @JamesQQuick
      @JamesQQuick  3 роки тому +1

      Unfortunately I messed up the audio on this one. Sorry about that

  • @JavierCarrion
    @JavierCarrion 5 років тому

    No audio my man. Where is my sticker?

    • @JamesQQuick
      @JamesQQuick  5 років тому

      Not sure you mean by either one of those comments?

    • @JavierCarrion
      @JavierCarrion 5 років тому

      James Q Quick I apologise it must have being an issue with my old iPhone iOS I was not getting any sound for this video and now it works. Great video by the way!!

    • @JamesQQuick
      @JamesQQuick  5 років тому +1

      @@JavierCarrion Glad you got it figured it out! You scared me for a second :)

    • @raymondkhessel889
      @raymondkhessel889 5 років тому +1

      @@JamesQQuick there really is no audio. only audio is on the "Learn, Build, Teach" intro.

    • @JamesQQuick
      @JamesQQuick  5 років тому

      I mean I don’t know what’s up. I can’t reproduce that and the video I uploaded definitely has audio. Idk