Web Crawling vs. Web Scraping - What is the Difference?

Поділитися
Вставка
  • Опубліковано 12 лис 2024

КОМЕНТАРІ • 40

  • @oxylabs
    @oxylabs  2 роки тому +3

    Hope you enjoyed the video! If you want to learn more about web crawling and web scraping, we got you covered - ua-cam.com/users/Oxylabs

  • @mercantilism954
    @mercantilism954 3 роки тому +30

    The process of searching targeted data is crawling while the process of downloading the data is called scraping

  • @busterdafydd3096
    @busterdafydd3096 3 роки тому +5

    2:22 web scraper in my books is a tool that will make metadata from the page, and so it parses all the body data. web crawler will download the pages while the parser "looks" at the pages and studies them while the web crawler will be more focused at jumping through the next portal

  • @busterdafydd3096
    @busterdafydd3096 3 роки тому +4

    0:58 1. data is supposed to be metadata. sometimes websites don't provide very good metadata so you are required to scrape the data to make metadata

  • @johnmicheal5722
    @johnmicheal5722 2 роки тому +3

    That was straight to the point and crystal clear. Thanks.

    • @oxylabs
      @oxylabs  2 роки тому

      We're very pleased you liked it, thank you!

  • @OneManCanStopTheMotorOfWorld
    @OneManCanStopTheMotorOfWorld 2 роки тому +2

    I like your content straight, concise, and to the point ;)

  • @kingofyoutube9318
    @kingofyoutube9318 3 роки тому +15

    if girl in video:
    return "more views, even if we don't understand"
    else:
    return "not interested"

  • @heatherryan9820
    @heatherryan9820 2 роки тому +1

    What I would like to know is how in the heck did she get so good at writing backwards? You can write backwards better than I can write normally.

    • @oxylabs
      @oxylabs  2 роки тому +2

      Hey, that's a good question! She wrote usually, and then we flipped the view :) Hope, you enjoyed the video!

    • @heatherryan9820
      @heatherryan9820 2 роки тому

      @@oxylabs That make since. That's pretty good though.

    • @ajmetz82
      @ajmetz82 2 роки тому

      @@oxylabs Were they writing on glass though? Or was it just writing in the air, and then the actual writing was added in post?

    • @oxylabs
      @oxylabs  2 роки тому +1

      @@ajmetz82 She was writing on the glass :)

  • @williamlowry
    @williamlowry 3 роки тому +7

    Awesome Vid. What a cool gal to present the info 🤘🏼

  • @abiworldseccentric9878
    @abiworldseccentric9878 4 роки тому +15

    Hey are you writing by left hand also right to left (Reverse) direction,..! Amazing ...!

    • @abee127
      @abee127 4 роки тому +28

      Pretty sure she just writes normally then inverses the video

    • @alexandertomilov6165
      @alexandertomilov6165 3 роки тому

      @@abee127 )))))))))))

    • @kiddozcollection
      @kiddozcollection 3 роки тому

      What is she writing on to get that effect?

    • @jonathanross9001
      @jonathanross9001 3 роки тому

      @@kiddozcollection probably a glass, plastic or something. Anything that is transparent and holds ink will work.

  • @abhikkumarde1053
    @abhikkumarde1053 3 роки тому +2

    Didn't know Kriti Kharbanda is from Computer Science Background 😱😱😱
    Wow...

  • @abdelhakbekheitia6210
    @abdelhakbekheitia6210 2 роки тому

    hi thanks for the video
    can i download files from website with Jsoup library
    i have a website that contains a lot of pdf files and when i click on document title it open the windows window to select the place to save the file
    i want to download all these files with Jsoup
    thanks a lot

    • @oxylabs
      @oxylabs  2 роки тому

      Hey! Thanks for asking, we're glad to help!
      Jsoup is an HTML parser library. Once you have the document (HTML) with the PDF links inside, you can use the jsoup to parse those links. Then, you can use an HTTP client of your choice to download the files from those links to your server.

  • @bhargavapothakamuri4218
    @bhargavapothakamuri4218 5 років тому +4

    The question is, do we need to use both of them for looking and downloading ?

    • @oxylabs
      @oxylabs  5 років тому +2

      Hi,
      So, both terms are closely intertwined actually, and also there are quite a few interpretations of each term. Web crawling refers to identifying predefined data that the user is looking/searching for. Once the extraction/downloading of the data starts, it would be termed as web scraping. Check out our in-depth blog post for more detailed information: oxylabs.io/blog/crawling-vs-scraping
      Thanks :)

  • @louislai4125
    @louislai4125 4 роки тому +2

    Does anyone realise she's writing in reverse from her perspective? Cool.

    • @EddieKMusic
      @EddieKMusic 4 роки тому +5

      Lol? She doesn't. You can invert the video afterwards.

    • @anarchistz4133
      @anarchistz4133 4 роки тому +9

      It must suck to have the IQ of a potato

    • @louislai4125
      @louislai4125 4 роки тому

      Would love to have Glados' IQ mate

    • @anarchistz4133
      @anarchistz4133 4 роки тому +3

      @@louislai4125 I see, you're a man of culture...But let me ask a question, who do you think is smarter: the potato or the pickle?

    • @milkyway9225
      @milkyway9225 3 роки тому +2

      @@anarchistz4133 thats the comment I was looking for ;DD

  • @wstudio10
    @wstudio10 3 роки тому

    Web Crawler Application
    Part 1: ua-cam.com/video/TAH0M8K2PsM/v-deo.html
    Part 2: ua-cam.com/video/U5h_naZMOZk/v-deo.html

  • @kalyanroy6687
    @kalyanroy6687 3 роки тому +3

    *manually

  • @Immanuel6468
    @Immanuel6468 2 роки тому

    Might need a web crawlers to get her ig

  • @vedrfolnir7936
    @vedrfolnir7936 3 роки тому

    why 50 dislikes?

  • @HeavyMedal
    @HeavyMedal 3 роки тому

    Her Instagram?