Web Scraping Basics in Python

Поділитися
Вставка
  • Опубліковано 1 гру 2024

КОМЕНТАРІ • 60

  • @NeuralNine
    @NeuralNine  3 роки тому +40

    I had to re-upload this video due to sound issues. I would be happy if you leave some comments, likes and watch time again. ^^

    • @HACKPHILES
      @HACKPHILES 3 роки тому

      Please add subtitles

    • @Slashylol
      @Slashylol 3 роки тому

      Thats why hmmm

    • @kaneki_ken_07
      @kaneki_ken_07 3 роки тому +1

      No Problem Florian, you're always the first choice

    • @malcox5218
      @malcox5218 3 роки тому

      sur

    • @johnjhonyk8976
      @johnjhonyk8976 3 роки тому

      NeuralNine make a video about http requests , and make some post and get requests

  • @kaneki_ken_07
    @kaneki_ken_07 3 роки тому +8

    Greatest man I saw in the teaching history, he knows exactly whats going on in subscribers mind and he uploads that topic. I was going to ask you about this and you published it happened a lot of time that the topic I was willing to learn was uploaded by you.

  • @ArunKumar-gb6hz
    @ArunKumar-gb6hz 3 роки тому +3

    Thanks for the Video. Good one 👍👏👌

  • @Bluva
    @Bluva 3 роки тому +4

    I've already seen this video but im here watching it again to help :)

  • @harigovind6706
    @harigovind6706 3 роки тому +23

    Please post more on webscraping including advanced webscraping techniques

    • @NeuralNine
      @NeuralNine  3 роки тому +10

      If the video performs well I might do that :)

    • @thecodfather7109
      @thecodfather7109 3 роки тому +3

      I agree, love your channel and would appreciate if more advanced tutorials of webscraping are shown 👍🏽

    • @spicer41282
      @spicer41282 3 роки тому

      Just Sub'd!
      Plz I 2nd & 3rd the motion for more Scraping!
      Thanks for considering....

    • @handarusandy7283
      @handarusandy7283 3 роки тому

      @@NeuralNine Please make a video on webscraping from multiple sites sir..
      Specifically what I have in mind is summary scraping for each site from google search result on page 1.
      Or maybe scraping from specific site articles using certain keywords/topic..
      I think a lot of people gonna find that useful and interesting in these times of information overload :)

  • @tsmghost
    @tsmghost 3 роки тому +4

    Finally the requested video❤️❤️✨✨✨❤️❤️

  • @alioudiouf6805
    @alioudiouf6805 3 роки тому +5

    Instead of urllib, you can use and install requests:
    pip install requests
    import requests

  • @giuseppelepiscopo4391
    @giuseppelepiscopo4391 3 роки тому +12

    It would also be great to have some tutorials on web scraping pages after the javascript code gets executed. Selenium should do the job, but it's not always so easy to get it done.

  • @lingeshwaran
    @lingeshwaran 2 роки тому

    you're most underrated youtuber i love your videos

  • @Learningreagent
    @Learningreagent 3 роки тому +15

    Plzz sir make a tutorial on web development with python.. Full fledged

  • @coolsav0074
    @coolsav0074 3 роки тому +4

    Lol I was mid way through the video and after came back after a break and the video was gone😂😂😂

  • @python4692
    @python4692 3 роки тому +4

    Everything is very clear, Thank You! Make some more videos for Beautiful soup and web scraping.

  • @saranyab.s2496
    @saranyab.s2496 3 роки тому +4

    Please do a full course on webscrapping including scrapy

  • @kibe2134
    @kibe2134 2 роки тому

    Best tutorial I've seen on the topic. Really makes it look easy. Great job.

  • @gabrielloiola1627
    @gabrielloiola1627 Рік тому

    I'm a really big fan of your work, thank you!!

  • @alexott50
    @alexott50 3 роки тому +5

    Could you cover web scraping with selenium?

  • @charan2446
    @charan2446 3 роки тому +4

    @NeuralNine
    can you make a video about C/C++ injected code in python.

  • @iandavies1524
    @iandavies1524 2 роки тому +1

    11:18 Some person ... is Guido van Rossum the original creator of Python, to whom we both owe a lot

  • @toni-jn6ns
    @toni-jn6ns 3 роки тому

    thanks for your videos, from Spain, me. ;)

  • @julhyus4174
    @julhyus4174 3 роки тому +1

    Webscraping with lxml is a good way too

  • @handarusandy7283
    @handarusandy7283 3 роки тому

    Thanks a lot! A good introduction to web scraping with clear explanation. It also seems simple enough so newbie like me doesn't get overwhelmed :D

  • @s.aravindh6227
    @s.aravindh6227 3 роки тому +2

    Nice video bro 👍👍

  • @rolo1632
    @rolo1632 3 роки тому

    Nice video...
    Explains everything very good 😁

  • @juan.rinconp
    @juan.rinconp 3 роки тому

    So useful, thanks!

  • @MoSylla45
    @MoSylla45 2 роки тому

    Great video.

  • @kaneki_ken_07
    @kaneki_ken_07 3 роки тому

    I am getting security error while trying with other websites please help.

  • @walternathaniel7365
    @walternathaniel7365 3 роки тому

    Got an attribute error: 'NoneType' object has no attribute' find'
    The code was,
    body=type_table.find('tbody')

  • @thepythonier9681
    @thepythonier9681 3 роки тому

    Well, I am inspired by your videos very much! I love the way you teach!
    I am curious to know which PyCharm edition do you use and how is your python logo and symbol different from the community edition, and also how are the logos of other features

  • @rayyanmairaj5330
    @rayyanmairaj5330 3 роки тому

    Is learning html/css/js important for web scraping? Or is it possible to become good at web scraping without knowing any of those languages?

    • @harigovind6706
      @harigovind6706 3 роки тому +1

      You just need to know basic HTML and Css how a webpage template is usually made of.javascript you can learn later put you should choose a langugae suitable for scraping that's in my opinion is python.so first you should focus on python

    • @rayyanmairaj5330
      @rayyanmairaj5330 3 роки тому

      @@harigovind6706 Im decent at python (at least i think so). But im not keen on learning html or css, so thats why i was curious. Looks like i have to learn at least their basics for web scraping. Thank you for the response

    • @harigovind6706
      @harigovind6706 3 роки тому

      @@rayyanmairaj5330 anyway you will come across html tags and some css selectors and maybe xpath too.so if you are good in python just get started you will adapt other things later

    • @alioudiouf6805
      @alioudiouf6805 3 роки тому

      @@rayyanmairaj5330 Mastering web technologies is really helpful nowadays: You will be able to design your own website with the Python framework called Django. Even if you are researcher, you might have you own web site where you present your CV, your activities, your knowledge... If you are data scientist, after, designing you model, after training and doing forecast, you need to present your work to non technical people, so instead of doing boring PowerPoint, you can do it by Django. HTML, CSS help you to have human readable web page, JavaScript makes the web pages interactive, dynamic. So do not stay only on what you learn academically or what you already know, extend you knowledge, that will make you become as strong as Google itself!

    • @rayyanmairaj5330
      @rayyanmairaj5330 3 роки тому

      @@harigovind6706 I see, thats what i heard from one django tutorial that we can worry about html and css later. For now lets understand how this works

  • @fredrikalouise4282
    @fredrikalouise4282 2 роки тому

    great video

  • @julhyus4174
    @julhyus4174 3 роки тому

    Check the robots.txt file before webscraping

  • @robinferizi9073
    @robinferizi9073 3 роки тому +1

    Why do I keep getting notified multiple times about uploads

    • @NeuralNine
      @NeuralNine  3 роки тому +1

      I reuploaded this video

    • @robinferizi9073
      @robinferizi9073 3 роки тому +1

      @@NeuralNine oh, but it also happened with videos by other channels, maybe I’m just going crazy tho, I haven’t had enough sleep in months

  • @Jose-qk3di
    @Jose-qk3di 3 роки тому

    What is intro music

  • @suyashmisra394
    @suyashmisra394 3 роки тому

    thanks for uploading this!
    i ran into a little problem and was wondering if anyone could help
    urllib.error.HTTPError: HTTP Error 403: Forbidden
    i tried going to stackoverflow but their solution didn't work either
    thanks in advance!

  • @thisisk4154
    @thisisk4154 3 роки тому +1

    Pls upload video on handwritten equation solver by using CNN

  • @PetritK10
    @PetritK10 3 роки тому

    I'm Linux SysAdmin, any Python scripting about SysAdmin, Thank you

  • @Henry_Nunez
    @Henry_Nunez 2 роки тому

    Hablas mucho. 😥

  • @Minienz89
    @Minienz89 2 роки тому

    your tutorials are cool and all but just like all other youtube tutorials.
    you just go "do this, and we type this, and that"
    mate, you need to explain WHY you are coding in the way you are, you need to explain what its happening when your typing "from urllib.request import urlopen" what is urllip.request exactly? what is urlopen and what does it do?
    why utf-8 in html_code=urlopen etc..., and why is it urlopen(url).read then .decode("utf-8")
    otherwise whats the point in even having the video, people might aswell just copy and paste all your code from a pastebin and gain almost nothing that they won't forget almost immediately, i call it just point a to b programming tutorials, no information on why your doing what you do, only "do this", "because i said so"
    but i do like how you explain the ways in which things can be used and offer examples, that's good work.
    like it is hard to apply these concepts to other things, for example
    print(html_code[start:end])
    why can't it just be
    print(html_code), why is start:end contained in [] and how does that affect the program etc., theres these things you don't explain, the actual programming concepts.