Thanks to FCC for posting my Web Scraping course. This is a huge achievement for me as a consistent learner from this channel :) I hope to see you all around in my future uploads!
Brother, thank you. I have a learning disability, so it is not easy for me to sit for long times and be focused. I'm incredibly happy right now. Your explanations are easy to follow; I do not feel that I am 'slow'. I just want to say thank you. You're making new learning a pleasant experience for me.
Don't let anyone in the world let you feel a slow person. :) We are different humans and your pace is what is the best for you. I am very glad I could help you out! Keep going :)
Everyone has their unique learning speeds. It is the effort and interest that matters. Never let traditional school/college systems shame you for not being able to follow their mass classroom approach. Happy Learning!
This course is mindblowing... first, the pace is excellent...no bullshiting, straight to the point, clear and concise, secondly, very detailed... I was able to scrap a real estate website for an analysis i wanted to do I have found web scrapping quite intimidating, but man this course made it so easy. You are a great teacher. Im short of words
I see some comments about people receive none from scraping responses, unfortunately it might be expected from websites that are dynamically changed and being updated, there is a great chance that the website had some updates in this 4-month span, and then it affects your results. Try to scrape differently by inspecting to the elements like I show in the website user interface :)
Hi @JimShapedCoding I tried your way of scrapping website but I am getting empty list for whatever tags I give. Can you please share why this is happening?
I thought this skill would be way above my level as i'm still a student mid way through my under-graduate , but you guys made it look like a child's play. I’m actually able to do web scraping after watching your video. Well done FCC team , good job boys💪🔥.
wow this is a very good free material and it just cover up more than what "Automate the Boring stuff with Python" book taught me. this guy just get to the point and did not complicate anything.
Just got out of "Automate the Boring Stuff" too! I'm so glad the programming' community is supportive and provides acessive and high quality material with no cost at all to 'outsiders' (I'm a accountant, not a programmer). Now, I feel that I need to write a book or make a youtube channel to share my financial knowledge with the whole world too xD
@@not_from_here4477 yeah, i will tell you that i took on a freelancing project where i had to scrape a German website to get the email out of 19065 Facilities. Even with Selenium module it was a tough job but then i posted in on reddit. And a person just did it by just using Developer tools of Chrome and just 15 lines of Python code and i got 50 dollars for completing it. I am planning to make a discord server, if you are on discord add me ID: Lord Ainz#3259. if i get enough people i will make a discord server.
@@pkavenger9990 it's very useful, indeed. I appreciate the invitation, but I do not intent to work directly with python. I just use it in my daily tasks.
One of the best tutorials on Web Scraping using Python. You started from the very basic level to explain the fundamentals and then slowly took us to using the same techniques to scrape a real web site. Amazing. I see you as my Guru or Mentor being an avid AI/Python enthusiast. BTW, you could have used strip() to remove the leading and trailing white spaces instead of replace(). Thanks again
As someone rather new to coding, I've tried several web scraping tutorials but none of them "clicked" for me. Your tutorial however was fantastic. So easy to follow along, it was incredible!!! Thanks you!!
The word 'Web Scrapping' was like a nightmare for me before I saw this video. Everytime I saw any web scrapping job in the job portals I was assuming that it's beyond my scope.🤣 But now I am confident enough to answer questions related to this after going through this video and doing some hands on as well. Thanks to Jim for such a beautiful explanation and thanks to FCC too for uploading the tutorial video. 🙂
As a proxy company, we know that web scraping is a valuable tool for many businesses. This video does a great job of breaking down the concepts and showing how to use the Beautiful Soup library in Python. I highly recommend it.
Really good video I did a code along and enjoyed a lot , it is my first time doing web scraping and i found the explanation to be easy simple and understandable so thanks ❣
I've tried the web scraping when i am in college but ii already forgotten on how to do it. As i watching the video, my knowledge came back. Thank you. Very good explanation.
A one hour video for bs4 tutorial explaining everything in such clarity and detail. This dude is nuts! Just take my like and subscribe. Just take it all.
This video is amazing. The instructor's step-by-step tutorial starts with a simple code structure and gradually makes it more complex. I hope you publish more online courses because your teaching method is audience friendly
Excellent tutorial for a total web scraping novice, after watching this I'm already able to pull data from several different websites for my own use case. Knowing very little html coming in, I already feel like I know enough to get to some useful information to analyze offline. Very easy to follow and a great flow by the presenter Jim. Thank you.
Just a suggestion @37:09 it is better to use text.strip() method to remove unnecessary space from the beginning and the end. replace removes spaces from the company name as well.
I have already tried different videos and sources for this. Not all had much detailed knowledge. I really appreciate how he explained all the necessary steps. Tips were really great. Thank you for the video,
Thank you! One step further would be to add Selenium to the project so that you can navigate also to the next page... I would be very interested in that (how to navigate with selenium and the parse the results after an action with beautifulsup)
Great tutorial Jim, thank you very much! You've brought me general understanding of Python syntax along with understanding of Beautifulsoup. Inspiring! Cheers!
Great video man - I’m so excited that I was able to make a basic web scraper on my own after watching this (but needs a ton of refinement! Haha). Thanks for a great video!
I would like to thank you. You are a world-class tech teacher as you help me to decide and start my focus on web scrapping. Your way of explanation is so compelling. Please add other web scrapping tips on with your You Tube channel.
Great video. One quick question although. At the moment we are searching the hard coded values. Is it possible to scrape the information based on the matching pattern?
@@shashwatshah2132 You have access to the attrs property, try printing out that, example: soup = BeautifulSoup('Home') link = soup.find('a') print(link.attrs)
Great question First, you should go ahead and use requests.get(), and provide as the argument the URL that I iterate over, each execution. And then, you can basically create one more instance of Beautiful soup, with the result of requests.get().text, like I show in around the second part of this video:)
This is a fantastic tutorial, probably one of the best I have ever come across. I came into this tutorial with 0 knowledge on web scraping, and came out of it with much more confidence. Excellent work!
The explanation is quite simple and clear... I love the way he explain little little things in the whole topic, so that every person can easily understand. ❤❤❤
Voww voww voww. I loved this tutorial. Followed from beginning to end. I liked it that you put the filtering condition while scraping the data, extra features and all. Just awesome. This is a must watch for all beginners. Huge thanks to both Jim and FCC
Thank you! This was a great introduction for a total beginner to scraping. By the end of it, I was able to use what you taught me on a different website, and I'm starting a scraping project now with what I just learned.
Just amazed, how effectively and enthusiastically you taught those lessons......... U sure gained a subscriber today...... And thanks for the tutorial, I have web scrapping as my project topic.... Thank you FCC Thanks Jim Kudoosssss ❤🎉
Great contribution from FCC team!. After a long time I could reach the right content for learning web scrapping and loving it. Before that I have checked a lot of web scrapping related tutorial which made me frustrated! Love you man....
To filter multiple skill requirements, create a list from the user's input by making a new variable and splitting: list = unfamiliarskill.split() Then, instead of: if unfamiliar_skills not in skills, you can replace it with: if all(skill not in skills for skill in list): ---- this is to check that none of the skills in the user input list is in the required skills. I'm a beginner and this was a pretty fun attempt. Made many mistakes with the differences between lists and strings.
Fantastic! This video has been super helpful! If you have a little programming background, you can even fast forward through the video and just get your own piece of code done in half an hour! Very well done!
Thanks to FCC for posting my Web Scraping course.
This is a huge achievement for me as a consistent learner from this channel :)
I hope to see you all around in my future uploads!
how can i avoid captcha/recaptcha?
every time i scrape some shops, the soup is garbage bcs of captcha.
Thank you for sharing your knowledge, I just subscribed to your channel!
Great guide!
@@ozzy9846 Thanks!
Really good job ¡ so clean and good explanations
This is definitely one of the best hours I spent on UA-cam. Quality content for free. We don't deserve this...
If you took the time to finish and learn, then you DO deserve it!
Well said Diego!
@Uvais Hassan and @@diegoguisasola3858 I agree with both of you! Your comments are deep! 💡
@@detroiter4eva exactly
@@ANKStardust h6o
Brother, thank you. I have a learning disability, so it is not easy for me to sit for long times and be focused. I'm incredibly happy right now. Your explanations are easy to follow; I do not feel that I am 'slow'. I just want to say thank you. You're making new learning a pleasant experience for me.
Don't let anyone in the world let you feel a slow person. :) We are different humans and your pace is what is the best for you. I am very glad I could help you out! Keep going :)
Everyone has their unique learning speeds. It is the effort and interest that matters. Never let traditional school/college systems shame you for not being able to follow their mass classroom approach. Happy Learning!
I just have to say, this is the best webscraping course I have seen so far. Very well done !
This course is mindblowing...
first, the pace is excellent...no bullshiting, straight to the point, clear and concise,
secondly, very detailed... I was able to scrap a real estate website for an analysis i wanted to do
I have found web scrapping quite intimidating, but man this course made it so easy. You are a great teacher. Im short of words
I see some comments about people receive none from scraping responses, unfortunately it might be expected from websites that are dynamically changed and being updated, there is a great chance that the website had some updates in this 4-month span, and then it affects your results. Try to scrape differently by inspecting to the elements like I show in the website user interface :)
yoyo ma
Hi @JimShapedCoding I tried your way of scrapping website but I am getting empty list for whatever tags I give. Can you please share why this is happening?
@@asmaakram1621 some of sites are locked for doin this in easy way
Hocam Türk müydünüz selamlar
For me i copied the html file wrongly from his github. Make sure to to open the page in a browser to make sure you've copied it correctly.
I thought this skill would be way above my level as i'm still a student mid way through my under-graduate , but you guys made it look like a child's play. I’m actually able to do web scraping after watching your video. Well done FCC team , good job boys💪🔥.
What do u do now
@@looksmatteronly nothing man. Life's going great. I am engaged and thinking about starting a youtube channel. This is my alt account
His teaching skills and accent are just fantastic.
his adaptive speech for everyone who know English at least a little bit. It's amazing
wow this is a very good free material and it just cover up more than what "Automate the Boring stuff with Python" book taught me. this guy just get to the point and did not complicate anything.
It's good to read such a comment. Thanks!
Just got out of "Automate the Boring Stuff" too! I'm so glad the programming' community is supportive and provides acessive and high quality material with no cost at all to 'outsiders' (I'm a accountant, not a programmer).
Now, I feel that I need to write a book or make a youtube channel to share my financial knowledge with the whole world too xD
@@not_from_here4477 yeah, i will tell you that i took on a freelancing project where i had to scrape a German website to get the email out of 19065 Facilities. Even with Selenium module it was a tough job but then i posted in on reddit. And a person just did it by just using Developer tools of Chrome and just 15 lines of Python code and i got 50 dollars for completing it. I am planning to make a discord server, if you are on discord add me ID: Lord Ainz#3259. if i get enough people i will make a discord server.
@@pkavenger9990 it's very useful, indeed. I appreciate the invitation, but I do not intent to work directly with python. I just use it in my daily tasks.
One of the best tutorials on Web Scraping using Python. You started from the very basic level to explain the fundamentals and then slowly took us to using the same techniques to scrape a real web site. Amazing. I see you as my Guru or Mentor being an avid AI/Python enthusiast. BTW, you could have used strip() to remove the leading and trailing white spaces instead of replace(). Thanks again
this is what I call quality content. Very logically presented and instructed. Thank you very much for contributing to my future's success in Python.
As someone rather new to coding, I've tried several web scraping tutorials but none of them "clicked" for me. Your tutorial however was fantastic. So easy to follow along, it was incredible!!! Thanks you!!
The word 'Web Scrapping' was like a nightmare for me before I saw this video.
Everytime I saw any web scrapping job in the job portals I was assuming that it's beyond my scope.🤣
But now I am confident enough to answer questions related to this after going through this video and doing some hands on as well.
Thanks to Jim for such a beautiful explanation and thanks to FCC too for uploading the tutorial video. 🙂
As a proxy company, we know that web scraping is a valuable tool for many businesses. This video does a great job of breaking down the concepts and showing how to use the Beautiful Soup library in Python. I highly recommend it.
This might have been the first non-music video whose every single seconds I watched. Great tutor, awesome explanation. Thanks a lot!
Really good video I did a code along and enjoyed a lot , it is my first time doing web scraping and i found the explanation to be easy simple and understandable so thanks ❣
Thanks for watching! Hope you'll find more of my videos useful
Just 15 minutes into the course and I'm already feeling like a web scraping pro 😊😊. Thank you so much
You are indeed!!
I've tried the web scraping when i am in college but ii already forgotten on how to do it. As i watching the video, my knowledge came back. Thank you. Very good explanation.
Glad to finish the entire discussion. I am a 3rd year Computer Science student and this helped me out A LOT!
Thanks again for the wonderful content.
Three years later still holds up. Thanks for helping us along our journey.
A one hour video for bs4 tutorial explaining everything in such clarity and detail. This dude is nuts! Just take my like and subscribe. Just take it all.
This video is amazing. The instructor's step-by-step tutorial starts with a simple code structure and gradually makes it more complex. I hope you publish more online courses because your teaching method is audience friendly
This was amazing, I didn't know web scraping could be so easy
I'm so lucky that I'm found this video, thanks a ton for uploading this wonderful video.
You're welcome!
Excellent tutorial for a total web scraping novice, after watching this I'm already able to pull data from several different websites for my own use case. Knowing very little html coming in, I already feel like I know enough to get to some useful information to analyze offline. Very easy to follow and a great flow by the presenter Jim. Thank you.
I'm from italy and i can say that your english is very understandable from a 19 years old boy. Thanks a lot.
Great course! I can't get over how he says "beautiful soup" it's wonderful
🎯 Key Takeaways for quick navigation:
00:00 *Web Scraping Basics *
01:08 *HTML Structure Overview *
05:41 *Installing Beautiful Soup *
09:20 *Reading HTML Content *
11:22 *Prettifying HTML with Beautiful Soup *
13:08 *Finding Specific HTML Tags *
15:48 *Scraping Course Names *
18:31 *Scraping Course Prices *
25:17 *Using the Request Library*
26:28 *Web scraping basics*
27:23 *Adapt to changing HTML elements*
28:55 *Retrieving HTML text*
30:13 *Creating Beautiful Soup instance*
31:06 *Finding job post elements*
32:39 *Searching for job elements by class*
34:23 *Extracting company names*
38:11 *Extracting skill requirements*
41:31 *Formatting job information*
46:06 *Filtering job posts by date*
53:31 *Extract href attribute*
54:12 *Filter skill requirement*
57:40 *Challenge: multiple skills*
58:06 *Save job posts*
59:24 *Run program periodically*
Made with HARPA AI
An extraordinary piece of video material that has proven highly useful for our new team members. Your generosity is immensely appreciated!
This is appreciated thanks!
You are the best Python web scraping teacher I have ever had. Well done!
Just a suggestion @37:09 it is better to use text.strip() method to remove unnecessary space from the beginning and the end. replace removes spaces from the company name as well.
50:22
One of the best crash courses I've watched in my life. Very effective, 100% would recommend!
The amount of hard work and dedication you guys put to create such free content is just Amazing!!!
Thanks to FCC for posting this Web Scraping course.
The tutor here is just phenomenal! Love it! Thanks for helping me towards my final year project :)
hey, im also choosed topic related to web scraping, what’s your idea for project?
Just wanted to say thank you! One of the best tutorials that I have seen on webscraping, and very easy to understand and follow. Great Job!
One of the best tutorials for beginners...wow.I just played in 0.9x speed and it was very clear.Thank you to this guy and the channel.
I absolutely love this channel, thanks for teaching us about coding
This is fr the best web scraping course
Thanks for following along! Hope you'll find more of my videos useful
Omg I was thinking just about this and you posted this. Are you guys some kind of wizard.
Thats really strange but me too...
The world doesn't deserve this channel. I love you guys. 💖
I have already tried different videos and sources for this. Not all had much detailed knowledge. I really appreciate how he explained all the necessary steps. Tips were really great. Thank you for the video,
Great course.
If you could post a web scrapping with Selenium course it would be nice.
Congrats man. Your eloquency is enough to teach anyone. Leave alone the content
Just finished watching the video, thanks a lot bruh. It really helped a lot
Glad this helped you!
Just before the times jobs task. I have completed what you have asked just after watching first half an hour. Good teaching
I really could have used this 4 months ago....
I’m still gonna watch it though
For getting discount course of byjus
Vaishali Dwivedi Mam 👇
Call now - 8319788447 take my Rishi so she will give at very less price
@@ideaindia4278 shut up
Really great tutorial! Came into this knowing nothing about BeautifulSoup and now I am able to write a webscraping applications using Python.
Thank You very much. I spent my day watching this. You guys are absolutely great.
You are one of the best educator that I have ever seen.I am impatient to see your other videos.Thanks for everthing
Best tutorial of beautiful soup ever
second that!
A very practical video with very detailed explanations!
Love to read this, thanks
I'm a Web Scraper Now:)
Enjoyed eveeeryy second of this!!.. Thank you so much
Thanks for the kind words!
Thank you! One step further would be to add Selenium to the project so that you can navigate also to the next page... I would be very interested in that (how to navigate with selenium and the parse the results after an action with beautifulsup)
This is the best Python educational video I've watched. The difficulty progression and pacing were perfect.
37:25 we can also use strip function instead of replace
Great tutorial Jim, thank you very much! You've brought me general understanding of Python syntax along with understanding of Beautifulsoup. Inspiring! Cheers!
Love to read this, thanks
Great video man - I’m so excited that I was able to make a basic web scraper on my own after watching this (but needs a ton of refinement! Haha). Thanks for a great video!
Best Web Scraping video out there for beginners.
Thanks for this I was wondering about it.
this is my first time, when I watched the entire video without yawning. it was super interesting!
How do you get the html file? I want to automatically check a website every few minutes.
Thank you very much for providing me some awesome lesson about web scrapping. I will be grateful.
Happy to read such a comment
Jim: "Now I will close back the head and then I will expand the body."
Me: 😳...sorry I think I'm in the wrong class.
I would like to thank you. You are a world-class tech teacher as you help me to decide and start my focus on web scrapping. Your way of explanation is so compelling.
Please add other web scrapping tips on with your You Tube channel.
Thank you very much for this effort...please make a elixir tutorial video.
you made it very easy for me i just scrapped leetcode after watching your videos
thanks a lot for such a great quality education for free
Great video. One quick question although. At the moment we are searching the hard coded values. Is it possible to scrape the information based on the matching pattern?
He was very focused on how to teach in a good manner. I love it! Keep up the good work!
what a great content!!
Thanks so much for this... I was sailing in a sea of confusion until I found this... and to imagine its ALL free? like just amazing...
i can't get it to work it always returns "none" or "[]"
This is an exceptional tutor. The content is just wonderful. This is truly the best web webscrapping course I have seen. Thank you for this.
This is an amazing tutorial....
he looks like bruno fernandes haha. But ngl this is and amazing course!!!!
It would been the best comment ever if you would say Stevie G
This was great! I was a little intimidated about learning web scraping but you made it really easy to follow and understand.
Thanks!
You welcome thanks for watching!
Is there a way I can get text from this tag, 22°C ?
text attribute
@@edwingarcia5043, Can u pls help me with code, means how can I write code for it?
@@shashwatshah2132
What text are You talking about ? The value of the data-v-7372d7ee attribute, or the value (inner text) of the tag ?
@@shashwatshah2132 You have access to the attrs property, try printing out that, example:
soup = BeautifulSoup('Home')
link = soup.find('a')
print(link.attrs)
@@edwingarcia5043 Thank u a lot
This is my third course that i finished with Jim about Python !!! Thank you
53:51 what if I want to get the info inside that link as well? now just the link itself... thank you so much!
Great question
First, you should go ahead and use requests.get(), and provide as the argument the URL that I iterate over, each execution.
And then, you can basically create one more instance of Beautiful soup, with the result of requests.get().text, like I show in around the second part of this video:)
I have a consultation coming up where I need to track school closures. This is perfect. Thank you!
Borat teaches Python!
I was looking for this comment lol
@@user-ff5vw4pn8i I couldn't resist :)
Not cool.
@@TD05SSLegacy Why not?
I love Borat sooo much, and his sense of humor really, so what is the point?
A great tutorial, well explained, well organized, high recommended for anyone who want to understand webscraping using python.
This is a fantastic tutorial, probably one of the best I have ever come across. I came into this tutorial with 0 knowledge on web scraping, and came out of it with much more confidence. Excellent work!
The explanation is quite simple and clear...
I love the way he explain little little things in the whole topic, so that every person can easily understand.
❤❤❤
This is one of the very good courses to start with learning web scrapping
Thanks for this tutorial. I've i followed every step and have successfully scraped data from my chosen website. This is great content
I finished my homework thanks to this tutorial. Thank you!
Best 1 hour I spent on youtube in a while. Thank you for this FreeCodeCamp!
This was extremely helpful for my college project. Thank you!
Voww voww voww. I loved this tutorial. Followed from beginning to end. I liked it that you put the filtering condition while scraping the data, extra features and all. Just awesome. This is a must watch for all beginners. Huge thanks to both Jim and FCC
Thank you! This was a great introduction for a total beginner to scraping. By the end of it, I was able to use what you taught me on a different website, and I'm starting a scraping project now with what I just learned.
3 years old video yet I really found it benefit! thanks dude!
Ages like a fine wine lol. Thanks for watching
Just amazed, how effectively and enthusiastically you taught those lessons.........
U sure gained a subscriber today......
And thanks for the tutorial, I have web scrapping as my project topic....
Thank you FCC
Thanks Jim
Kudoosssss ❤🎉
Count von Count leaves Sesame Street to pursue programming dream 👍🏼
Simple and thorough explanation 👍🏼
you can use ."strip" method to delete unwanted white spaces it's much better than replace :).
Bro u are amazing, this is top quality entertainment and educational
Thanks a lot bro, hope you'll find more of my videos useful
Great contribution from FCC team!. After a long time I could reach the right content for learning web scrapping and loving it. Before that I have checked a lot of web scrapping related tutorial which made me frustrated! Love you man....
To filter multiple skill requirements, create a list from the user's input by making a new variable and splitting: list = unfamiliarskill.split()
Then, instead of: if unfamiliar_skills not in skills, you can replace it with: if all(skill not in skills for skill in list): ---- this is to check that none of the skills in the user input list is in the required skills. I'm a beginner and this was a pretty fun attempt. Made many mistakes with the differences between lists and strings.
Bro can you plz share the code, i am struggling to figure this logic out
It would be a great help
Fantastic! This video has been super helpful! If you have a little programming background, you can even fast forward through the video and just get your own piece of code done in half an hour! Very well done!
Thank you so much. Leant web-scrapping and completed my assignment in just a few hours.