Web scraping in Python

Web scraping is a method used to extract data from websites. It involves programmatically downloading web pages and parsing their HTML to extract the necessary information. It can be used to harvest data for the purpose of statistical analysis, training machine learning models, and creating alerts. In this talk, we'll discuss how to use basic programming skills in Python to scrape the web. We'll examine the technical and ethical aspects of the method, as well as practical applications.
--
Slides: education.scinet.utoronto.ca/...
--
This webinar was presented by Yohai Meiron (SciNet) on November 22, 2023, as a part of a series of weekly Compute Ontario Colloquia. The webinar was hosted by SciNet. The colloquia cover different advanced research computing (ARC) and high performance computing (HPC) topics, are 45 to 60 minutes in length, and are delivered by experts in the relevant fields. Further details can be found at www.computeontario.ca/trainin...

[@adityatandon9434]

is it considered illegal or "hacking" , asking because I'm interested to make a project to scrape a website (Checked its robots.txt file and its not allowed) but I think since its very small project it'll only collect data when i run the program (not automatically) to get small data

[@jasmineg8177]

"PromoSM"