Yup! It's not gonna be exactly the same as Facebook and Instagram are heavy on JavaScript so they require a more powerful library, for example: Selenium! 😊 I have a bunch of really cool tutorials about it: ⭐ web scraping entire Facebook image gallery with Selenium: ua-cam.com/video/SsXcyoevkV0/v-deo.html ⭐ web scraping Instagram images with Selenium: ua-cam.com/video/iJGvYBH9mcY/v-deo.html ⭐ automating LinkedIn contacts using Selenium: ua-cam.com/video/7aIb6iQZkDw/v-deo.html And I have some additional resources for Instagram scraping if you want to check them out: Detailed Instagram Web Scraping Blog: www.mariyasha.com/post/web-scraping-instagram-thumbnails-with-selenium Code for different types of Instagram bots: github.com/MariyaSha/WebscrapingInstagram Good Luck and I hope it helps! 😁
I loved the way you taught; I was stuck for 2 hours with this problem before seeing your video, and you solved all of my problems in a simple manner. 💕💕💕💕
Omg I loved this tutorial. I usually use Selenium with Beautiful soup, but for scraping tables (static ones, I think) I would say that your method is far way faster and better. Thank you
I have learned Python Flask from your videos and now I have made 2 complex app(at least for me😅) using flask. Your videos are really very good. Keep it up😊😊😊😊😊
hmmmm... that's a great question! I haven't had a chance to work with macport yet so I'm probably not the best person to ask 😊 I would assume these two are competitors and they wouldn't want you to migrate so easily... but that's just a guess 😅 hahahaha Thanks for your lovely comment, and sorry I couldn't help much. Maybe some other folks here have some experience with it?
Amazing video, I just cloned the previous WebScrapingDatabases repository and works wonders. Still I want to scrape a grocery store catalog to keep record of sale prices and discounts and that's not tabular data so no elements there.
Personally working on this. It's not on a repo, at least just yet. Still trying to get past the headers to hit the site directly. I was building 1 for HEB Grocery store, since their digital receipts are stored on the account through the site. I had to manually copy the cookie that I received after making an initial response with the browser. I just get denied when I try to save the cookie on a return using Python and requests library. That is the challenge.
Thank you very much!!! the biggest problem i had with automating an economic report was an easy way to get data before plotting the charts. scraping with pandas solves this.
Great explained. You should explain how we can get atributes from a XML ? We can use pandas or other library? And plus, rs, How we can alterate some atributes and save the file Thx !!
Love the white background on this video. I have to get the black at just the right angle from the glare of the sun to see the print. Great video thank you. It does not work so well with my windows and visual studio, I do not get the cell at the bottom to select which table I want.
Please Tell me about your Computer's Monitor. I also want to purchase this kind of large monitor. Because I am Also a Python Coding Learner.... By the Way your Explanation Skills are Awesome. I LIKE IT SO MUCH. Thank You.. Waiting for your Reply ..... ....... ....... ...............
Thank you, me neither!!! 😅 I was working with Pandas for quite some time but never used it to scrape webpages! Apparently since it already has the ability to read from a csv file and automatically place the records in a data frame - it can apply very similar principles on web pages as well! 😊
@@PythonSimplified Because of this video I was able to use Pandas' read_html for a project I'm working on. So much easier! Thanks for the video and a big shout out to Ditto for the recommendation 👏
Wow... Such a simple way. Thanks a lot sister. Can you post a video on how to scrape and do actions like select dates, select values from drop down from a java script enabled website in python?
Thank you so much Jonatthan! 😊 I'm using the Samsung Odyssey G9 ultra-wide 49" monitor, I got it on an amazing deal (it's refurbished certified, so I'm saving 20%-30% just with that 😉)
I have this same exact monitor. I love it. If you could do a video on how best to utilize the space on this monitor for coding programs, that would be great! Thank you for your lessons.
Cool stuff Mariya. Keep going. And shall we expect any Deep learning models with Keras in the future??? Since I am gonna work on that for my Projects...
What a great timing for your question! 😀 I've just posted a new Pandas tutorial where I show you how to do it: ua-cam.com/video/zN2Hua6oII0/v-deo.html It will go over many useful Pandas commands and tricks, but if you only need the to_csv() method you can find it at minute: 07:30 Good luck and I hope it helps! 😁
Hello. i want to extract full articles from wordpress based sites. The quickest method suppose to be parsing rss feed but, i m unsure if You can get the full article by doing so. i m sure it's doable some way. because they do it by using php so, why not with Python? Would You like to put up a video regarding harvesting articles?
Selenium is actually my all times favorite! I've used it to download my entire image gallery from Facebook (before permanently erasing my account 😅 hahahaha), I've used it to spam an imposter of mine on Instagram until they gave up, automatically adding an unlimited amount of connections on LinkedIn and even used it to find out if PS5 are back in stock on Best Buy 😊 I have a bunch of Selenium tutorials is you want to check them out: ⭐ interacting with LinkedIn using Selenium: ua-cam.com/video/7aIb6iQZkDw/v-deo.html ⭐ web scraping entire Facebook image gallery with Selenium: ua-cam.com/video/SsXcyoevkV0/v-deo.html ⭐ web scraping Instagram images with Selenium: ua-cam.com/video/iJGvYBH9mcY/v-deo.html (As well as a few on Wayscript's channel - the PS5 restock bot for example) It's a very fun and intuitive tool to play with, hope it helps! 😁
hmmmm... it's a tough question since I don't know much about this program or what exactly this certification exam grants you 😅 In general - I stay away from online certifications because I don't believe employers recognize anything other than BSc or in some cases Boot Camp completions. But when it comes to Google - is there a chance they are recruiting candidates who successfully passed this exam? I'm not sure... 🤷♀️ I did a quick check of the first row of certified developers: developers.google.com/certification/directory/tensorflow It seems that none of them is working for Google but they do work in the data science industry. If you want to make sure you're not missing anything - reach out to a few of these certified developers on Linkedin and check if they're happy with this program and if it helped them in some way. This will also be very handy in terms of networking - it's always important to make new connections as they sometimes may result in a career opportunity or a really good advice! 😁 So my official recommendation (if it even counts hahahaha, I'm not really an expert) is to do this exam only as an additional certification on top of a BSc or any other wieldy recognized academic program. However, I don't believe this is an alternative to 4 years of school... if it was I'd quit university right now and go do that instead!! hahaha 🤣🤣🤣 Good luck, and let me know if you end up taking it, I'm curious to see what it's all about! 😊
Спасибо большое! 😁 попробуй .to_csv() метод: df.to_csv("my_file.csv" , encoding="utf-8", index=False) это сохранит любой Data Frame в CSV файл (который можно открыть с помощью excel) удачи! и надеюсь что это поможет! 😀
I feel like Web Scraping with Pandas is simpler than with selenium, isn't it?. Btw what's your opinion on log4j Java exploit? hahaha. Literally, you could hack someone's computer through Minecraft.
Could you explain the same technique on Facebook (e.g. friend list or Wall) or IG?
Yup! It's not gonna be exactly the same as Facebook and Instagram are heavy on JavaScript so they require a more powerful library, for example: Selenium! 😊
I have a bunch of really cool tutorials about it:
⭐ web scraping entire Facebook image gallery with Selenium:
ua-cam.com/video/SsXcyoevkV0/v-deo.html
⭐ web scraping Instagram images with Selenium:
ua-cam.com/video/iJGvYBH9mcY/v-deo.html
⭐ automating LinkedIn contacts using Selenium:
ua-cam.com/video/7aIb6iQZkDw/v-deo.html
And I have some additional resources for Instagram scraping if you want to check them out:
Detailed Instagram Web Scraping Blog:
www.mariyasha.com/post/web-scraping-instagram-thumbnails-with-selenium
Code for different types of Instagram bots:
github.com/MariyaSha/WebscrapingInstagram
Good Luck and I hope it helps! 😁
@@PythonSimplified Please take the microphone off you desk.. When you type it's like your hitting the mic.. Also thanks for the videos.. Much love!
@@JaveGeddes I like the sound of typing in her video as well! 🙈
She can't, because this is not example for real world scraping. On YT you can find pro tutorials with much better libraries to choose.
@@StanislavVasko can you provide any links? Please 🙏
I loved the way you taught; I was stuck for 2 hours with this problem before seeing your video, and you solved all of my problems in a simple manner. 💕💕💕💕
You're welcome Mariya !
Omg I loved this tutorial. I usually use Selenium with Beautiful soup, but for scraping tables (static ones, I think) I would say that your method is far way faster and better. Thank you
This coding tutorial just saved me 2 days of effort, thank you so much!
I just came back home and this was waiting for me in the youtube notifications! Thanks Mariya!
You're absolutely welcome! hope this shortcut saves you lots of time in your future projects! 😁
I have learned Python Flask from your videos and now I have made 2 complex app(at least for me😅) using flask. Your videos are really very good. Keep it up😊😊😊😊😊
great comment, there are lots of great dev jobs that need Flask 👍
@@Tobs_ Flask is nothing in front of ASP.NET
Thank you, thank you, thank you for simplifying this! I've been looking ever where. When the code worked on my end I yelled YES
Yeeey!! I'm super happy to help!! 😃
Have fun with your new web scraping superpowers! 😉
BOOM!!!! This video was awesome and provided exactly what I was looking, best and fastest
method I've encountered thus far.
The best simple tutorial video I have seen ever and also the content is so clear
Finally, your english is pretty good and quite understandable
Oaoh!! I always thought Pandas library is incredibly powerful 💪🏼Bravo!! 🤘🏻
Back to the LXML Roots! Great great great as always 💪💪💪 THX Mariya
wow, that seems quite powerful for just a few lines of code! Awesome, good job 👍
Very cool, especially throwing in the SSL unverified cert issue.
hmmmm... that's a great question! I haven't had a chance to work with macport yet so I'm probably not the best person to ask 😊
I would assume these two are competitors and they wouldn't want you to migrate so easily... but that's just a guess 😅 hahahaha
Thanks for your lovely comment, and sorry I couldn't help much. Maybe some other folks here have some experience with it?
For separator in python you can use: print("*" * 30)
with python you can multiply stings to repeat then by the product 😁
Great example! I didn't know that I can scrape the data that way :-) Thanks for being an inspiration ;)
Awesome tutorial. I couldn't find a solution anywhere as to why I kept getting the ssl error...your video really simplify it...
I really enjoy your teaching, is fun, precise and short !
This should be useful for scraping wikipedia pages too
Nice Pandas shirt :) and brilliant tutorial as always :)
Amazing video, I just cloned the previous WebScrapingDatabases repository and works wonders. Still I want to scrape a grocery store catalog to keep record of sale prices and discounts and that's not tabular data so no elements there.
Personally working on this. It's not on a repo, at least just yet. Still trying to get past the headers to hit the site directly. I was building 1 for HEB Grocery store, since their digital receipts are stored on the account through the site. I had to manually copy the cookie that I received after making an initial response with the browser. I just get denied when I try to save the cookie on a return using Python and requests library. That is the challenge.
Thank you very much!!! the biggest problem i had with automating an economic report was an easy way to get data before plotting the charts. scraping with pandas solves this.
Awesome vid - currently documenting my journey on UA-cam been following yours for some time now. Thanks! 😀
Closed whatever I was watching and came here 😍😍😍😍 😀
hahahaha that's awesome!! thank you so much dear! 😁😁😁
Wow, this is awesome! New ways for making amazing things, thanks for this videos and your explanation 😁🙏
Hii
its a good news to you , you got a new subscriber me😆😅
thanks for helping me in python ...
love from india ❤
You wrote panAdas for the notebook, just to let you know I focus on the video content more than before 😀 ..
Great tutorial as usual ❤, thanks M ..
Great explained.
You should explain how we can get atributes from a XML ? We can use pandas or other library?
And plus, rs, How we can alterate some atributes and save the file
Thx !!
Love the white background on this video. I have to get the black at just the right angle from the glare of the sun to see the print. Great video thank you. It does not work so well with my windows and visual studio, I do not get the cell at the bottom to select which table I want.
Thank you for your simple explanation.
Nice! very quick scrape n grab method.
Thanks So Much For This Incredible Information ~
Your The Best; Love You And Your Channel ~
You're absolutely welcome! I hope it helps saving time on your future projects! 😊
So useful!
Again , amazing new trick, so now we can get any data faster and intelligently, Thank you..❤
Love you young lady. Your tutos are very good and easy 👍
Very nice .
Thalaivi you are great
Damn, this is amazing.. I'll give a try with my project! Awesome tutorial, really helpful 👍 thank you so much
Please Tell me about your Computer's Monitor. I also want to purchase this kind of large monitor.
Because I am Also a Python Coding Learner....
By the Way your Explanation Skills are Awesome. I LIKE IT SO MUCH.
Thank You..
Waiting for your Reply
..... ....... ....... ...............
Hi Mariya! Happy new year ❣️✌️🔥
Very cool. I had no idea this was possible. 👍🏼
Thank you, me neither!!! 😅
I was working with Pandas for quite some time but never used it to scrape webpages!
Apparently since it already has the ability to read from a csv file and automatically place the records in a data frame - it can apply very similar principles on web pages as well! 😊
@@PythonSimplified Because of this video I was able to use Pandas' read_html for a project I'm working on. So much easier! Thanks for the video and a big shout out to Ditto for the recommendation 👏
Really great video!
Question: What is the extension that pops up in the browser "found solution on GitHub" at 2:48?
Thank you!
Amazing girl, amazing content 🔥🔥🔥
Do you consider make a video (or whole series) about web scraping using scrapy?
Wow... Such a simple way. Thanks a lot sister.
Can you post a video on how to scrape and do actions like select dates, select values from drop down from a java script enabled website in python?
Such a great presentation.
nice, you did it - i'm proud of you 😘
I‘m impressed. Thanks 🙏
Thank you! I had been doing this the hard way! XD
Panadas - sounds like icecream 🤤
Awsome!! Thank you!
love your videos
what monitor do you use in your videos? pd: i love your videos
Thank you so much Jonatthan! 😊
I'm using the Samsung Odyssey G9 ultra-wide 49" monitor, I got it on an amazing deal (it's refurbished certified, so I'm saving 20%-30% just with that 😉)
I have this same exact monitor. I love it. If you could do a video on how best to utilize the space on this monitor for coding programs, that would be great! Thank you for your lessons.
Heyy u are a good explainer🎉
nice job as always ;) big like for you!
Thank you! Interesting )
Wow, this is amazing, thanks!
Great video!!!
Amazing 😇 I love your way 😁
Cool stuff Mariya. Keep going. And shall we expect any Deep learning models with Keras in the future???
Since I am gonna work on that for my Projects...
awesome video !
Muy bueno para complementar mis primeros pasos en python
Will you web scrap option chain using pandas which is htmi pattern of any share market say Indian NSE OR NASDAQ?
Simply cool like you 😃😉
Very nice. Thanks
Can you scrape dynamically generated, Ajax pages?
How to avoid 403 Forbidden with some URLs using this code?
Which monitor on your table?)
Hey Mariya could you please do a an OOP part 2 tutorial covering all the OOP concept that you didnt cover in the part 1
Wow, I do it 👍😂
How can I save it, for example, in CSV?
What a great timing for your question! 😀
I've just posted a new Pandas tutorial where I show you how to do it:
ua-cam.com/video/zN2Hua6oII0/v-deo.html
It will go over many useful Pandas commands and tricks, but if you only need the to_csv() method you can find it at minute: 07:30
Good luck and I hope it helps! 😁
@@PythonSimplified I wiil see it 👍
Thank you 👍👍👍
Hey Honey there are few modules available for extract table in 2 line.
you are awesome!!! thanks a lot
Hello. i want to extract full articles from wordpress based sites. The quickest method suppose to be parsing rss feed but, i m unsure if You can get the full article by doing so. i m sure it's doable some way. because they do it by using php so, why not with Python? Would You like to put up a video regarding harvesting articles?
❤cool, thank you for your tutorial
This is very huge name of a variable but it looks good. That is the new thing. I didn't know that.
thanks for the video [:-0
Extra awesome 😎😂👏
I always learn so much from you.
thank you 🌹 very much.
by the way you look lovely in that dress!!! 🥰😍🥰😘
Thanks for video liked it
Nice Video!!! Thanks!!!!!
is there a way to do this without jupyter notebook? just curious, please don't hate
I'm looking for some thing to scrape genealogy DNA web sites. Now to figure out how to do button presses and logins
Heyy.. Have you tried selenium for scraping websites?
Selenium is actually my all times favorite! I've used it to download my entire image gallery from Facebook (before permanently erasing my account 😅 hahahaha), I've used it to spam an imposter of mine on Instagram until they gave up, automatically adding an unlimited amount of connections on LinkedIn and even used it to find out if PS5 are back in stock on Best Buy 😊
I have a bunch of Selenium tutorials is you want to check them out:
⭐ interacting with LinkedIn using Selenium:
ua-cam.com/video/7aIb6iQZkDw/v-deo.html
⭐ web scraping entire Facebook image gallery with Selenium:
ua-cam.com/video/SsXcyoevkV0/v-deo.html
⭐ web scraping Instagram images with Selenium:
ua-cam.com/video/iJGvYBH9mcY/v-deo.html
(As well as a few on Wayscript's channel - the PS5 restock bot for example)
It's a very fun and intuitive tool to play with, hope it helps! 😁
@@PythonSimplified oh yeah. I've also watched them. Stupid me forgot about them Hahaha. Btw thanks for the references. And yeah my notes?🙂
She is so beautiful as always 🥰😍
Hello miss,,,
please teach how to Make bulk id card software in python Tkinter GUI,
I'm waiting Django videos 😊...
Nice video
Thank you! :)
can you make a video on how to scrape UA-cam data??
You are awesome
very nice and intelligent girl!👍
Mariya do you recommend doing Google's tensorflow cert. exam from google developers?
Are they in demand?
hmmmm... it's a tough question since I don't know much about this program or what exactly this certification exam grants you 😅 In general - I stay away from online certifications because I don't believe employers recognize anything other than BSc or in some cases Boot Camp completions. But when it comes to Google - is there a chance they are recruiting candidates who successfully passed this exam? I'm not sure... 🤷♀️
I did a quick check of the first row of certified developers:
developers.google.com/certification/directory/tensorflow
It seems that none of them is working for Google but they do work in the data science industry.
If you want to make sure you're not missing anything - reach out to a few of these certified developers on Linkedin and check if they're happy with this program and if it helped them in some way. This will also be very handy in terms of networking - it's always important to make new connections as they sometimes may result in a career opportunity or a really good advice! 😁
So my official recommendation (if it even counts hahahaha, I'm not really an expert) is to do this exam only as an additional certification on top of a BSc or any other wieldy recognized academic program. However, I don't believe this is an alternative to 4 years of school... if it was I'd quit university right now and go do that instead!! hahaha 🤣🤣🤣
Good luck, and let me know if you end up taking it, I'm curious to see what it's all about! 😊
Love your video... But I am very beginner in this field. 😑
How to write code in selenium for WebS Facebook to Open Groups in order
Привет Мария. Молодец. Если возможно Python + Kivy + pandas с сохранением данные на excel. Сними плс видео ролик. Спасибо.
Спасибо большое! 😁
попробуй .to_csv() метод:
df.to_csv("my_file.csv" , encoding="utf-8", index=False)
это сохранит любой Data Frame в CSV файл (который можно открыть с помощью excel)
удачи! и надеюсь что это поможет! 😀
@@PythonSimplified Спс. Если не получится напишу. ОК.
@@PythonSimplified Здравствуйте. Этот прием не получилось. Задачу решил но другим путем.
Love it
За скрэпинг отдельное спасибо.
You're looking soo beautiful today💖❤️❤️🇳🇵😅
Thank you so much! 😊
It's Rudolph the White Nose reindeer.
Nice videos, maybe we can use print("*" × 50) instead of print("****************").
Can you make tutorial you make tutorial on flask?
Could you get a link of your screen ?
I feel like Web Scraping with Pandas is simpler than with selenium, isn't it?. Btw what's your opinion on log4j Java exploit? hahaha. Literally, you could hack someone's computer through Minecraft.