Python & MITMProxy: Web Scraping Secret iOS App Data
Вставка
- Опубліковано 27 жов 2020
- Using Python we build a simple Goodreads webscraper using
- MITMProxy to observe the web traffic and get the API calls
- Requests to perform the API call in Python
- BeautifulSoup to convert the XML data
- Pandas to take the converted XML data and create a CSV file
Today's question came from a stranger on the internet over at Reddit - / trying_to_make_a_simpl...
Thank you for watching!
Just wanted to say thanks for these videos! I've only been learning Python for a week now, but you do well enough job of explaining your process that I can still follow along on concepts I haven't even gotten to yet. It definitely helps with getting me primed for the things ahead. Much appreciated!
Great tutorial. Love that you keep your mistakes and errors there. Very helpful
I was pretty psyched when this popped on my feed
Welcome Back, I missed these videos!!! Keep it up. Thank you
Great series, glad you're back! I'd love a more in depth video on mitmproxy! I'm looking to start using* home assistant and I'd love a way to interact with my smart home devices and automate them in ways they won't allow me to out of the box.
Great video! I found you off of Reddit today. Love your production!
Haven't seen you post in a while , but wanted to thank you for the vids you made. They really helped get more practical uses of scraping skills
Excellent videos!! Your content helped me solve a problem I’ve had for ages!
Loving the videos man! I was wondering if you would be able to do a video talking about some of the applications of web scraping?
thanks for tutorial man this was insane. Best programming teaching technique i have ever seen.
Informative, educational and funny!
2:28
Hey man! Can you maybe quickly explain how you set up your iPhone mirroring on your MacBook and how you connected it to mitmproxy?
Hi, How did you add your device with your laptop please?
This is so cool and satisfying to watch!!!! Awesome stuff dude keep if up!!
Good stuff man. Thank you. Wish I had found this a year ago 💪🏽
Hello MR
Are you familiar with the DoorDash driver app? Is it possible to scrape data from that using MITM. Specifically, what I’m hoping for is a way to scrape all of my earnings from my time as a DoorDash driver (orders, stores, dates, base pay & tip).
How did you configure your iphone to listen to the proxy server? i could not
great vid ...also your tone is great for this video👍🏻