I HAVE NEVER SEEN ANYTHING LIKE THIS IN MY LIFE. Sure, I have see screen scraping back in the old CRT days, but this is UNREAL and it's easy ONCE you know the language!! Excellent Video!
I'm encountering an issue at 4:09 for the //p[@class='result-info'] , as I got a #N/A as a result. The class name on CraigList is not changed yet, so can't figure out why this isn't working as you. Thanks for your help and your videos. EDIT : #2 On TechCrunch website, I'm not able to click on "XPath" Button. It's not working at all. Otherswebsite are fine tho. Do you have any idea why ? #3 On Yelp website , the result for the first example in Sheets is CSS code. Far from what you get even if I'm doing the exact same thing. Your video isn't so old, I really can't figure out why thinks works so differently , I tried to re-watch many times your video to see if I'm missing something but no.... ;(
Clear Explanation 👍 Questions Will the important HTML Is up-to-date data from the source website? If no then please tell us a way to keep a live data 2- I want to scrap ecommerce website product data, how to auto scrap Next page ? 3- How about import data via json file url most e-commerce website uses it eg Shopify I'll be thankful if you please create an ecommerce website data scraping vidoe or share your tips so ill give it a try 🙂
Thanks so much for the value! For your yelp example, how would you go about trying to keep a well managed and orderly scrape of all the items across all page numbers over time? Including trying to remove duplicates as each item moves across the different pages? Thanks!
Great video, I apply the importxml function to Google Sheets and other times it works and other times (without changing anything) it gives me #N/A into cell. What can I do? Thank you very much
How would this work (if at all) in youtube trying to scrape video data? Especially when it comes to tracking down the actual video ID and not the vanity URL? THANKS IN ADVANCE
Is it possible to have google sheets pull information from Search Engine results? For example, enter a business name, and it searches Google and pulls info for that company?
Do you know if it's possible to tell Google sheet to scrap data from a specific location? I tried using those commands, but it was sending me data from United States whilst the page update automatically depending on the country you're accessing it from, though the URL remains the same.
Great tutorial! When I scraped data from a website the data was only scraped until a certain point, even though more yellow containers were highlighted. What is the issue here, does the scraping stop after a certain number of lines?
would love to hear how you would go ahead scraping dynamic pages that loads the content through java / api? I have some different solutions available: Scrapy, Octoparse, Selenium(Python), Java, or somehow retrieving it directly from the API. Could i do it with GraphQL? I need the data to get fed into a cell in a google sheets, i prefer not having to manually load it from a csv. i'm okay at sheets but not python/java
Excellent video. Curious if you could help explain if this is exclusive for text or if numerical data can be extracted as well? If so, could you help coach on how to do that? I keep struggling to get anything but the text headers in a numerical data table that is non HTML tables. Thank you!
Thanks for the awesome video! But how to find the right xpath from youtube? I try SelectGaghets extention, but he gives me a Error: Imported Xml content can not be parsed. Or Error "Imported content is empty" only "//a" xpath works for me...
SelectorGadget doesn't have an icon to click to activate after i Installed on chrome. Is there a Firefox equivalent? Also, how would you recommend scrapping home data from Redfin/Zillow? I would like to paste in links and automatically fill in home data row by row for different homes. For the SF for example, i tried used //div[@class='info-block sqft'] but it doesn't work (shows N/A)
Hello Thank you very very much for this excellent video that is very very helpful Just a question : if I need to scrap the image URL of the product, is there a way to do it ? Thank you
Hey Thank you for the video! Do you know to get the updated data. Example if i am importing a stock price. and i would like to import the updated data after 30 mins.
I can't think of a way other than manually refreshing the formula and cells, however, I do know that Excel supports getting data from stock tickers. You can write a ticker name in a cell, like $AAPL, and then go to the 'data' to format it as a stock ticker, and then fetch a lot of different data points about the stock -- it might be easier than scraping it!
Thank you so much for these tutorials! I think i'll use them in future. Not now, because.. i need to import comments from instagram, and...is there any way to do that? I guess insta won't let google sheet take data from it because it's not "logged in", and..yea.. i would love to hear any answers for it, even if that's a no :")
Which site are you trying to scrape? Websites where the data is loaded dynamically sometimes don't cooperate with Google Sheets / other webscrapers and you may need a different approach
Same problem... I'm trying to scrape youtube.com. I'm watched this video ua-cam.com/video/pwZ44kAeiOo/v-deo.html&t where he scrape youtube with no effort, but right know it's seems it no working any more...
UA-cam dynamically generates content on the page with javascript -- in other words, the page essentially loads and is blank and then the content is populated after the fact. Google Sheets (and other static web scrapers) can only scrape the page if the content is there on the initial page request, but it's unfortunately not able to if the content is generated after.
Hello! I am having a difficulty in understanding. I would like to gather data from "www.roblox.com/groups/8650183/TheSquid#!/about", specifically the the number under funds. How would I be able to do that?
Taking the Craig's List one for example, If you wanted to see the top 300 results, if they were beyond a more button that loaded onto the current page and not on a "page=2" type thing.
Hey Brad, unfortunately if you want to do any kind of UI interaction on the page, you'll need to use a different web scraping method--something like the Chrome web scraper extension or the Selenium library in R or python.
I HAVE NEVER SEEN ANYTHING LIKE THIS IN MY LIFE. Sure, I have see screen scraping back in the old CRT days, but this is UNREAL and it's easy ONCE you know the language!! Excellent Video!
Thank you for this video! I was trying to scrape data from a website and couldn't figure it out until I came across this video.
That tutorial is so useful and simplicit, contain no bs and full of content. You are a champ.
is it possible to get the sector from google finance / yahoo finance page for a stock, i tried but its showing me an error..
More google sheet tutorial please. Thanks a bunch! 😍
Wow! You' re a MASTER of scraping and Google Sheets! Just learned so much with 2 of your videos
Thanks! I’m glad to hear it!
@@dataslice Thank is to you! Only problem is scraping Image URL from Craiglist in your example, I added /@src but it doesn't work
I'm encountering an issue at 4:09 for the //p[@class='result-info'] , as I got a #N/A as a result.
The class name on CraigList is not changed yet, so can't figure out why this isn't working as you.
Thanks for your help and your videos.
EDIT :
#2 On TechCrunch website, I'm not able to click on "XPath" Button. It's not working at all. Otherswebsite are fine tho. Do you have any idea why ?
#3 On Yelp website , the result for the first example in Sheets is CSS code. Far from what you get even if I'm doing the exact same thing.
Your video isn't so old, I really can't figure out why thinks works so differently , I tried to re-watch many times your video to see if I'm missing something but no.... ;(
Thanks, great help for any webside :D
Clear Explanation 👍
Questions
Will the important HTML Is up-to-date data from the source website? If no then please tell us a way to keep a live data
2- I want to scrap ecommerce website product data, how to auto scrap Next page ?
3- How about import data via json file url most e-commerce website uses it eg Shopify
I'll be thankful if you please create an ecommerce website data scraping vidoe or share your tips so ill give it a try 🙂
This video is so good it's basically a cheatsheet.
this channel is gold. Amazing tutorials
Thank you, I appreciate it!
U solved my very unsolved problem - thanks alot!!
Pure gold, great and on point! Thanks for the content.
Glad you enjoyed it!
Superb
finally I found it, absolutely amazing, thank you a lot!
best tutorial ive seen, thank you
Can i do the same on password protected site
Simply Amazing. Thanks for such a wonderful video tutorials
Great content!!
I'm trying to scrape an Amazon list of Item Names & Prices but it will only return a list of 10 of the items... 🤷♂️
Thanks so much for the value! For your yelp example, how would you go about trying to keep a well managed and orderly scrape of all the items across all page numbers over time? Including trying to remove duplicates as each item moves across the different pages?
Thanks!
wow, what an extension! Killer! Love it
You da real mvp
Thanks! :-)
Great video, I apply the importxml function to Google Sheets and other times it works and other times (without changing anything) it gives me #N/A into cell. What can I do? Thank you very much
If nothing is changing, I’m not sure what the issue would be unless there’s an error getting data from the site. What site is it?
@@dataslice I did it through a script and it works. I was told that it was probably the speed of the network. Thanks a lot again
Super useful. You safe my day!
importxml function is not working in google sheets. It is showing NA when trying import the data
Can you suggest a solution
thumbs up for the video, really useful and well explained.
top-notch tutorial, Thanks alot :D
Thanks man you really helped me out here!
Excellent video. Great content!!
Absolutely amazing !!!!
Earned a subscriber great info, clear and concise!
Thank you!
Thank you mr for these useful tricks
Thanks for watching!
amazing..thanks
How would this work (if at all) in youtube trying to scrape video data? Especially when it comes to tracking down the actual video ID and not the vanity URL? THANKS IN ADVANCE
Can we use importxml function directly without using or downloading application or software to scrape data from any website?
Thank you for your help
I tried exactly the same workflow as you but mine is giving me error. it's craiglist with home rental site.
Is it possible to have google sheets pull information from Search Engine results? For example, enter a business name, and it searches Google and pulls info for that company?
How to make it auto update/refresh result? Can i just Reload the google sheet tab
Really good video :D
Do you know if it's possible to tell Google sheet to scrap data from a specific location? I tried using those commands, but it was sending me data from United States whilst the page update automatically depending on the country you're accessing it from, though the URL remains the same.
The =IMPORTXML(B2,B3) isent working for me, the numbers just go grey . Anyway to fix this??
I still get #N/A ??? It worked for Craigslist but not for other sites i tried like Supermarkets?????
same, for prices like walmart
Hello I am an Amazon seller, do you think I could use this technique to retrieve my sales history directly in a Google sheet?
Great info, earned a sub 🙌
How is scrape pictures from Craigslist? Is there a way to scrape desired data from balance sheet from yahoo finance into google sheets?
Excellent Content!
hi there can you help me how to collect data from 'BURSA'?. such as stock price and so on. i already tried all the methods but it did not work
Amazing content
how to extract data from multiple pages on yelp ? not just the first one
is there a way to automatically change the url. lets say like a item id at the end or the url to make a database?
Great tutorial! When I scraped data from a website the data was only scraped until a certain point, even though more yellow containers were highlighted. What is the issue here, does the scraping stop after a certain number of lines?
Victor. Same problem I am having. @dataslice can you comment?
What if I want to scrape all of the images and their respective alt text or all of the h tags in order of their appearance on the page?
hey, i am having the same question. have you found out the solution?
How come this only works for certain website? Eg. When I try to do this on a real estate website or supermarket website i always get the error #N/A?
what did you do to show the xpath??? you did not teach how to show this xpath in your video
would love to hear how you would go ahead scraping dynamic pages that loads the content through java / api? I have some different solutions available: Scrapy, Octoparse, Selenium(Python), Java, or somehow retrieving it directly from the API. Could i do it with GraphQL? I need the data to get fed into a cell in a google sheets, i prefer not having to manually load it from a csv. i'm okay at sheets but not python/java
thank you , useful
Excellent video. Curious if you could help explain if this is exclusive for text or if numerical data can be extracted as well? If so, could you help coach on how to do that? I keep struggling to get anything but the text headers in a numerical data table that is non HTML tables. Thank you!
Thanks for a great video on this subject! But this does not work for me. I get an "error" when try to input the second field in this example!
Hi, how many data row is it limited for importxml function?
I just tried this trying to scrape google play store and failed. is this possible to scrape google play store reviews? please help
Tell me the extension that is using for select all links in one time
Thanks for the awesome video! But how to find the right xpath from youtube? I try SelectGaghets extention, but he gives me a Error:
Imported Xml content can not be parsed. Or Error
"Imported content is empty" only "//a" xpath works for me...
If the page gets updated. The info on the Sheet will get updated as well?
Hello thanks for the awesome tutorial, however, how do you do this with a webpage you have to log in to get table info?
SelectorGadget doesn't have an icon to click to activate after i Installed on chrome. Is there a Firefox equivalent?
Also, how would you recommend scrapping home data from Redfin/Zillow? I would like to paste in links and automatically fill in home data row by row for different homes. For the SF for example, i tried used //div[@class='info-block sqft'] but it doesn't work (shows N/A)
Mine worked fine..
nicely done...
How if we collect data from website with basic auth to spreadsheet
Can we use importxml to extract photos to Google Sheets? If so, what is the process?
Hello
Thank you very very much for this excellent video that is very very helpful
Just a question : if I need to scrap the image URL of the product, is there a way to do it ?
Thank you
hey, i am having the same question. have you found out the solution?
Tried doing this for rental units to find but just kept getting an error sadly
Hey Thank you for the video!
Do you know to get the updated data.
Example if i am importing a stock price.
and i would like to import the updated data after 30 mins.
I can't think of a way other than manually refreshing the formula and cells, however, I do know that Excel supports getting data from stock tickers. You can write a ticker name in a cell, like $AAPL, and then go to the 'data' to format it as a stock ticker, and then fetch a lot of different data points about the stock -- it might be easier than scraping it!
Señor, usted SAPE.
How do you use this function to scrape hyperlinks in the website?
can you please guide me how to scrape skyscanner and kayak Best price in google sheet.
thanks
thank you for the quality tutorial. i'm looking for a way to scrape data from SSRS to google sheet. is this possible? thanks
hey man, having trouble scraping yahoo finance onto a spreadsheet, can you help?
You're a beast.
I'm having a hard time scraping data from skybox. hopefully this helps
How do you scrape data from a website that is behind a paywall?
Thank you so much for these tutorials! I think i'll use them in future. Not now, because.. i need to import comments from instagram, and...is there any way to do that? I guess insta won't let google sheet take data from it because it's not "logged in", and..yea.. i would love to hear any answers for it, even if that's a no :")
Selector Gadget does NOT work with Craigslist, OfferUp, or Walmart.
How to get data in Google Sheet from a website after login?
How to import the tables that filled with api data?
This is AWESOME! Do you know if this is possible to do with a site that requires a login?
Does this work with Microsoft Edge? Do you have discord server? I wanna ask something. :)
this is so helpful! is it possible to use this method to get the links in the page?
How can I get the URL link?
Can you import the images?
Love it thanks for sharing! Do you have one on python by chance? I saw the one on R but am curious if you do anything with python.
I’m working on a python one now - thanks for watching!
@@dataslice Can't wait! These are awesome!!
Thanks for this great tuto. when i'm trying to use on a realtor listing, google sheet result is "N/A", what did i make wrong ? thanks
Which site are you trying to scrape? Websites where the data is loaded dynamically sometimes don't cooperate with Google Sheets / other webscrapers and you may need a different approach
Same problem... I'm trying to scrape youtube.com. I'm watched this video ua-cam.com/video/pwZ44kAeiOo/v-deo.html&t where he scrape youtube with no effort, but right know it's seems it no working any more...
Regular devtools has right click on element > copy > copy xpath
Is this data updated automatically?
Will this update daily?
why is this failing with youtube links?
UA-cam dynamically generates content on the page with javascript -- in other words, the page essentially loads and is blank and then the content is populated after the fact. Google Sheets (and other static web scrapers) can only scrape the page if the content is there on the initial page request, but it's unfortunately not able to if the content is generated after.
All is cool, until google sheets gives "Loading" forever if you input more data...
How would you do this with links
Hello! I am having a difficulty in understanding. I would like to gather data from "www.roblox.com/groups/8650183/TheSquid#!/about", specifically the the number under funds. How would I be able to do that?
Hey mate! Great tute. Any idea how to get the info beyond a "More" button using these methods?
Taking the Craig's List one for example, If you wanted to see the top 300 results, if they were beyond a more button that loaded onto the current page and not on a "page=2" type thing.
Hey Brad, unfortunately if you want to do any kind of UI interaction on the page, you'll need to use a different web scraping method--something like the Chrome web scraper extension or the Selenium library in R or python.