Web Scraping Tutorial | Data Scraping from Websites to Excel | Web Scraper Chorme Extension

Поділитися
Вставка
  • Опубліковано 1 жов 2024

КОМЕНТАРІ • 829

  • @paulajohnston3015
    @paulajohnston3015 2 роки тому +1

    Please help. Azharul explains wonderfully but when I need to select a black blob appears and not a hand? Thanks

    • @gurjitkaur1550
      @gurjitkaur1550 2 роки тому

      I'm having the same issue. Did you find any solution? If yes, please share

  • @magicmaniac5482
    @magicmaniac5482 2 роки тому +1

    On the parent selector part it does not let me select the "pages" since it's so far away from "root", it only lets me select one of them or all of them. Can someone help?

    • @sadiyamatori
      @sadiyamatori Рік тому +1

      I am having the same issues we need help here.

  • @payamsarwar5611
    @payamsarwar5611 2 роки тому +2

    Hi Sir,
    I am unable to select multiple pages from linkedin, saying - selector is required and cannot be empty.
    Yellowpages fine
    Please please help

  • @AzharulRafy
    @AzharulRafy  2 роки тому +6

    Need Help with Data Scrapping? Hire a Freelancer: rafys.net/DataScrapping
    Get Octoparse Web Scraper: rafys.net/Octoparse
    All the best,
    Azharul

    • @jalalehamza3820
      @jalalehamza3820 2 роки тому

      Very detailed and 100% helpful
      But when I export data long website appear like this, for exemple: www.youtu...
      and i don't know how to solve it
      Thanks for your help

    • @kapetanegros6514
      @kapetanegros6514 2 роки тому

      i've tried creating my own sitemap but it seems i cannot click on 2 parent selectors. i can only click one parent selector. what seems to be the problem on that part? thanks

  • @pixileads
    @pixileads 2 роки тому

    I am facing a problem while scraping a car selling website. There is a button for phone no., after clicking the button the phone no. should appear. I want to extract the phone no. I need help on that I tried all the options but failed. Not even element click option worked.

  • @veronicamarcos356
    @veronicamarcos356 Рік тому +20

    I must say that this video has been an incredibly helpful tutorial. I've always been curious about how to extract and analyze data effectively, and this resource has provided me with clear guidance and valuable insights. I truly appreciate the effort put into creating such an informative and beginner-friendly tutorial.

  • @AzharulRafy
    @AzharulRafy  2 роки тому +1

    You can Hire a Web Scraper to Get Data Scraped from any resource: go.fiverr.com/visit/?bta=353100&brand=fiverrhybrid&DScrappingYT&landingPage=https%3A%2F%2Fwww.fiverr.com%2Fcategories%2Fdata%2Fdata-processing
    All the best,
    Azharul

  • @MehdiGuizani
    @MehdiGuizani 3 місяці тому +2

    Copy paste 😂

  • @paulajohnston3015
    @paulajohnston3015 2 роки тому +1

    I agree - great video but the moment I need to select, I get a black blob and can't go further. I have searched and can't find an explanation? Thank you.

    • @gurjitkaur1550
      @gurjitkaur1550 2 роки тому

      Hi. I'm having the same issue. Did you find any solution? If yes, please share

  • @dennisjohnson5555
    @dennisjohnson5555 Рік тому +2

    Hi Azharul - Thanks for the help in scrapping. I have one problem making this work. I can only collect from 1 page. Tried mulitple times its not extracting more than 20 contacts from a page of 100 and also not collecting from other pages any help here ?

  • @MrSanGotenks
    @MrSanGotenks Рік тому +39

    This is literally by far the best tutorial i've ever watched. No bs straight to the point, you gained a follower kind sir!

    • @DrGuy118
      @DrGuy118 6 місяців тому

      This tutorial changed my life.

  • @andyliu3342
    @andyliu3342 Рік тому +1

    Hi Rafy, How are you doing these days? Could you please share with me a better tool for the WhatsApp number or mobile number scraper, please? If you have one, please do let me know, where is that video clip, please?

  • @RohitSingh-bh5yn
    @RohitSingh-bh5yn Рік тому +1

    how to convert this scrapped data into json and use it as an api in our project website?

  • @Jameslu-c4v
    @Jameslu-c4v 2 місяці тому +2

    press F12 to get this console.

  • @AzharulRafy
    @AzharulRafy  2 роки тому +1

    Need help with scraping data? Check this out: wher2hire.com/datascraping/
    If you are facing any difficulties with scraping data from any website, you can hire someone from Fiverr to get all the data scraped from any website. You will find professionals who writes custom scripts to scrape data from any website.
    Tip: Before you hire any freelancer, please spend some time reading some of the reviews from their previous clients. It will help you learn more about the freelancer, and will help you find a best fit for your project.

  • @izufractiongaming7044
    @izufractiongaming7044 Рік тому +1

    Anyone know how to retrieve data from website. The problem is, in order to get the data, you need to enter their phone number first to make it appear.

  • @arabicvoice1
    @arabicvoice1 Рік тому +1

    আচ্ছালামু আলাইকুম
    ছার আমি ইন্ডিয়া আসাম রাজ্যের।
    ছার আমি আপনার Udemy student.
    ছার আমি এই web scrapper নিয়ে একটি সমস্যায় পড়েছি দয়া করে সমাধান দিবেন। ছার আমি যখন নতুন পেজ বা টেব অপেন করি এই scrapper Page সম্পুর্ন ভাবে চলে যায় এবং নতুন পেজ full screen এ অপেন হয়। তার কারনে আমি second step করতে পারছি না।

  • @myb_vlog
    @myb_vlog Рік тому +1

    Why can't I get into yelp!?? Would you please help me Rafy Bhai!

  • @JayJay-tb2rc
    @JayJay-tb2rc 2 роки тому +49

    This was by far the best no bs video.Thank you so much. You have saved me so much headache, time and money. I liked it as it's very straightforward and easy to follow. THANK YOU. Jay - London

    • @rimantasdanilevicius6754
      @rimantasdanilevicius6754 Рік тому

      the web scraping do not scrap all data. How you solved this problem?I tried to set delay 10 sec and still not all data have been scraped...

    • @darioyou1
      @darioyou1 Рік тому

      @@rimantasdanilevicius6754 Bro, did you manage to solve the problem with the delay? I need to scrape more than 40 thousand pages. But it's just text. cheers!!

    • @nettakay2116
      @nettakay2116 9 місяців тому

      @@rimantasdanilevicius6754 Did you ever find out what happened? My site has 985 rows but it only scraped 200. I'm thinking it only scrapped the first 10 pages and not the pages under "Next".

  • @maker4986
    @maker4986 2 роки тому +1

    @10:26 how do you select two of them? I can't..

    • @Iestynity
      @Iestynity 8 місяців тому

      hold ctrl and click

  • @5hadTech
    @5hadTech 3 роки тому

    আসসলামুআলাইকু, আপনারা যারা ইংরেজী বুঝেন না তারা চাইলে আমার চ্যানেল থেকে ভিডিওটি দেখে নিতে পারেন ওয়েব স্ক্রেপার নিয়ে বাংলায় ভিডিও তৈরি করা আছে

  • @belsoulaf2054
    @belsoulaf2054 Рік тому +1

    Hi ! I cannot select the pagination with type "link" What should I do ? I hope You'll see my comment and answer me

  • @hummingawayawayaway
    @hummingawayawayaway 2 роки тому +1

    when i create a new selector and try to click on the name on the webpage, I am unable to select the text to proceed to "done selecting". For some reason, the hand symbol doesn't appear for me. Instead, I get some weird transparent circle. Did anyone else have this issue?

    • @gurjitkaur1550
      @gurjitkaur1550 2 роки тому

      I'm having the same issue. Did you find any solution? If yes, please share

  • @aarspainting81
    @aarspainting81 Рік тому +1

    well I guess subscribe and like are not enough

  • @terencebenjamin3382
    @terencebenjamin3382 2 роки тому +1

    Hi, I started getting this error when trying to setup the selector. chrome extension "Could not establish connection. Receiving end does not exist.:

    • @gokulkrishnan4721
      @gokulkrishnan4721 2 роки тому

      I got an error saying "No data scraped yet" 🙃 someone please help me

  • @zhaldzh4882
    @zhaldzh4882 2 роки тому +3

    Hi Azharuf, what is the meaning of the C button when choosing "link" ...by the way..nice video

  • @bbetter128
    @bbetter128 Рік тому +1

    Hey man can i do web scrape based on a audio/sound?

  • @nagkawew2290
    @nagkawew2290 Рік тому +1

    Hi Rafy thank you for sharing tecnic but I got a problems to asked you. When I have browsing the record for Phone no. & Email the web shown some of them with ellipsed (+11 123456....) then I have export data for excel or csv that show me hidden with ellipses too.

  • @md.tauhidulislam6351
    @md.tauhidulislam6351 Рік тому +1

    Dear Azharul Rafy, Your videos are very helpful for learning. But, when I follow this video learning, the process is not in working. web scraping option does not come in appear. will you mind to solve the problem or may I get any support from you?

  • @Syed_hizqeel
    @Syed_hizqeel 2 роки тому +1

    why i am not able to extract the number

  • @ShakilHasan-k6f
    @ShakilHasan-k6f Рік тому +1

    I did everything as per your instruction, but it only works for one page. After completing one page it stopes.

  • @arunkumar2029
    @arunkumar2029 2 роки тому +1

    What if after slelecting the link - instead it opens a new chrome tab?

  • @amitsaraogi4755
    @amitsaraogi4755 2 роки тому +1

    instead of yellow page, how to do it from google

  • @leonvla
    @leonvla 2 роки тому +1

    Nice tutorial, how can I scrape multiple of images? pagination --> image (multiple)? i don't understand, sorry

  • @maxshutter8427
    @maxshutter8427 Рік тому +1

    It works but only the first 5 pages and then stops. Is there a way to keep it going without stopping?

  • @little__secret_9119
    @little__secret_9119 2 роки тому

    Sir ma jab be linkedin pr people search krta hun to people ka name ke jaga linkedin user likha ata or un ke profile open nhi hoti ma kya krun please guide kr dan 😢

  • @amelieguzman9639
    @amelieguzman9639 Рік тому +17

    You don't imagine how this tutorial has helped me in my new position. Thank you so much!!

    • @munirsaint1127
      @munirsaint1127 Рік тому

      hi....when i click the serial no. 1 that link open in new tab...what is this type of problem...please guide me...thanks

  • @noahscares
    @noahscares 11 місяців тому +1

    I tried to select the link but my mouse cursor goes round when I leave the chrome extension to the target webpage
    Can u help me with that ..?pls

  • @mr.k7475
    @mr.k7475 5 місяців тому +1

    Hello there. I need some help. I have followed all the steps up until make selection. When I go for selecting multiple titles, it won't allow me. For example I select the first title, after that when I click on the second title, the previous selection disappears and only the last selection remains.

  • @harshitjain4282
    @harshitjain4282 2 роки тому +2

    what is the use of P,C,S buttons while selecting a link? And how to know whether to use link option or pop-up link option?

  • @knp9145
    @knp9145 2 роки тому +2

    Very informative VDO! Thanks! How can I select multiple Parent Selectors? I can't select _root and the pages.

  • @lola.ooshin9315
    @lola.ooshin9315 2 роки тому +10

    Thank you! Thank you! Thank you! I have been looking for a a video like this to teach me how to scrape data and might i say, your video is absolutely amazing and straight to the point! Amazing job!

  • @izufractiongaming7044
    @izufractiongaming7044 Рік тому +1

    How about data that need captcha?

  • @hasanurrahman6254
    @hasanurrahman6254 2 роки тому +1

    Which scrapper is better between Web scrapper and Instant Data scrapper ??

  • @wizaasir
    @wizaasir 2 роки тому +1

    When you select C that is child for certain IDs, does that mena you are setting them as children for the link or what?
    Thanks!

  • @applenests9650
    @applenests9650 Рік тому +1

    What do the "P", "C", "S" stand for when selecting something? How do we know which to use for what? Also, what are the different "Type"s you can choose from when adding a new selector?

  • @endrit5778
    @endrit5778 11 місяців тому +3

    00:00 Learn how to scrape data from websites using a free Google Chrome extension
    02:09 Scrape data from Yellow Pages using Web Scraper extension
    04:18 Creating selectors to collect business information
    06:25 Select and save selectors for phone number, address, website, and email
    08:35 Creating a sitemap with multiple pages
    10:33 Automate web scraping with intervals to avoid restrictions
    12:38 Automatically extract missing contact information from business listings
    14:33 Extracting data from business listing websites
    Crafted by Merlin AI.

    • @paliwalji7620
      @paliwalji7620 10 місяців тому

      what if we want to extract phone numbers from all the pages?

  • @jewelrana4522
    @jewelrana4522 6 місяців тому +1

    If every data open in a new tab what should I do?

  • @UzairKhan-mj3pe
    @UzairKhan-mj3pe 2 роки тому +1

    wow very good mashallah
    thank you sir you solve my problem

  • @jasmadsen
    @jasmadsen 2 роки тому +1

    Do you have a video on how to use this on pages that have infinite scrolling pages? Thanks!

  • @advancepoint2923
    @advancepoint2923 2 роки тому

    hi i am facing issue data fetch in yahoo finance page to get data con you guide me

  • @md.kawsarhowlader2052
    @md.kawsarhowlader2052 2 роки тому +1

    Dear Brother So Nice Videos & very expression.

  • @Rishee_Pal
    @Rishee_Pal 2 роки тому

    Hi Azharul. This chrome scraper Wil work on sales LinkedIn navigator.

  • @euphrasiagomes4271
    @euphrasiagomes4271 2 роки тому +1

    Can you upload any video for me how can I type very fast?

  • @mwewachisenga9179
    @mwewachisenga9179 2 роки тому +7

    Hello Azharul. The video is very very helpful. I have a question though. Is it possible to refresh the scrapped data in excel by a click of a button or something ? If YES, how can I go about it ?

  • @Jawirjawara87
    @Jawirjawara87 2 роки тому +3

    Helpfull actually. But it doesnt work correctly when I tried it. I want to scrape the front page (without nesting or without link-inside-link) only. After clicking on Scrape option, it doesnt have any result although I am able to preview the data. Why ? thanks for the help

  • @aditisplayworld5853
    @aditisplayworld5853 2 роки тому +1

    Thank you for the video..Can it be used at Organization level? Is it a paid service?

  • @tiktokcelebrities5318
    @tiktokcelebrities5318 2 роки тому

    I am trying to scrap the same website like you are doing. But the page doesn't have pagination. It has only the next button, How to handle such query

  • @tatendasithole2471
    @tatendasithole2471 2 роки тому +2

    This is a cheat code in life. Thanks

  • @hotchpotch1234
    @hotchpotch1234 2 роки тому

    how to scrape HTML images and convert to PNG? Please help me brother, buyer requirement this.

  • @RedEm-f5r
    @RedEm-f5r 2 роки тому +1

    very detailed.. it help me a lot

  • @mirtecox2872
    @mirtecox2872 10 місяців тому +6

    Such a good tutorial! There wasnt a single moment where it was unclear to me what you were doing. As a beginner with webscraping I managed to make it work, thanks to this video!

  • @sylvanusmwamba7296
    @sylvanusmwamba7296 2 роки тому

    Hi there, I have tried so many times, but I am staking I can't complete the scraping process yet I follow all the instructions, anything I have missed?

  • @Islamic_Beauty23
    @Islamic_Beauty23 2 роки тому

    Sir Mera doosra site map nahi ban Raha pages k liye.add selector option hee nahi araha

  • @HudsonLukeSeptimo
    @HudsonLukeSeptimo Рік тому +7

    Wow! The way you explain is very clear and concise. This is very helpful especially for someone like me who is not really good in coding. thank you sir!

  • @Bellmatik
    @Bellmatik 2 роки тому

    Ooohh - Sorry to post this. I have just seen your excellent scrape video regarding GOOGLE MAPS....using the Instant Data scraper...
    It does not work for me since the data is not organized in google maps, but in some other way. I will watch more of your videos and try to learn more of the scraping busyness.... :-)

  • @ZLKYass
    @ZLKYass 2 роки тому

    How to gather images links from a slider please?

  • @colvideos1
    @colvideos1 7 місяців тому +1

    But Yellow Pages directory are displayed in the most simple format, so any scraper can scrape that directory. Never scrape YP directory because the leads are total miscatagorized garbage.

  • @mdabdurrahmanrakib8299
    @mdabdurrahmanrakib8299 2 роки тому

    Brother? How much data I can scrape with this extension?

  • @abdulwaheed2513
    @abdulwaheed2513 2 роки тому +2

    Hi, very useful tutorial and tool. I am facing one issue with Auto Pagination websites. As soon as we scrool down, the data loads and page url remains the same. in this case, we cannot select the pagination Link... so any solution for this?

    • @santiagobardelli5675
      @santiagobardelli5675 Рік тому

      I am facing the same problem, so when I run the process at the end it gives me an error message, no data collected...

  • @wwefan29m
    @wwefan29m 2 роки тому +5

    Hi. Great video. I learned a lot. How do you select data in a simple drop drown menu?

  • @josiahmunguti2493
    @josiahmunguti2493 Рік тому +1

    My scraper tool is not selecting items from the website ....as I move the cursor it show a round grey thing not the actual arrow wat should I do?

  • @JohnMiles-u2l
    @JohnMiles-u2l Рік тому +1

    Very informative video. I did everything but am still unable to highlight my link using s hotkey. it keeps redirecting me to link i am trying to select

  • @richardnnamdi3414
    @richardnnamdi3414 2 роки тому +1

    Good day Azharul thanks for the helpful video tips. Please can you coach me more on data scrapping and lead generation?

  • @positivesounds2273
    @positivesounds2273 Рік тому +1

    thanks this will help my buisness alot

  • @joaochiavelli4056
    @joaochiavelli4056 2 роки тому

    is there a way to fill in fields with the extension, for example make a login?

  • @SafdarAli-kx9hf
    @SafdarAli-kx9hf 2 роки тому

    Hi,
    Thank You, but I have issue each time clicking on Inspect the chrome shows "DevTools failed to load resource".
    Kindly help me with it.
    Thank You!

  • @IlanSmithillusionist
    @IlanSmithillusionist 2 роки тому

    Thank you Azharul! This is great. am I able to scrape within a search on LinkedIn? As an example, i seach for Head of Marketing for companies in my area, and them scrap those results?

  • @digitalislam4376
    @digitalislam4376 2 роки тому +1

    amazing tutorial. you saved my 1000's of dollars.

  • @tahareemkhan3343
    @tahareemkhan3343 2 роки тому

    This is great, Am gonna try it out, however, what can I do if i want to scrap like 20K email addresses?

  • @apptextouhid6753
    @apptextouhid6753 2 роки тому

    Hello Brother, When i try , not find button "create site map" can you pls advise

  • @alfonso.agvmedia
    @alfonso.agvmedia Рік тому +1

    Amazing video Azharul! Tysm

  • @shadrackawunyo7786
    @shadrackawunyo7786 3 роки тому +4

    Hi Azharul. Thank you very much for this wonderful insight. One question. Please is this process dynamic? Can it be refreshed to get new data when the page is updated?

  • @hardeepbhatti8619
    @hardeepbhatti8619 2 роки тому

    How much can I scrape from a single website using this tool?

  • @gtag174
    @gtag174 2 роки тому

    is this possible with find a variable based on a search term. Like search for Table and find the Item code for it

  • @tnishachaudhary6231
    @tnishachaudhary6231 2 роки тому

    As in your video, the link of businesses is opening on same page but in my case(Amazon product) its opening in new page and it's not working the same way

  • @airahaeri9536
    @airahaeri9536 2 роки тому

    Please help. I have followed the instructions, but the data is not scraping. What seems to be the problem, Sir? When I click the scrape, it does not open a new window.

  • @drhaqeeqattv
    @drhaqeeqattv 2 роки тому

    Sir g, which tool is best for scraping E commerce data
    Like product name, description, price, specification,
    Import.io is not working

  • @hipockt4
    @hipockt4 2 роки тому

    Azharul is it normal for prices not to show when scraping amazon with the google web scraper?

  • @elialanza8645
    @elialanza8645 Рік тому +1

    Hey mate, this is super useful, thank you very much
    What do we do if we're scrapping phone numbers that are hidden behind a button.
    For example, we do everything you've listed in the page but to see the phone number we have to click a button to "show" the number and then the number itself isn't text but is also a link. Thank you again

  • @mrcooltube1
    @mrcooltube1 Рік тому +1

    Thank you a lot for making the video. I did the same as you said. Unfortunately it only scraped the first page. where did I get it wrong?

  • @allabouttechurdu3675
    @allabouttechurdu3675 3 роки тому

    *Hi Azharul* how are you.. i'm facing a problem plzz help, When i start scraping it barely scrape 3 pages although there are more than 3 and after scraping 3 pages it stops it's own :(( PLZZZ HELP

  • @clydeoporto
    @clydeoporto 2 роки тому

    hi, for Instagram I wonder why I can't be able to extract the numbers of followers. I don't know why?! do you have any idea? thanks and more power to your channel.

  • @djal3xus
    @djal3xus Рік тому +5

    Absolutely terrifying ! Number one ! Although the plugin is outdated and a bit different than the current version the video is TOP NOCH!
    I would like to see a bit more in depth explanation, but the tutorial is super ! Great work !

  • @vikasthk786
    @vikasthk786 2 роки тому +7

    Hi, What if link window opens in another tab automatically?

    • @swapneelhosur6143
      @swapneelhosur6143 2 роки тому

      There should be an option in Google Chrome settings to open page in same tab just check it out.

    • @themeyer2010
      @themeyer2010 Рік тому

      Just open up the inspector tool again in that tab and then return to the original page. You’ll have to refresh the site map when you return to the original page. But it does work and pull the data over.

    • @dwijgurram5490
      @dwijgurram5490 Рік тому

      ​@@themeyer2010 your technique screws up the site map

    • @anisfakir1394
      @anisfakir1394 Рік тому

      I am facing same problem
      Give me solution please

  • @sofianearrad4689
    @sofianearrad4689 2 роки тому

    Thank a lot for this video ! but please i want to scrap it for woocommerce and for images i have problem, do you know how i can fix it ?

  • @intanayu7615
    @intanayu7615 2 роки тому

    thankyou! It's really helpfull. Can I use this for website that don't have any link except the pages? because I tried this, and it didn't work

  • @physics1927
    @physics1927 Рік тому +1

    Nicely explained

  • @mahabutt3327
    @mahabutt3327 3 роки тому

    Please help me when i scrape page that has 60 listing but this scraper only scrapes 15 listing

  • @mouhamed126
    @mouhamed126 2 роки тому

    Hi, when I click select it says" Could not establish connection. receiving end does not exist" how to solve that please