How To Use ChatGPT To Fully Automate Web Scraping

Поділитися
Вставка
  • Опубліковано 10 вер 2024

КОМЕНТАРІ • 58

  • @alkuzad
    @alkuzad Рік тому +29

    For me, it did not show the potential of the tool. You set requirements and then instead of fixing it with ChatGPT you just removed it. Prompt has to be more descriptive and not just "parse the website" to get good results. Pip install command is incorrect but because you had it already pre-installed it works.

  • @mikecorbean8819
    @mikecorbean8819 Рік тому +4

    Well, my CGPT buddy has been troubleshooting this w/ me now for about an hour.
    I'm on my 4th version of code from my partner.
    All 4 run successfully but the resulting csv file only contains the headers:
    column A: "Movie"
    column B: "Title"
    Now she's suggesting we attack this one using the API - argh!

  • @hamburger--fries
    @hamburger--fries 7 місяців тому

    This was super helpful - Like a gateway drug. I used it a little differently. I scrapped 2000 books from my companies site and then removed various html and other odd things that occured in a OCR scan years ago. Anyway thanks!!!!

  • @MyMindGeek
    @MyMindGeek 7 місяців тому +6

    I am feeling dizzy after this video. Still too complicated and unaccessible to the layman.

    • @GoalRushTV-l6d
      @GoalRushTV-l6d 6 місяців тому +1

      That’s the easiest video I have watched today

  • @ryandunner
    @ryandunner Рік тому +3

    Hey!
    I am looking to scrape data from a website, specifically news articles from a few sources I have. I want to scrape this data and then have it automatically plugged back into chat gpt for further prompting, is that possible?

    • @asifmian43
      @asifmian43 3 місяці тому

      yes, you can contact me

  • @user-ch8hh5oy6g
    @user-ch8hh5oy6g Рік тому +2

    where do I put the code, pleas? I am not IT at all, BUT willing to learn this scrape skills as I considr it great stuff for us sales people. P.S. how would you suggest to scrape 1. all 5* hotels in New York and 2. car rentals in all Caribbean? Muchas gracias, joseph

    • @viljevisser1442
      @viljevisser1442 9 місяців тому

      Hi! I work with a lot of sales teams to generate new cold leads for them via scraping. Let me know if I can assist.

  • @yaakovk9468
    @yaakovk9468 4 місяці тому

    it's can work with linkedin to or google search ? for emails or more ?

  • @gaa535g
    @gaa535g Рік тому +1

    Thank you! That was easy ❤

  • @dr.samuelburbanks4905
    @dr.samuelburbanks4905 Рік тому +3

    How do you get to the terminal. so many steps left out.

    • @MichaelShingo
      @MichaelShingo Рік тому

      Windows: search "Command Promp", Mac: search "Terminal"

    • @vasilepelmus3308
      @vasilepelmus3308 Рік тому

      Exactly! But they said how to create an account with Chat GBT for 2 minutes🤦‍♂🤦‍♂🤦‍♂

  • @dr.samuelburbanks4905
    @dr.samuelburbanks4905 Рік тому +5

    You are skipping important steps like what is the app that you used to paste the code in, yes you said it but I didn't understand what you said.

    • @MichaelShingo
      @MichaelShingo Рік тому +1

      VS Code

    • @bifrostbeberast3246
      @bifrostbeberast3246 Рік тому

      @@MichaelShingo The video shows a man who asks ChatGPT to program for him and it does. You might get the idea that you also could ask ChatGPT all the things you want to know. Like: "What is a software called, where programmers program inside?"

    • @heroe1486
      @heroe1486 5 місяців тому

      @@bifrostbeberast3246 And chatGPT would figure out if this man was using Neovim, vim, Sublime Text, Visual Studio, Vscode, Atom or whatever ? This video is just some clickbait that made some people think it was really automated while he copy pasted some basic code you'd figure out by reading some README for 5 minutes, ofc it'd bring clueless non programmers.

  • @comptegmail273
    @comptegmail273 Рік тому +1

    do you know how to scrape data frmo glassdoor

  • @MirGlobalAcademy
    @MirGlobalAcademy 4 місяці тому

    .empty what is the purpose of it?

  • @alphalobo7161
    @alphalobo7161 22 дні тому +1

    To me this is ridiculous. You start off saying we will not need to know any code, and then we are up to our elbows in code!

  • @user-wl7iu4ec2c
    @user-wl7iu4ec2c Рік тому

    What if BeautifulSoup and openai prompt to be used to analyse the data and fetch the information what is required.
    any one has tried out.

  • @TheCentoru
    @TheCentoru 8 місяців тому

    Sorry mate, but the error fix at 8:15 makes this approach as NOT fully automated

  • @ahmadmerei7979
    @ahmadmerei7979 Рік тому +2

    Thank you for sharing but still want more details on how I can learn this step by step? any reference, courses?

    • @xsw882
      @xsw882 Рік тому +6

      chatgpt will explain it to you step by step

  • @mangeshsawant6361
    @mangeshsawant6361 Рік тому +1

    helpful video, thank u

  • @bigd6566
    @bigd6566 Рік тому +3

    Hello, can you please show me how to get just the actors from all the 250 movies without including the directors? Thanks

  • @Peepstep
    @Peepstep 9 місяців тому

    How to about getting contacts from sites like jist dial india mart..make a video about getting contacts from websites use chat gpt

  • @adied7725
    @adied7725 Рік тому +1

    Hi thanks for the video,
    How to visualise this data in wordpress?, please I'm trying to build a we scraper or url parser... Any ideas much appreciated thanks

    • @bifrostbeberast3246
      @bifrostbeberast3246 Рік тому

      ChatGPT cann explain it to you

    • @adied7725
      @adied7725 Рік тому

      @@bifrostbeberast3246 how?, please i'm not a develper any pointers?

  • @jessbailie1628
    @jessbailie1628 Рік тому

    can this be used to scrape email addresses? the addresses are publicly available on the company website.

    • @jaypg3d977
      @jaypg3d977 Рік тому

      you can scrape anything as long as there is no restrictions that prevent it

    • @justaguy905
      @justaguy905 Рік тому

      put a requirement of '@' to scrape it

    • @ilyasalmas8841
      @ilyasalmas8841 Рік тому

      @@justaguy905 ?? explain

  • @bifrostbeberast3246
    @bifrostbeberast3246 Рік тому +3

    People asking stupid questions in the comments without realizing that they get an instant answer if they would ask ChatGPT, which is the very topic of the video. MAybe it's better those people don't know how to do the stuff they ask for. It's like giving a monkey a gun.

    • @akshayy_xd
      @akshayy_xd Рік тому

      Hahahahaha

    • @Cahangir
      @Cahangir 10 місяців тому

      dont worry, they'll learn when they are banned from a certain website ))

  • @MarblelessMedia
    @MarblelessMedia 8 місяців тому

    This is no longer working. I'm told it goes against internet policy.

  • @abhishekprakash9803
    @abhishekprakash9803 Рік тому

    i have a one questions like ...........we want to build a chatbot .....for confidential document ....can chatgpt give the answers from my documents how to link my document to chatgpt.

  • @shivamkk007
    @shivamkk007 6 місяців тому

    Basically Taught how to use chatGPT... That wasn't what I came here for

  • @tapforall
    @tapforall Рік тому

    doesn't work

  • @v1s1v
    @v1s1v 11 місяців тому +2

    This actually shows that it's not that easy to fully automate web scraping with ChatGPT. There are AI-powered web data extraction providers like Kadoa that actually make it easy.

  • @creamsodabish
    @creamsodabish Рік тому +1

    yeah man, you skipped over a LOT of stuff. all good. i'll figure it out

    • @bifrostbeberast3246
      @bifrostbeberast3246 Рік тому

      He literally showed in the video how you can ask ChatGPT everything you want to know and it will even code for you. But yeah, I am sure you will figure it out.

  • @kirill_good_job
    @kirill_good_job 9 місяців тому

    your experiment is not replicate

  • @nadranaj
    @nadranaj 11 місяців тому

    misleading title. It should have been "How to use ChatGPT to generate code to do web scraping"

    • @heroe1486
      @heroe1486 5 місяців тому

      Yeah this video doesn't show any "automated" webscrapping, he's just asking chatGPT for basic code you'd figure out by reading some README, some library genuinely do some sort of scrapping automation, requests and Beautiful soup are basic tools that don't do that and would actually be used in the core of such projects. It's a video for laymen I guess.

  • @tajinetopf95
    @tajinetopf95 Рік тому

    danke du bist im deutschen netz

  • @MichealS-bi8xt
    @MichealS-bi8xt Рік тому

    ChatGPT is just used as a scaffolding tool there. Nothing revolutionary. Sure it will make you gain a lot of a time if you already know how to code. If you don't know how to code AT ALL, you will struggle, even with Chat, you will probably struggle LESS than without Chat but don't expect to produce top notch apps. This is sold by people who just want YT views and sell tutorials.

  • @ibessf
    @ibessf Рік тому

    Your Englisch Sound a bit German 😅

  • @brandonjoseph3422
    @brandonjoseph3422 Рік тому

    Nonsense

  • @kakamoora7874
    @kakamoora7874 Рік тому

    Jokes 😂

  • @bbrrrrr6553
    @bbrrrrr6553 Рік тому

    ChatGPT is just used as a scaffolding tool there. Nothing revolutionary. Sure it will make you gain a lot of a time if you already know how to code. If you don't know how to code AT ALL, you will struggle, even with Chat, you will probably struggle LESS than without Chat but don't expect to produce top notch apps. This is sold by people who just want YT views and sell tutorials.