Selenium in Google Colab Tutorial For Beginners: Web scraping To Google Sheets

Поділитися
Вставка
  • Опубліковано 25 жов 2024

КОМЕНТАРІ • 37

  • @aidenstyle8604
    @aidenstyle8604 5 місяців тому +1

    I am from Thailand. I love you, Guy

  • @100busan
    @100busan 18 днів тому

    I am from Korea. I love you, Guy

  • @brutekerb4582
    @brutekerb4582 Місяць тому

    debir haber visto este tutorial de primeras muchas gracias thank you so much

  • @LeitordeMapa
    @LeitordeMapa 5 місяців тому +1

    Perfect, you saved my day!

    • @ScrapingNinja
      @ScrapingNinja  5 місяців тому +1

      Glad I could help! don't forget to subscribe.

    • @LeitordeMapa
      @LeitordeMapa 5 місяців тому

      @@ScrapingNinja You earned it, for sure

  • @mariana_anst
    @mariana_anst 3 місяці тому +1

    Unfortunately couldn’t pass from step on 5:18, the command driver = web_driver() didn’t work. Just giving up on trying to use selenium on colab. Visual Code has been better to me…

    • @ScrapingNinja
      @ScrapingNinja  3 місяці тому

      Can you share the error?

    • @allah-swt
      @allah-swt 29 днів тому

      It works perfectly fine on Colab. I'm using the selenium on colab.

  • @tomhanksact
    @tomhanksact 7 місяців тому +1

    i want to ask brother, how to Bypass Cloudflare anti-bot service detected ? With undetected_chromedriver doesn't work. Still got blocked.

    • @ScrapingNinja
      @ScrapingNinja  7 місяців тому

      Use playwright with playwright_stealth.

  • @ilvhimekazain
    @ilvhimekazain 4 місяці тому

    bro, try using this method again to scrape all the product review components on the Lazada website, when I tried it like in the video and just adjusted what I wanted to scrape by copying the inspection results and then running the code, the results didn't appear like at minute 08:21

    • @ScrapingNinja
      @ScrapingNinja  4 місяці тому

      make sure you are using correct xpath and also try to print page source to see if the correct page is being loaded

  • @aounzaidi9248
    @aounzaidi9248 7 місяців тому

    Salam Sir,
    I want extract data like url and titles from Google search page
    Ap guide kr kr skty, ap sirf ek roadmap bata dein? Waiting for your reply

    • @ScrapingNinja
      @ScrapingNinja  7 місяців тому

      you can do it following the same steps, install selenium, get the google link and start extracting data like i did in this video

    • @aounzaidi9248
      @aounzaidi9248 7 місяців тому

      @@ScrapingNinja sir in my project there are some queries which i want to search on Google and then i want to scrape 300 results from each query, is it possible

    • @ScrapingNinja
      @ScrapingNinja  7 місяців тому

      Yes you can edit your link to get up to 40 results per page and also include query inside the link this way you will keep minimum requests to google and get more results

  • @austinbright-j3o
    @austinbright-j3o 2 місяці тому

    Can I scrape sites using this that use captchas

    • @ScrapingNinja
      @ScrapingNinja  2 місяці тому

      You will need to use proxies to avoid captcha.

    • @austinbright-j3o
      @austinbright-j3o 2 місяці тому

      @@ScrapingNinja I’m new to code. Can I do this in Google colab? Does it cost money to implement?

  • @JP-vo8ik
    @JP-vo8ik 3 місяці тому +1

    SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 114
    Current browser version is 126.0.6478.126 with binary path /usr/bin/google-chrome
    error

    • @ScrapingNinja
      @ScrapingNinja  3 місяці тому

      You need to update chromedriver using apt-get

  • @josemariomonteiro3628
    @josemariomonteiro3628 2 місяці тому

    SessionNotCreatedException: Message: session not created exception: Missing or invalid capabilities
    (Driver info: chromedriver=2.41.578700 (2f1ed5f9343c13f73144538f15c00b370eda6706),platform=Linux 6.1.85+ x86_64)

    • @ScrapingNinja
      @ScrapingNinja  2 місяці тому

      Check your code to make sure you have set compatibilities correctly

    • @ScrapingNinja
      @ScrapingNinja  2 місяці тому

      Options