8. Scraping Products from Amazon using Selenium | Dynamic Website | Web Scraping Tutorial | Python

Поділитися
Вставка
  • Опубліковано 26 гру 2024

КОМЕНТАРІ • 42

  • @HackersRealm
    @HackersRealm  Рік тому +8

    Hey Hackers,
    I believe selenium module got updated and existing code need few changes to work. To resolve that, use the following,
    ```
    from selenium.webdriver.common.by import By
    # update these snippets
    browser = webdriver.Chrome(executable_path = path) -----> browser = webdriver.Chrome()
    # get the input elements
    input_search = browser.find_element(By.ID, 'twotabsearchtextbox')
    search_button = browser.find_element(By.XPATH, "(//input[@type='submit'])[1]")
    product = browser.find_elements(By.XPATH, "//span[@class='a-size-medium a-color-base a-text-normal']")
    next_button = browser.find_element(By.XPATH, "//a[text()='Next']")
    ```
    The notebook is already updated and available in GitHub repository.
    Thank you so much for your support!!!
    Happy Coding🔥

    • @karthikkarthik100
      @karthikkarthik100 Рік тому +1

      Thanks a ton, just started on it , got the error , happy to see the resolution. You are great!

    • @HackersRealm
      @HackersRealm  Рік тому +1

      @@karthikkarthik100 will try to create new video as well with a fresh series!!!

  • @subha1818
    @subha1818 2 роки тому +6

    Nicely explained. Special thanks for the HTML xpath tips 👍

  • @dibyajyotimahanta3330
    @dibyajyotimahanta3330 9 місяців тому +1

    really a great video, made my learning supper fast and easy!

  • @superbin6021
    @superbin6021 Рік тому +1

    Thank you, watch your video one year ago about hackerrank. Still finding job because I don't have computer science degree.
    Even after taking aws dva-c02 and aws caa-c03, still no hope, now I am trying to become automation tester

    • @HackersRealm
      @HackersRealm  Рік тому

      Try to attend some contests, it's a good way to get jobs without a CS degree and Never give up on the pursuit..

  • @azizhussaini6215
    @azizhussaini6215 Рік тому +1

    Nicely explained, thank you man

  • @Invisible_Programmer
    @Invisible_Programmer Рік тому +1

    Excellent Explanation 🥳🥳

  • @chamlin6452
    @chamlin6452 2 роки тому +1

    Thanks a lot, you saved my day

  • @stephenellis4777
    @stephenellis4777 11 місяців тому

    How do you export the scraped data to csv or json?

    • @HackersRealm
      @HackersRealm  11 місяців тому

      you can save the dataframe using df.to_csv("output.csv", index=False)

  • @codesengine9862
    @codesengine9862 Рік тому +1

    how you get the span class? in direct don't give the just course give us pure leaning

    • @HackersRealm
      @HackersRealm  Рік тому

      please watch the previous videos for better understanding.... It will give better idea too

  • @dhikshitha7694
    @dhikshitha7694 2 роки тому +1

    Can I scrape multiple columns at a time? Is it possible to scrape 10000+ products?

    • @HackersRealm
      @HackersRealm  2 роки тому +1

      yes it's possible to do anything, you just have to customize your logic!!!

  • @KrishnaKumar-do9tp
    @KrishnaKumar-do9tp 2 роки тому

    this video is way outdated for today jupyter notebook but still some quality content

  • @atulraaazzz2931
    @atulraaazzz2931 2 роки тому

    if any product is at discount of 50 perc but i need it at 70 per is it anyway to track when prod is at 70perc i got notification

    • @HackersRealm
      @HackersRealm  2 роки тому

      There is some software for notification alert... Bt doing it in python, you have to build a crawler

    • @atulraaazzz2931
      @atulraaazzz2931 2 роки тому

      @@HackersRealm can u make this for me i will pay ur charge give ur contact i want to discccus some thing with u

    • @HackersRealm
      @HackersRealm  2 роки тому

      @@atulraaazzz2931 you can reach me via insta or linkedin. For consultation also, there is a link in the description

  • @St4nGaming
    @St4nGaming 2 роки тому +1

    Can you do this in java

    • @HackersRealm
      @HackersRealm  2 роки тому

      It's possible, you can use similar modules in java I guess

  • @Aisaneslamchalandar
    @Aisaneslamchalandar 10 місяців тому

    Dond do id bud i cand❤️

  • @Riddles974
    @Riddles974 Рік тому +2

    works

  • @Monika-ku1jw
    @Monika-ku1jw 7 місяців тому

    how can we convert these scrapped data's in excel sheet

    • @HackersRealm
      @HackersRealm  7 місяців тому

      you can export the dataframe that is shown in the video, df.to_csv('filename.csv')

  • @Siddipet_Voice_actor
    @Siddipet_Voice_actor 2 роки тому

    We should use # this for Id of path rite

  • @rajanpanwar6572
    @rajanpanwar6572 8 місяців тому

    Sir it is showing error that
    browser = webdriver.Chrome(executable_path = path)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    TypeError: WebDriver.__init__() got an unexpected keyword argument 'executable_path'
    so how should i resolve it sir please guide me please

    • @HackersRealm
      @HackersRealm  8 місяців тому

      could you please check the pinned comment

  • @aishwaryapattnaik3082
    @aishwaryapattnaik3082 Рік тому +1

    Nice explanation Ashwin. But majority of the code shown here is deprecated after more than 2 years. Had to use a lot of Google and Stack Overflow ...keep posting more updated ones \,,/

    • @HackersRealm
      @HackersRealm  Рік тому

      Thanks for the tip!! I try to update the code in github whenever it's possible. The idea is to convey the overall logic for users to understand how things are working!!!

  • @rahulparashar5684
    @rahulparashar5684 Рік тому +1

    Not running and my laptop also hanged

    • @HackersRealm
      @HackersRealm  Рік тому

      the script doesn't need major hardware requirements, restart the machine and try again. It might work

  • @mohaddesehmahmoodi-j7k
    @mohaddesehmahmoodi-j7k 11 місяців тому

    Can I have your email?

    • @HackersRealm
      @HackersRealm  11 місяців тому

      It's in the channel description