Google Sheets Database with Python Web Scraping

Поділитися
Вставка
  • Опубліковано 14 жов 2024
  • We can use Google Sheets as a database for our Python Web Scrapers. In this video tutorial I will show you how to add new rows under each other to a Google Sheet from your Python script.
    -------------------------------------
    twitter / jhnwr
    code editor code.visualstu...
    WSL2 (linux on windows) docs.microsoft...
    -------------------------------------
    Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases
    mouse amzn.to/2SH1ssK
    27" monitor amzn.to/2GAH4r9
    24" monitor (vertical) amzn.to/3jIFamt
    dual monitor arm amzn.to/3lyFS6s
    microphone amzn.to/36TbaAW
    mic arm amzn.to/33NJI5v
    audio interface amzn.to/2FlnfU0
    keyboard amzn.to/2SKrjQA
    lights amzn.to/2GN7INg
    webcam amzn.to/2SJHopS
    camera amzn.to/3iVIJol
    gfx card amzn.to/2SKYraW
    ssd amzn.to/3lAjMAy

КОМЕНТАРІ • 63

  • @alexlytle089
    @alexlytle089 4 роки тому +15

    dude thank you so much!! I get excited everytime you post a new video. Really high quality stuff mate.
    I ran into this error "ImportError: No module named gspread". But i fixed it by running this into my python interpreter
    import pip
    pip.main(["install", "gspread"])
    just in this happens to somebody else

  • @InfinitycgIN
    @InfinitycgIN 2 роки тому +4

    Thanks a ton, your video helped me in reducing the code by almost 60%, I am a non programmer and was writing my script just by googling and UA-cam. A massive thanks for the easy-going and straightforwardly understandable video with no clutter

  • @justash123
    @justash123 2 роки тому +1

    SIR THIS IS THE BEST TUTORIAL EVER!
    Im hosting a website using heroku but my manual database keep clearing after a few hours, but this is the perfect solution for that, tysm!

  • @zjm89
    @zjm89 4 роки тому +4

    This came at the perfect time. Looking forward to watching more of your videos

  • @ahmadcooper40
    @ahmadcooper40 3 роки тому +4

    Hey John, thanks for your videos, they're easy to understand and follow. After watching your Google News scraper video, and this video on how to scrape to Google Sheets, I'm wondering if you could make another video on "How to Scrape Google News to Google Sheets". I tried figuring it out myself but I only managed to get the first news article. Additionally, if its possible, a video on "How to append scrape data (i.e. Google News) to Excel"), or to create a new Sheet within an existing doc. If you could do any of those that would be amazing.

  • @snapesrds5766
    @snapesrds5766 Рік тому +1

    Thanks You from deepest of my heart. ❤

  • @AbdulMalik-rt3vx
    @AbdulMalik-rt3vx 2 роки тому +2

    Very useful and real life example! Thank you John!

  • @louisgirardin2030
    @louisgirardin2030 4 роки тому +4

    Great lesson with the right content and easy to follow ! Thx a ton.

  • @ayencoscolfield3312
    @ayencoscolfield3312 3 роки тому +2

    Speechless as usual one word for you pal ,awesome!!!

  • @jamesmarx3105
    @jamesmarx3105 3 роки тому +1

    I find it really easy to learn from you. Thanks for making content!

  • @omarcedric9193
    @omarcedric9193 3 роки тому +1

    Straightforward and concise. Thank you for this.

  • @gitgosc7075
    @gitgosc7075 2 роки тому +1

    something new for me, thanks a lot, great channel!

  • @LeopoldoAvalos
    @LeopoldoAvalos 2 роки тому +1

    Thank you John!

  • @wkowalski
    @wkowalski 3 роки тому +3

    By any chance you think you could do a video about automating scrapers with cronjobs, and maybe even using launchd on Mac OS if you happen to know anything about that? Really glad I found your videos... They're really well done and very helpful.

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 роки тому +1

      Sure I have a video about running scrapers in the cloud and cronjobs planned

    • @wkowalski
      @wkowalski 3 роки тому

      @@JohnWatsonRooney Awesome! Can't wait.

  • @severtone263
    @severtone263 Рік тому +1

    Thx mate! Great vid

  • @ianpropst-campbell6028
    @ianpropst-campbell6028 Рік тому

    Excellent tutorial! You mentioned something cron jobs. Do you have any tutorials about how to set those up?

  • @aysenurakdass
    @aysenurakdass 2 роки тому +1

    Your video has been very helpful. Thank you so much.

  • @EUU100
    @EUU100 3 роки тому +2

    Perfect, thank you for your effort and time Mr Rooney

  • @DuckkkMr
    @DuckkkMr 4 роки тому +3

    Thanks that is very helpful. I am looking to know how to import several row with several values (i.e I have a .csv with 400 rows and I want to upload these 400 rows into GSheet automatically) ? Right now it only insert the latest value of my .csv
    Thanks !

    • @EUU100
      @EUU100 3 роки тому

      did you find out?

  • @datochikhla8572
    @datochikhla8572 3 роки тому +1

    Thank you very much for helping me

  • @pedrofilhojp1
    @pedrofilhojp1 2 роки тому

    Obrigado pelo seu video. Ajudou muito na automatização de minha planilha. Show. Parabéns.

  • @zanew2493
    @zanew2493 2 роки тому +1

    goated video

  • @geriivagyok
    @geriivagyok 2 роки тому +1

    This is fantastic! Thank you!

  • @gabefife951
    @gabefife951 2 роки тому +1

    Thank you so much, I do get an error that says I need to requests more quota but it doesn’t really effect it bc I still get what I want with it.

  • @gauravpainuly1800
    @gauravpainuly1800 2 роки тому +1

    very interesting

  • @nicolas____
    @nicolas____ Рік тому +1

    i fuckin love you man, thank you!

  • @marcogelsomini7655
    @marcogelsomini7655 2 роки тому

    Nice video thx! Is possible to automatic update the information scraped from a website? or you have to run the code ?

  • @clintluna6884
    @clintluna6884 3 місяці тому

    Does this auto run each day, or does that have to be done manually? Thanks!

  • @connerbaker5435
    @connerbaker5435 3 роки тому +2

    Great stuff. Thank you sm

  • @boristhebulletdodger-z3b
    @boristhebulletdodger-z3b 4 роки тому +2

    Great video. Any chance to do a tutorial on how to create a trigger when price change?

  • @kingsleysimon8945
    @kingsleysimon8945 Місяць тому

    I have a spread that I used in predicting virtual football results, the trouble I have is collecting the results unto my spread automatedly using python code... So to predict next outcome...
    Can your code scrap the results of every few minutes unto my Google spread and also determine outcome base on ticktack to patterns?

  • @michaelkurz5878
    @michaelkurz5878 Рік тому

    great video. keep going!

  • @wangdanny178
    @wangdanny178 2 роки тому +1

    Hey john, do you need to have to import 'oauth2client.service_account'? my google sheet is not updated as the script tells

    • @JohnWatsonRooney
      @JohnWatsonRooney  2 роки тому +1

      Hey good question! It’s been a while since I’ve done this but as far as I remember that wasnt needed as the g sheets import handled it all.

  • @business5707
    @business5707 3 роки тому +1

    Hello John, I got this error copying from your video "list indices must be integers or slices, not str" Do you know why?

  • @expat2010
    @expat2010 4 роки тому +2

    Very nice.

  • @yuliyakunitskaya7817
    @yuliyakunitskaya7817 3 роки тому +2

    Thanks!

  • @peepi98
    @peepi98 2 роки тому

    hi! where did yo get the info? i was surfing throgh the official gspread webside (i think) and i didnt see the append_row command (for example)

  • @renatoacevedosilva9423
    @renatoacevedosilva9423 2 роки тому

    Just amazing, did you know how to extend the matrix with a For loop?

  • @wangdanny178
    @wangdanny178 2 роки тому

    btw john is it possible to make the product['date'] as date object to append in google sheet?

  • @tiroles
    @tiroles 2 роки тому

    That is fantastic! Thanks for the video! I'm trying to find a way to automate the update of the sheet. I know google sheets have that, but the way it scraps are too basic. If there is a pyton way it would be wonderful!

  • @michaelkurz5878
    @michaelkurz5878 Рік тому

    great actor

  • @pablo3830
    @pablo3830 3 роки тому +1

    Can you make a video about google Sheets web scraping with ezsheets module

  • @sylcexport9642
    @sylcexport9642 4 місяці тому +1

    Hi John it seems google api change the way we write things up, here's what I had to write to get it to work: sh.update([['third']], 'A1')

  • @pablo3830
    @pablo3830 3 роки тому +2

    what do I do if FileNotFoundError: [Errno 2] No such file or directory: 'hey.json'
    I followed every step

  • @MrShivahari
    @MrShivahari 2 роки тому

    Hey can we use the saved data in google sheets to render into django page through pandas liabrary

  • @SkySesshomaru
    @SkySesshomaru 3 роки тому +1

    Wow

  • @AnNguyen-lm5dm
    @AnNguyen-lm5dm Рік тому +1

    Hello, how can I get the example code sir?

    • @JohnWatsonRooney
      @JohnWatsonRooney  Рік тому

      hey sorry this is old now i don't think i have this specific code anymore

  • @tonyvillena1293
    @tonyvillena1293 Рік тому

    What if I wanted to create a spreadsheet from spread

  • @markwasfy9230
    @markwasfy9230 8 місяців тому

    Guys Don't forget to enable google drive api to not get any errors

  • @muhammetayd4172
    @muhammetayd4172 2 роки тому

    it doesnt work for me. I cant update the cell. Did i a mistake?

  • @kunalgupta2900
    @kunalgupta2900 3 роки тому +1

    Can we Automate Google sheets with Python? I mean, If we want to automate reports and send Email to the management, can we do that? If yes, how? Can you please help with the same?

  • @user-xo1ow5to2n
    @user-xo1ow5to2n 2 роки тому

    More haste less speed on the typing sir.