Loading data into BigQuery

Поділитися
Вставка
  • Опубліковано 21 вер 2024

КОМЕНТАРІ • 25

  • @rs82uk
    @rs82uk 4 роки тому +17

    And where is the episode on streaming? the batch really didn't need an episode since its so simple?

  • @yevhenii11
    @yevhenii11 3 місяці тому +1

    thank you for your lecture! short and plain to understand

  • @Raptor-jv7fi
    @Raptor-jv7fi 22 дні тому

    Appreciate this video as it was informational to me. But the examples you have used are hard to relate, please use examples that are relatable across the globe as you have a diverse audience.

  • @abdullahramzan9225
    @abdullahramzan9225 2 роки тому +1

    Very useful video to understand how BigQuery works. Kudos to team for great content.

  • @mohammedazeem3303
    @mohammedazeem3303 Рік тому +1

    Could you please help me in understanding how can I move data From Big Query To Google Ads,
    Since I could experiment with "BIg Query Data transfer service", "Scripts" etc. to move data from Google Ads to BigQuery but, still exploring Vise-versa possibilities, exploring API's etc.
    Any help to expedite my understanding would highly be appreciated.

  • @hobbyturystaSEO
    @hobbyturystaSEO 4 роки тому +1

    How to connect big query with firebase ml function. I. E. In truck apps We got many truck queries like Mercedes and scania, man, volvo, Renault etc with few parameters. How to run big queries with more than one param tournament

  • @abhilashshetty4840
    @abhilashshetty4840 4 роки тому +4

    Great lecture..

  • @sau002
    @sau002 2 роки тому +3

    Is it possible to load rows incrementally into BigQuery? Consider a large table with about million rows. On a daily basis, only about 200 rows gets modified/inserted. I would like to push these 200 rows daily, as opposed to load the whole table afresh.

    • @digheanurag
      @digheanurag 2 роки тому

      Did you find an answer?

    • @kiappy1981
      @kiappy1981 2 роки тому +1

      @@digheanurag I think that you have to load a kind of snapshot of your data using cloud storage and maintain data aligned using a streaming process if you need a real-time update otherwise you can go for batch process...

    • @hizokadarkwolf
      @hizokadarkwolf Рік тому

      first, don''t use csv. Ideally a better format is PARQUET. You can upload it to Storage and take it from there, its lighter and faster. You could also have a Cloud function (with bigquery API) to react to an event or a DataFlow job that moves the data.

  • @AbuTaher-vx2oe
    @AbuTaher-vx2oe 11 місяців тому +2

    Is it possible to upload csv data on pre existed table?

    • @aliciawilliams5520
      @aliciawilliams5520 10 місяців тому

      Here's more information for overwriting or appending data: cloud.google.com/bigquery/docs/loading-data-cloud-storage-csv#appending_to_or_overwriting_a_table_with_csv_data

    • @AbuTaher-vx2oe
      @AbuTaher-vx2oe 10 місяців тому +1

      @@aliciawilliams5520Thank you

  • @emmanueloyedeji9155
    @emmanueloyedeji9155 2 роки тому

    Need up tp update the videos with the changes to the UI on the platform, following the lesson with the new UI is nerve wreacking

  • @kar2194
    @kar2194 3 роки тому +1

    When I upload my own csv to BigQuery, my header row can't be recognized... Please help anyone?
    Format of my simple csv data in excel:
    friend | food

    • @vishnuvrv
      @vishnuvrv 3 роки тому

      Did you let BQ autodetect Schema and input parameters?

    • @aliciawilliams5520
      @aliciawilliams5520 3 роки тому +2

      My experience is that for schema autodetection to work, it requires at least one field that is not STRING. A workaround is to add a field that is just add an extra field that has a non-string type, if that's easy. Otherwise, you'll need to manually define your schema.

  • @CaribouDataScience
    @CaribouDataScience 2 роки тому

    Any change in getting an updated video? I don't see "Create Dataset"?

    • @valengarciamesa814
      @valengarciamesa814 Рік тому +1

      Try clicking in the 3 points next to the name of your project, in that way you will see the "create dataset" botton, I am having problems to get the tutorial because of the new version too, but at least those videos are a good place to start in BigQuery. Have a nice day!

    • @CaribouDataScience
      @CaribouDataScience Рік тому +1

      @@valengarciamesa814 Thanks for your suggestion.

  • @Naz_Pejuang
    @Naz_Pejuang 2 роки тому

    Thank's, for you i like good jobs

  • @haohuynhnhat3881
    @haohuynhnhat3881 2 роки тому +3

    is...is...he Chad?

  • @hafjashp
    @hafjashp 4 роки тому

    Next episode?

  • @sergeibatiuk3468
    @sergeibatiuk3468 2 роки тому +1

    Cats are better of course