Delta Tables with Data Flows

Поділитися
Вставка
  • Опубліковано 22 січ 2025

КОМЕНТАРІ • 9

  • @rodrigoc.frazani9836
    @rodrigoc.frazani9836 6 місяців тому +1

    Thank you for sharing the video. I am trying to consume a Delta table in the storage account, but I am getting a bad request error. Do you have any tips to solve this problem?

    • @austinlibal
      @austinlibal 6 місяців тому

      You’re using Synapse Data Flows to consume a delta table?
      Whats the error message?

  • @duarteteles6533
    @duarteteles6533 Рік тому

    Hi, thx for the informative video. Does integration with delta tables still work in this exact setup if Unity Catalog is set?

  • @TheDataArchitect
    @TheDataArchitect 7 місяців тому

    I need to connect powerbi with delta tables, but don't want to spin up the cluster, the delta tables resides in the datalake storage account.

    • @austinlibal
      @austinlibal 6 місяців тому

      I think this is possible but I’ve heard it takes ages.
      Moving to Fabric would help speed this up dramatically though and could be done without a cluster.

    • @TheDataArchitect
      @TheDataArchitect 6 місяців тому

      @@austinlibal thanks, we found serverless compute, but the issue is, it dont connect to the storage account. asks for the key, but serverless compute does not have such option available where i can provide it the storage account key.

  • @t-bar-mranch1074
    @t-bar-mranch1074 9 місяців тому +1

    What would be nice to see is how to do change data capture using a delta table as the source so you could do transformations before writing to another sink. Hmmmmmmmm :)

  • @jonimatix
    @jonimatix Рік тому

    What would be the use case of a data lake and data flows?

    • @austinlibal
      @austinlibal Рік тому

      Data flows being a no code ETL orchestration tool allows for transformation of data without having to use code. This allows for more users in an organization to work with moving and transforming data.