How to automate you data pipelines using Fivetran and dbt on Snowflake | Tutorial for beginners

Поділитися
Вставка
  • Опубліковано 10 вер 2024

КОМЕНТАРІ • 4

  • @severtone263
    @severtone263 8 місяців тому

    Great demo! Thank you

  • @AussieFirebug
    @AussieFirebug 2 роки тому +1

    Is it possible to run python files within fivetran? I'm using ADF at the moment but it has a lot to be desired. The only thing stopping me from testing out fivetran is the ability to run my python files in the cloud.
    I currrently use Azure Function Apps for the python files and I schedule it (alongside all my other data ingestion tasks) in ADF.

    • @mastering_snowflake
      @mastering_snowflake  2 роки тому +1

      Hey, thanks for your question.
      I believe you can follow a similar approach in Fivetran. Fivetran allows you to call Azure Functions, so if your python code already lives there hopefully it should reasonably straightforward to test this out using Fivetran. You can find more details here: fivetran.com/docs/functions/azure-functions
      BTW - I read you blog from time to time too - keep up the great work!

    • @AussieFirebug
      @AussieFirebug 2 роки тому +2

      @@mastering_snowflake Haha no way. I didn't pick up an Aussie accent? Are you from the UK?
      Thanks for the link.
      I actually hate the way Azure functions work (really hard to debug. Things work on my laptop and then fail in the cloud). I thought there might have been a nice IDE in fivetran for running python scripts.
      Keep up the videos mate. They're really good 👌