What is dbt: The Data Build Tool?
Вставка
- Опубліковано 10 вер 2024
- Repo: github.com/jus...
Curious about dbt and how it can transform your data workflows? In this video, we provide a comprehensive introduction to dbt (data build tool), covering its core features, benefits, and how it fits into your data engineering toolkit. Perfect for those new to dbt or looking to enhance their data build processes.
🔑 What You’ll Learn:
Introduction to dbt: Overview of what dbt is and how it works
Core Features: Key functionalities and benefits of using dbt for data transformation
dbt Training: Step-by-step training on setting up and using dbt
Database Migration with dbt: How dbt can streamline database migration and management
Practical Examples: Real-world use cases and best practices for leveraging dbt in your projects
This crash course is ideal for data analysts, engineers, and anyone interested in learning how dbt can optimize your data transformations. Like, comment, and subscribe for more insights and tutorials on data build tools!
🌐 Stay Connected:
Subscribe to our newsletter: airbyte.com/ne...
Learn more about Airbyte: airbyte.com
GitHub: github.com/air...
X (Twitter): x.com/airbytehq
LinkedIn: / mycompany
#dbt #DataBuildTool #dbtTraining #DatabaseMigration #DataTransformation #dbtCrashCourse
For my version (dbt-core 1.7.13 and adapter postgres 1.7.13) in 2:48 it is also already asking for host, port, user, pass, dbname and schema. Probably because I haven't used dbt before and the profiles.yml was not created yet.
BTW really good tutorial! Very well explained, was easy to follow along :)
Hi mate, is it possible to orchestrate Airbyte+dbt in one Airflow dag? I have read lot of documentation, but didn't found a normal example. Can you help with this?
We just made a video covering this!
ua-cam.com/video/rBsfUiHoNdc/v-deo.html
The problem with the macro is that you cannot rename a column in the select statement by doing that into the macro code. You have to call the macro from the model, and write the alias here
I don't understand why the models should go into the examples folder. Why wouldn't you put it in the models folder directly. And where does the data come from? What is this mysterious destination database? Is that explained somewhere?
It doesn't have to be in the examples/ folder. Models need to be contained inside the models/ folder, and it can have any subfolders inside. You can read more about this in the getdbt docs. The tutorial assumes you've knowledge of docker, and doesn't go into detail on how to load the database. You have to go into the github repo and explore your way. The tables are loaded from a file called 'init.sql' (found on the repo).
I use dbt in my project. We run SQL files with the Glue adapter on AWS to generate Hudi tables. As a beginner, there’s a lot for me to learn about dbt.