dbt(Data Build Tool) crash course for beginners: Zero to Hero

Рет қаралды 20,091

Күн бұрын

In this video tutorial, we will learn about dbt (data build tool), the core concepts of dbt, exploring its project structure and key components.
It will guide us through setting up dbt Cloud using BigQuery and GitHub. Additionally, the tutorial covers various topics of dbt such as models, building & running them, understanding Macros, Generic and Singular Tests, and Snapshots within dbt.
▬▬▬▬▬▬ Links 🔗 ▬▬▬▬▬▬
► docs.getdbt.com/docs/supporte...
► github.com/AnandDedha/dbt-bq-...
► Data - github.com/AnandDedha/dbt-bq-...
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:00 Getting Started (Understanding dbt and its role in the data life cycle)
08:50 dbt core concepts & project structure
13:13 Configuring dbt Cloud with BigQuery and Github Integration
26:32 yml files in dbt
31:28 Model Creation Process and Execution in dbt
50:03 Exploring Macros in dbt
59:04 Overview of Generic and Singular Testing in dbt with example
68:04 Utilizing Snapshots in dbt
#dbt
#databuildtool
#dbtcloud
#dbtlabs
#bigquery
dbt
data build tool
dbt cloud
dbt labs
BigQuery
dbt (data build tool)
Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️
👉 Support us here: buymeacoffee.com/datatechdeq
Thank you for being such an amazing community. We couldn't do this without you! 🎥✨
Contact me : datatechdemo2@gmail.com

Пікірлер: 30

@dennisdmak 5 ай бұрын

Weldon. I'm using dbt Oracle and this really helped

@RahulDhanawade-im7su 4 ай бұрын

very helpful! Thanks mate.

@danieldumaraos 3 ай бұрын

Thank you so much! I have learned a lot just by watching this video. Now, I am confident tackling simple using dbt. What I hope to have seen on this video is the documentation and a little bit more about the model dependency lineage but overall the video is awesome!

@DataTechByAnandKumar 3 ай бұрын

Thanks for the feedback Daniel!! I will try to make video on documentation and model dependency lineage

@nayeemsyed3033 4 ай бұрын

@Data Tech, by any chance can we get few scenario based interview questions on DBT cloud ?

@amacodes7347 3 ай бұрын

Create video and thanks for this great content. I would like to highlight that when create the dataset in BQ choose multi region US if you would not overwrite the dbt project yaml file +location: , because you would face a hard time to run the models and could get the location not found in BigQuery

@ankushgupta2292 6 ай бұрын

Very well explained..

@aleksandrshipilo4467 5 ай бұрын

Thank you for the tutorial)

@kirankumar1290 2 ай бұрын

I was trying understanding dbt from various channels but finally I learned lot from your video which is boosting my career. Thanks bunch such wonderful and useful video.

@DataTechByAnandKumar 2 ай бұрын

Thank you! Could you please share the video among your colleagues or organization? It would be help us

@kirankumar1290 2 ай бұрын

@@DataTechByAnandKumar sure I will share the video in my organization. can you publish one more video on dbt with airflow

@toddai2721 16 күн бұрын

Because of your tutorial, my wife finally will have relations.

@ugandarhari Ай бұрын

Thanks for such a nice content. Now I can add one more tool in my resume. Very informative session! The only flaw is the video quality, please try to upload HD resolution from next time, rest is awesome.

@DataTechByAnandKumar Ай бұрын

Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️ 👉 Support us here: buymeacoffee.com/datatechdeq Thank you for being such an amazing community. We couldn't do this without you! 🎥✨

@bhavesh6806 2 ай бұрын

Nicely explained

@yashhooda4441 3 ай бұрын

can you please make a video on dbt core... if possible

@anjaliacharya9506 5 ай бұрын

I do not have raw dataset in the dbt-training project I created, do we need to upload it or its created by default?

@DataTechByAnandKumar 5 ай бұрын

You must upload datasets, but there are also example datasets provided.

@prashantchutke Ай бұрын

Do you have to create schema.yaml or it is created automatically? Is it updated on it's own when a new model is created or we have to update in manually?

@DataTechByAnandKumar Ай бұрын

In order to create dynamic yml , my guess is that you could use codegen and especially the generate_model_yaml. hub.getdbt.com/dbt-labs/codegen/latest/ So you would have to execute : dbt run-operation generate_model_yaml --args '{"model_names": ["orders"]}' then if you want the file .yml to be automatically created with the "description" key filled with the name preceding it, you can use www.dbt-power-user.com/

@lakshmilfg1147 5 ай бұрын

Once dbt materializes all models as views, can I select a view directly in database and get the result I want? Because DAG will be defined within views ..right? Like View1--> View2--> View3.. Also if I dont have dbt in my company, Could I use nested views to recreate what dbt does?

@DataTechByAnandKumar 5 ай бұрын

We have the option to construct views upon existing views, but I wouldn't advise it because of potential performance issues.

@apatidar32 5 ай бұрын

I'm trying to pass command dbt run but it keeps on failing the model I created, but if I preview the query it shows me table I am suppose to see. Can you help me out in what could be the issue? the other two example are running just fine.

@apatidar32 5 ай бұрын

it got resolved, apparently it's a location issue. My dataset was not multi-region so have to relocate it. Could make a small video on how to configure dataset location to auto detect in dbt itself, in profile.yml file

@youssefassoud3767 4 ай бұрын

@@apatidar32 How do you solved this issue please ?