Allen Ronald Lopez Lisa Martin Anthony

stud ;)

Thanks for this tutorial.

TOP

How to achieve incremental insert in dbt without allowing duplicates base on specific columns?

Git clone no longer has the same content. Instead the new approach is with the command 'abctl local install'. Unfortunately it failed to complete with an error that it was unable to get some packages. I see a few with similar error chiming in on the forums. It would be great if they responded with a suggestion on the work around.

Bro. So much crap being put out by glory posters out there. I mean the mountains of crap posts out there from people who don’t have a f’ing clue. And then there’s your posts. 😊 thank you for just giving us the information we need. This is amazing. But I swear if I find a “if was going to start over as a data engineer in 2024” video in your lists, I’m gonna lose my shit. 😂 Thanks again bro. Solid f’ing information.

This tutorial is good, but unfortunately the installation/ project creation steps are outdated. The dbt installation process has changed, the dbt init now asks adapter credentials before it can create a profiles file etc. :( Anyone using this video would have to do a lot of research trying to simply set up their first project.

Am I missing something or is there no links to the online articles he is using?

Hi Kahan , I need some suggestions on how to handle the following situation: ' CREATE OR REPLACE VIEW my_database.my_schema.main_view AS SELECT v1.column1, v2.column2, v1.column3 FROM my_database01.my_schema01.view1 AS v1 JOIN my_database01.my_schema02.view1 AS v2 ON v1.join_column = v2.join_column; ' `{{ ref() }}` doesn't take schema names, right? In Snowflake, I can directly reference `my_database01.my_schema01.view1 AS v1` and `my_database01.my_schema02.view1 AS v2`. How can I implement this in my dbt project? Specifically, I need to build views with the same name but located in different schemas (`my_database01.my_schema01.view1` and `my_database01.my_schema02.view1`) within the same dbt project. Any suggestions or points would be greatly appreciated. Thanks in advance!

Changing logic between environments is shooting in the leg.

Thanks man. Hope this channel blows up in the days to come.

9:02 Does staging area serve only as a medium for 'mental clarity'? Because the raw data can directly be transformed into a desired data model.

Hello, I would like to know which version of visual studio you are using in this video? because for my part, I would like to hide columns for a specific role, but I do not have the "Tables and column" tab.

Thanks for the video, so helpful for my docker based pipeline. Also you are very cute, have a good day.

Your data modelling playlist is fantastic !

Excellent Video !

This gave me a headache. Not a DB person at all.

Straight to the point and precise. Thank you!!

The video says "I will add the code into a Github", so where is the code then? It's so frustrating when you go to a tutorial and its missing code or other things the author says he will include.

Then how do I connect it to power bi desktop for report building? Is it from get data

I followed the same steps and in snowflake, describe user shows default_role correctly. But when I m doing SSO, it doesnt see that role at all. And there are no grants. It just uses PUBLIC role. What am i missing?

thx for sharing, qq: why would we leverage snapshot freshness instead of freshness ?

Brilliant..how nicely explained..kudos bro

Do you have any mail or social media to contact you?

Thanks for your video! Nicely explained. A question, would this approach be the same as a medallion architecture? if not, what are the differences?

How to load csv file which contains null values. I downloaded the result of the query of which last column contain null values. E,g. …….,false,false,, Last 2 values are null. How to upload? What should I set in csv format in sf while uploading it?

if your DBT INIT NOT WORKING PLEASE TRY THIS ONE python -m pip install --upgrade dbt-core. pip dbt install not working please try this one pip install dbt-core

fatal: not a git repository (or any of the parent directories): .git I am getting this error, why not mention " if you are getting errors, then do this..." ?!!!!!! you should have thought about it !

Thanks for this video! Generally agree with all the points you mention, but what are your thoughts on allowing stakeholders to self-serve versus implementing controls such that most, if not all, data reporting should always be through the data team?

OMG! No Cheap chat?! A very straight forward tutorial!

So whats the difference between Inkon data warehouse vs traditional relational db?

Very good and easy explanation. GJ

Great content! I had a question - why would companies choose to use standalone ELT / ETL providers (e.g. Stitch, Matillion) over the native Amazon Glue / Azure data factory? Wouldn’t it be easier to use the cloud provides as it would be more integrated?

Totally agree! At my job we create all the business logic in the Gold Layer, there we can have it commented, keep track of changes, its way easier to debug problems, I've been the whole week checking some columns and updating them with the business team based on the way they want it changed. Data analysts just need to create reports and understand the data to present it to stakeholders/other teams, not that this is an easy task since they are essentially our bridge with the business team

This would work as a podcast instead of a video. No visual not examples

If I have a sql server database and I want to connect to it in Metabase and create a dashboard, and I want the dashboard to be live (the visuals refresh automatically when new data comes in the database), similar to Direct Query in Power BI, is that possible in Metabase?

Hey Kahan! There were some changes to get the dbt env setup going.. perhaps it's time for an update? Had to find work arounds.. when I do it, profiles.yml file doesn't exist or cannot be found.. anyways, thanks for making the tutorial

thanks!

What about the ingestion part? I mean, in which environment do you develop and test the ingestion logic? Or is this just for production?

The staging layer would be equivalent to a landing zone?