Пікірлер
@AjayKumar-gs9sg 10 күн бұрын
Anyone trying in 2o24 and could not find SQL API option ?
@user-hn6ev9to1v 13 күн бұрын
Do yourself a favor and just learn SQL and skip this little scripting tool.
@diegoalejandrorobledofigue1377 19 күн бұрын
Good work mate
@captainchannel8210 22 күн бұрын
Hey Data team, i am looking for aws cloud for Data Analysis. So can you please confirm this whole tutorial can be a good start.
@DataTechByAnandKumar 21 күн бұрын
Yeah, it will helpful.
@rasmusandreasson1548 22 күн бұрын
Great video! Looking forward for more videos!!
@prashlovessamosa 26 күн бұрын
Dhanyawad anand bahi
@utpalknayak Ай бұрын
Just picked up a project in Azure synapse and this video helped a lot
@DataTechByAnandKumar Ай бұрын
Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️ 👉 Support us here: buymeacoffee.com/datatechdeq Thank you for being such an amazing community. We couldn't do this without you! 🎥✨
@yitianhou8706 Ай бұрын
Hi, very nice project and video!!! I am having some problems, when I upload airflow-redshift-template.yaml to cloudformation -- Create stack, it shows the following error, could you tell me how to fix it? Template format error Follow the standard JSON or YAML spec to format your template.Learn more Parser error duplicated mapping key (323:3) 320 | WebserverLogs: 321 | LogLevel: !Ref Webserve ... 322 | Enabled: true 323 | SecurityGroup: ---------^ 324 | Type: AWS::EC2::SecurityGroup 325 | Properties: Thank you very much, sir!
@abhishekmote7250 28 күн бұрын
I agree, I am having same issue. Did you get it resolved?
@arunkumarr2810 Ай бұрын
My py version is 3.12 and i'm getting error while installing azureml.opendatasets... can you please guide me
@M.AliJaved Ай бұрын
Will the table update automatically after adding a new file to the bucket?
@raghudubba4427 Ай бұрын
Even if i configure requirements.txt correctly , still getting import pandas as pd modulenotfounderror: no module named 'pandas' in airflow and dag is broken error . Thanks
@raghudubba4427 Ай бұрын
Broken DAG: [/usr/local/airflow/dags/openweather_api.py] Traceback (most recent call last): File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/airflow/dags/openweather_api.py", line 8, in <module> import pandas as pd ModuleNotFoundError: No module named 'pandas'
@DataTechByAnandKumar Ай бұрын
Just redeploy the airflow instance .
@ugandarhari Ай бұрын
Thanks for such a nice content. Now I can add one more tool in my resume. Very informative session! The only flaw is the video quality, please try to upload HD resolution from next time, rest is awesome.
@DataTechByAnandKumar Ай бұрын
Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️ 👉 Support us here: buymeacoffee.com/datatechdeq Thank you for being such an amazing community. We couldn't do this without you! 🎥✨
@emmanuelmatsenene615 Ай бұрын
I am getting this error message "You are missing permissions and may need to talk to your administrator. Original error message: Failed to create table: Access Denied: Dataset bigquery-public-data:covid19_open_data: Permission bigquery.tables.create denied on dataset bigquery-public-data:covid19_open_data (or it may not exist)." not sure what im doing wrong here
@prashantchutke Ай бұрын
Do you have to create schema.yaml or it is created automatically? Is it updated on it's own when a new model is created or we have to update in manually?
@DataTechByAnandKumar Ай бұрын
In order to create dynamic yml , my guess is that you could use codegen and especially the generate_model_yaml. hub.getdbt.com/dbt-labs/codegen/latest/ So you would have to execute : dbt run-operation generate_model_yaml --args '{"model_names": ["orders"]}' then if you want the file .yml to be automatically created with the "description" key filled with the name preceding it, you can use www.dbt-power-user.com/
@darl6368 2 ай бұрын
I have doubt For new user consumer it will create new partition
@sunnyd9878 2 ай бұрын
Greatvjob keep creating good videos
@bhavesh6806 2 ай бұрын
Nicely explained
@areksrocks3375 2 ай бұрын
Very useful video. I like the thing you explained and showed many available options :) I will continue with your next videos about BigQuery.
@DataTechByAnandKumar Ай бұрын
Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️ 👉 Support us here: buymeacoffee.com/datatechdeq Thank you for being such an amazing community. We couldn't do this without you! 🎥✨
@prashantmhatre1328 2 ай бұрын
Bhai , I have clones this project at my machine yesterday. Yesterday i did the steps as per the Document and check the whether the local host is working on not. after that I shut down my laptop. Now , today I again wants to run the project so what steps i have to perform. I am facing below issue after executing docker compose build --no-cache - => ERROR [airflow-init internal] load build context
@DataTechByAnandKumar 2 ай бұрын
You just need to run the containers again
@cyrusthepete 2 ай бұрын
Thanks for this.
@ishitalaxman570 2 ай бұрын
Very informative, great work!
@DhaneshAkolu 2 ай бұрын
Is this service free to use? If not can I work on this project and disable the service?
@DataTechByAnandKumar 2 ай бұрын
Yeah, you can work and disable the services .
@akshitanagar3107 2 ай бұрын
Lovely and well explained concepts..Thank you and keep posting..
@parthdhingra3663 2 ай бұрын
Very well explained.. Keep on posting these kinda videos.. Very informative..!! I have been following your channel from a long time.. The content on your channel is outstanding ..!!
@kirankumar1290 2 ай бұрын
I was trying understanding dbt from various channels but finally I learned lot from your video which is boosting my career. Thanks bunch such wonderful and useful video.
@DataTechByAnandKumar 2 ай бұрын
Thank you! Could you please share the video among your colleagues or organization? It would be help us
@kirankumar1290 2 ай бұрын
@@DataTechByAnandKumar sure I will share the video in my organization. can you publish one more video on dbt with airflow
@toddai2721 18 күн бұрын
Because of your tutorial, my wife finally will have relations.
@PeopleAndroid 2 ай бұрын
my question on this is how do I sure i stopped the SQL dedicated pool when my pipeline ends
@sasanknimmagadda2010 3 ай бұрын
Thank you so much, very good video for understanding Row and Column level security.
@yashhooda4441 3 ай бұрын
please make a video on dbt core too and please make a video on what technologies should i work on too secure a good paying job in india as currently i am in my 4th year and my college placements have snatched my hope for getting a on campus placement and also give some ideas for data science project that i can stregthen my cv as a fresher
@Aman-lv2ee 3 ай бұрын
great video, but need a guidence what stack should I learn after working on snowflake (4+ year majorly on store procedure creation) next?, seeing the job opportunity of Snowflake less in India and job posting having multiple tools like spark, cloud etc, and all which I have never worked on, please any advice, thanks
@dataengineering4438 3 ай бұрын
You rocked it Bro
@akilanvaithilingam6155 3 ай бұрын
Thank you for this video. I have a question.!! I have created a macro in my dbt cloud project folder and how to use it across different models/project? Pls explain.
@DataTechByAnandKumar 3 ай бұрын
There are various methods to accomplish this task: 1. Optimal approach: Package your project. 2. Alternatively, you can copy your project into other projects and use macro locally. 3. Another option is to utilize a GitHub link.
@amacodes7347 3 ай бұрын
Create video and thanks for this great content. I would like to highlight that when create the dataset in BQ choose multi region US if you would not overwrite the dbt project yaml file +location: , because you would face a hard time to run the models and could get the location not found in BigQuery
@ankushgupta2292 3 ай бұрын
Great explanation on dbt macros..!!
@pragyanagar2596 3 ай бұрын
Well explained. Thankyou
@yashhooda4441 3 ай бұрын
can you please make a video on dbt core... if possible
@danieldumaraos 3 ай бұрын
Thank you so much! I have learned a lot just by watching this video. Now, I am confident tackling simple using dbt. What I hope to have seen on this video is the documentation and a little bit more about the model dependency lineage but overall the video is awesome!
@DataTechByAnandKumar 3 ай бұрын
Thanks for the feedback Daniel!! I will try to make video on documentation and model dependency lineage
@Shadowless_Kick 3 ай бұрын
Thanks! Is it possible to set a policy so that only login users of one of my websites can access an AWS S3 ? (I use the AWS S3 for storing profile images of the login users)
@Aman-lv2ee 4 ай бұрын
is dbt an alternative of spark?
@DataTechByAnandKumar 4 ай бұрын
Not really, it depend on the use case.
@cheedellasrinivas8090 2 ай бұрын
Video is nice, could you please explain advance concepts of dbt like dbtmesh and semantic layer
@baifriend 4 ай бұрын
kzfaq.info/get/bejne/eZxygaSXxsvViI0.html
@ramnalam 4 ай бұрын
Hi, where can we find PPT's which are used in this series
@srishtimahajan2146 4 ай бұрын
Hi can I try it out for free on AWS free tier or will it be chargeable
@nayeemsyed3033 4 ай бұрын
@Data Tech, by any chance can we get few scenario based interview questions on DBT cloud ?
@RahulDhanawade-im7su 4 ай бұрын
very helpful! Thanks mate.
@BasitAIi 4 ай бұрын
Please make a video on how to create AWS account for students
@anonymousantelope1649 5 ай бұрын
currently in a data eng class textbook material on this subject made no sense to me, this video explained it clearly making it feel easy to understand, nice vid.
@DataTechByAnandKumar 5 ай бұрын
Great to hear!
@Hailey-pj4kn 5 ай бұрын
Thankyou
@DataTechByAnandKumar 5 ай бұрын
You’re welcome 😊
@dennisdmak 5 ай бұрын
Weldon. I'm using dbt Oracle and this really helped
@madhubanti123 5 ай бұрын
Hi Anand ...I have few questions.. Send connect in linkdin ...or is there any preferred method to connect ?
@DataTechByAnandKumar 5 ай бұрын
Please send me an email with your questions.
@lakshmilfg1147 5 ай бұрын
Once dbt materializes all models as views, can I select a view directly in database and get the result I want? Because DAG will be defined within views ..right? Like View1--> View2--> View3.. Also if I dont have dbt in my company, Could I use nested views to recreate what dbt does?
@DataTechByAnandKumar 5 ай бұрын
We have the option to construct views upon existing views, but I wouldn't advise it because of potential performance issues.
@makwaiyong4393 5 ай бұрын
why is my openweather_api.py showing up as broken DAG in airflow?