AWS Airflow Demo| Python code |AWS MWAA SETUP (part2)

  Рет қаралды 1,104

Techno Devs with Saurabh

Techno Devs with Saurabh

3 ай бұрын

In this video, we have covered below topics.
Create Amazon Managed Workflows for Apache Airflow.
Create DAG python code
Run python code by scheduling job using Airflow
understand airflow environment
GitHub link for code
github.com/saurabhgarg013/Air...

Пікірлер: 12
@basavapn6487
@basavapn6487 15 күн бұрын
Very well structured,Thanks for the detailed explanation
@narendrakashyap7730
@narendrakashyap7730 Ай бұрын
Salute you for your efforts and courage. Thank you Saurabh.
@SonuKumar-fn1gn
@SonuKumar-fn1gn 14 күн бұрын
Very nice video ❤ thank u so so much 😊
@user-uo8jg2qm8q
@user-uo8jg2qm8q 2 күн бұрын
Thankyou so much....with your help I got role in jpmc... however I am scared as I don't belongs to coding background ...how I will survive as data engineer
@SonuKumar-fn1gn
@SonuKumar-fn1gn 14 күн бұрын
Please create a video helm airflow and helm spark chart in kubernetes and submit a job in pyspark. Thank you sir ji so much for the video ❤❤❤
@EGourav
@EGourav 3 ай бұрын
Hi Saurabh ji, Thank you so much for the Airflow lecture. Could you please tell us about resolving error when we will select web server as Private Network. And if possible kindly share the codes also.
@Sunny-um6oj
@Sunny-um6oj 3 ай бұрын
Sir your videos are very useful. Please post the video on AWS EMR on EKS.
@Thesantoshdandin
@Thesantoshdandin 3 ай бұрын
I think you need to use catchup in DAG.. instead of default_args . Your videos are very informative and easy to follow.. Thanks .
@ankitkamble8673
@ankitkamble8673 3 ай бұрын
Great video 💯 Bro ... Thank alot..🤟
@basavapn6487
@basavapn6487 15 күн бұрын
One more thing to confirm about depends_on_past is not correctlty explained,For example if we have two tasks task1 and task2 and suppose if dag starts to run and when task1 completes and if task2 fails ,and When next day dag runs and task1 runs and completes but it will not start task2 because the previous day task2 is in failed state ,so depends_on_past works in this way i,e it depends on the same task for the previous instances to see if it got completed.
@basavapn6487
@basavapn6487 15 күн бұрын
Why simple_3.py file ran for 19times,I couldn't get why it ran for so many time ,Did you get to know whats the reson behind the run?
@chinmay694
@chinmay694 Ай бұрын
Do you have whole content of glue & Emr I'm intrested to learn , Please reply
Apache Airflow Tutorial in Hindi | AWS Airflow (part1)
1:13:15
Techno Devs with Saurabh
Рет қаралды 2,7 М.
Looks realistic #tiktok
00:22
Анастасия Тарасова
Рет қаралды 104 МЛН
100❤️
00:19
MY💝No War🤝
Рет қаралды 23 МЛН
Now THIS is entertainment! 🤣
00:59
America's Got Talent
Рет қаралды 37 МЛН
تجربة أغرب توصيلة شحن ضد القطع تماما
00:56
صدام العزي
Рет қаралды 57 МЛН
Create EMR cluster and add steps | Submit job
34:31
Techno Devs with Saurabh
Рет қаралды 1,2 М.
Orchestrating Data Pipelines With Snowpark dbt Python Models And Airflow
17:12
AWS Elastic Beanstalk Tutorial with Demo
34:44
Techno Devs with Saurabh
Рет қаралды 3,8 М.
AWS Kinesis theory with demo| ETL Hands on demo using lambda and Kinesis
49:51
Techno Devs with Saurabh
Рет қаралды 3 М.
Developing and testing with Amazon Managed Workflows for Apache Airflow on Amazon ECS
48:49
Create AWS EMR Cluster Using AWS CLI and Submit job
47:29
Techno Devs with Saurabh
Рет қаралды 1,4 М.
Это - iPhone 16 и вот что надо знать...
17:20
Overtake lab
Рет қаралды 98 М.
Это Xiaomi Su7 Max 🤯 #xiaomi #su7max
1:01
Tynalieff Shorts
Рет қаралды 1,2 МЛН
Смартфон УЛУЧШАЕТ ЗРЕНИЕ!?
0:41
ÉЖИ АКСЁНОВ
Рет қаралды 1,1 МЛН
ОБСЛУЖИЛИ САМЫЙ ГРЯЗНЫЙ ПК
1:00
VA-PC
Рет қаралды 2,1 МЛН
Top 50 Amazon Prime Day 2024 Deals 🤑 (Updated Hourly!!)
12:37
The Deal Guy
Рет қаралды 1,4 МЛН