23. Send Email alert when Pipeline fails in Azure Data Factory

No video

23. Send Email alert when Pipeline fails in Azure Data Factory

Рет қаралды 66,881

3 жыл бұрын

In this video, I explained about creating a logic app which will run on HTTP request and send email alert, and calling that logic app from your pipeline on failures.
Link for Azure Synapse Analytics Playlist:
• 1. Introduction to Azu...
Link for Azure Databricks Play list:
• 1. Introduction to Az...
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
Link for Azure Data Factory Real time Scenarios
• 1. Handle Error Rows i...
Link for Azure LogicApps playlist
• 1. Introduction to Azu...
#Azure #AzureDatafactory #DataFactory

Пікірлер: 79

@ArabaEfsanesi 2 жыл бұрын

I have just completed 85 videos. What a effort Maheer! You explained almost every details in ADF with practical demos. I learned a lot, a lot, a a lot... I am planning to continue with PowerBi and also ADF real time scenario playlists. I really appreciate for your effort on these playlists. Thank you Maheer, Gracias, Arigatōgozaimashita, Xièxiè nǐ, Tesekkurler, Shukran, JazakAllah, Shukriya......

@WafaStudies 2 жыл бұрын

Thank you for kind words ☺️

@nitishsalunke 3 жыл бұрын

I am holding multiple job offers just because of you and your videos. Thank you so much! Your videos are very easy to understand. Keep making such videos 🎉

@WafaStudies 3 жыл бұрын

Congratulations 🎉👏🎉

@swagatmohanty5818 3 жыл бұрын

Hi bro. ADF, ADLS, SQL Server. Are these skills enough to get a job (2 years. exp.) ? Kindly guide me.

@RaviPrasadRAVIPDGUPTA 2 ай бұрын

@@swagatmohanty5818 yes

@srisuman3996 3 жыл бұрын

Bro meeru flawless unnaru andukey emo Microsoft mee daka vachindi … talent got recognised …. Preparing for interviews through your videos much help full

@WafaStudies 3 жыл бұрын

Thank you bro 🙂

@abhijeetpandey8052 3 жыл бұрын

Thank you for putting lot of hard work for us..best tech related channel on KZfaq...... can't thank you enough

@WafaStudies 3 жыл бұрын

Thank you for your kind words 🙂

@cajaykiran 3 жыл бұрын

Spot on!! Can you please do a video on reading a file from SharePoint online Document library to Azure ADLS/ BLOB using ADF.

@itsartyficial1985 Ай бұрын

Useful for interview thanks it was very helpful

@shockey3084 3 жыл бұрын

As usual, keeping quality maintained.

@WafaStudies 3 жыл бұрын

Thank you 😊

@AnnuKumari-mo6gz 3 жыл бұрын

Much needed .. Thanks for covering😀

@WafaStudies 3 жыл бұрын

Thank you 🙂

@viveknimmagadda2397 Жыл бұрын

Thank you for the detailed explanation. It is really helpful!

@deepakbehera498 5 ай бұрын

Could you also please post how to identify the cost for these services ? Great Video. Thanks!

@ranjitreddy7918 2 жыл бұрын

I really appreciate your efforts.

@WafaStudies 2 жыл бұрын

Thank you 😊

@omkarkulkarni3346 4 ай бұрын

Thanks for the video ,you have added your email id in action to send failure notification email but in real world production scenario how does it get handled?

@johnpaulprathipati153 2 жыл бұрын

hi maheer bro i am fan of your content.. tq so much

@WafaStudies 2 жыл бұрын

Thank you ☺️

@YasminS-e1l Ай бұрын

O365 deprication with teams, now we have to implement the workflow by power automate. Could you please explain me how to do this?

@MuppiriRajaVenkataPhanindraKum 3 ай бұрын

I'm doing just as mentioned in the video but I'm unable to capture the error message in the email alert that I'm receiving. Is there something that I'm doing wrong, could you let me know what could be the issue

@chaudhryalisalam3668 Жыл бұрын

Great work again mate.

@abhineshlal2602 4 ай бұрын

its working when we are doing using directly web activity but when we are inserting web activity in pipeline and using same statement of error message through parameter it's not working. Every other parameter except error message are coming in email. How to do that?

@sarmisthasarkar3009 4 ай бұрын

Hi @WafaStudies.. thanks for detailed videos on ADF. Can you please help to handle one scenario in ADF ? I need to get response from REST API which will response data in jsonline format (not json array) . How in ADF can read jsonline API response ? in REST API, jsonline seems not to be supported.

@user-md8ji1uo6q Жыл бұрын

very good video, helpful

@WafaStudies Жыл бұрын

Thank you 😊

@jagadeeshpinninti3323 2 жыл бұрын

How much will it cost to use using Azure logic apps to send the failure ADF pipelines email notifications?

@kathirsubramaniam4597 3 жыл бұрын

How to read an error message from DataFlow if failed? I tried to use expression like this "@{activity('Run DataFlow').output.errors[0].Message}" to read error message from my DataFlow activity. But there is no such expression to read the exact error message from DataFlow.

@vickygupta4263 Жыл бұрын

Even i need an expression to evaluate the error msg. Pls let me know if u got the answer

@prosinging7853 3 жыл бұрын

Very helpful videos u are making for azure but some advanced topics are missing. Eagerly waiting for those advanced topic videos. One of them mentioned in the chat

@devtest8259 7 ай бұрын

This was failing on a notebook activity because the error included a “ which caused everything to break. I did a replace in the expression builder which solved it.

@iaminazure 3 жыл бұрын

Could be done in a better way...using datafactory restapi's Or else if we don't need custom message we can configure alerts directly in the ADF

@joshiabhinav Жыл бұрын

you are the Best

@rk-ej9ep Жыл бұрын

wow..what an effort 👍👍

@xelaCO14 2 жыл бұрын

thanks for this video! it´s amazing and helpful

@rakeshpanigrahi577 Ай бұрын

Thanks a lot foe the informative video. We can also the below logic to replace the "][ - regexReplace(StringList, '["\\[\\]]', '')

@meghashares24 Жыл бұрын

Life Saver!!!!!!!Hats Offfffffff

@robinthomas7782 2 жыл бұрын

How can we get the name of the activity to send inside the mail body

@reshavraj4090 3 жыл бұрын

Great Content ..!

@WafaStudies 3 жыл бұрын

Thank you 🙂

@Niru-tj4fo Жыл бұрын

Great explanation . Can we replicate this on our Azure DevOps pipeline while creating infra changes for eg . my YAML pipeline creates an storage account and if it fails or succeeds i want the pipeline to send mail . can we use logic app here ?

@surajviswakarma254 Жыл бұрын

Hi, your videos are really interesting. I have a scenario where I need to send pipeline, activity and time taken for execution for each pipeline in a mail body. Can you help how can I achieve it. I have set up the log analytics for adf and able to run the KQL to get the results. This results need to passed over the email body to business user. Please help

@ramyanive1349 Жыл бұрын

In my pipeline i am using more than one activity. I need to send email for 2 scneario 1. When the file is not present 2. When the value of the file is wrong So my question is for verifying these two do i need to have 2 logic app ?

@hari7221 2 жыл бұрын

Hi , do we have any other ways to send emails from ADF ( other than logic app)? Like graph api or any other? Thanks

@bashabash3697 Жыл бұрын

How to check whether this logic is already implemented or not?

@samcool1504 2 жыл бұрын

This is a very helpful video. Can we also use one web activity for multiple pipelines? If yes, how can it be done?

@VenkatSanthoshh 2 жыл бұрын

@WafaStudies in the email section from Logic App , I have given an email in the "To" section , but I am getting "message": "Email format of a sender or at least one recipient is incorrect." I tried giving semicolon at the end of the email but still getting the error , Could you suggest me how to proceed with this?

@prosinging7853 3 жыл бұрын

can u please add a video on 'email alert when a data is inserted into a synapse view/dmv using adfv2/logicapp'

@priyankamanjunath8565 2 жыл бұрын

can we log error messages to csv file ?? can you please make video on that , if we want to capture errors from multiple activities

@annekrishnavinod5482 3 жыл бұрын

can we reuse this web activity? or we can create for all pipelines manually?

@shivabasayyahiremath6802 2 жыл бұрын

awsome bro

@WafaStudies 2 жыл бұрын

Thank you 😊

@malathin5879 2 жыл бұрын

Hello Sir, i am new to data factory. How much of coding is needed for this profile

@WafaStudies 2 жыл бұрын

Very less

@bvkandala 2 жыл бұрын

I am getting this error Error code 2108 Troubleshooting guide Failure type User configuration issue Details {"error":{"code":"InvalidRequestContent","message":"The request content is not valid and could not be deserialized: 'After parsing a value an unexpected character was encountered: e. Path 'pipelinename', line 3, position 1.'."}} Thanks

@samcool1504 2 жыл бұрын

I'm getting the same error

@bvkandala 2 жыл бұрын

@@samcool1504 I figured it out. Check your code, you must be having a ) instead of }

@samcool1504 2 жыл бұрын

@@bvkandala can you help share the code snippet ? I seem to be having } in the dynamic content section.

@bvkandala 2 жыл бұрын

@@samcool1504 what's your email id, and where did you check the code? In the web activity body?

@bvkandala 2 жыл бұрын

@@samcool1504 { "Pipeline":"@{pipeline().Pipeline}", "Subject":"An error has occured in the Gov Cloud @{pipeline().Pipeline}-pipeline!", "ErrorMessage":"@{activity('Copy data1').Error.message}", "DataFactoryName":"@{pipeline().DataFactory}", "Runid":"@{pipeline().RunId}" } Go back to your logic app and in the click on the email activity and , click on RUN and chose the option "RUN With Payload", in the body type the following code { "Subject": "This is a TEST email" } Now run and save the logic app, comeback to your pipeline and run it.

@amanahmed6057 2 жыл бұрын

sir agar mera account free hai or me agar resource group banaata hu or agar me usko 3 din baad delete maaru toh koi problem thodi hai??

@vickygupta4263 Жыл бұрын

Can anyone pls help to get exact error message of failed activity. Code that i used is like - @('activity').output.errors[0].message But getting error msg as failed to parse any special character. Thanks!