23. Send Email alert when Pipeline fails in Azure Data Factory

Поділитися
Вставка
  • Опубліковано 2 лют 2025
  • In this video, I explained about creating a logic app which will run on HTTP request and send email alert, and calling that logic app from your pipeline on failures.
    Link for Azure Synapse Analytics Playlist:
    • 1. Introduction to Azu...
    Link for Azure Databricks Play list:
    • 1. Introduction to Az...
    Link for Azure Functions Play list:
    • 1. Introduction to Azu...
    Link for Azure Basics Play list:
    • 1. What is Azure and C...
    Link for Azure Data factory Play list:
    • 1. Introduction to Azu...
    Link for Azure Data Factory Real time Scenarios
    • 1. Handle Error Rows i...
    Link for Azure LogicApps playlist
    • 1. Introduction to Azu...
    #Azure #AzureDatafactory #DataFactory

КОМЕНТАРІ • 81

  • @ArabaEfsanesi
    @ArabaEfsanesi 3 роки тому +16

    I have just completed 85 videos. What a effort Maheer! You explained almost every details in ADF with practical demos. I learned a lot, a lot, a a lot... I am planning to continue with PowerBi and also ADF real time scenario playlists. I really appreciate for your effort on these playlists. Thank you Maheer, Gracias, Arigatōgozaimashita, Xièxiè nǐ, Tesekkurler, Shukran, JazakAllah, Shukriya......

    • @WafaStudies
      @WafaStudies  3 роки тому

      Thank you for kind words ☺️

  • @nitishsalunke
    @nitishsalunke 3 роки тому +7

    I am holding multiple job offers just because of you and your videos. Thank you so much! Your videos are very easy to understand. Keep making such videos 🎉

    • @WafaStudies
      @WafaStudies  3 роки тому +1

      Congratulations 🎉👏🎉

    • @swagatmohanty5818
      @swagatmohanty5818 3 роки тому +4

      Hi bro.
      ADF, ADLS, SQL Server. Are these skills enough to get a job (2 years. exp.) ?
      Kindly guide me.

    • @RaviPrasadRAVIPDGUPTA
      @RaviPrasadRAVIPDGUPTA 8 місяців тому

      @@swagatmohanty5818 yes

  • @abhijeetpandey8052
    @abhijeetpandey8052 3 роки тому +4

    Thank you for putting lot of hard work for us..best tech related channel on UA-cam...... can't thank you enough

    • @WafaStudies
      @WafaStudies  3 роки тому +1

      Thank you for your kind words 🙂

  • @srisuman3996
    @srisuman3996 3 роки тому +2

    Bro meeru flawless unnaru andukey emo Microsoft mee daka vachindi … talent got recognised …. Preparing for interviews through your videos much help full

  • @cajaykiran
    @cajaykiran 3 роки тому +2

    Spot on!!
    Can you please do a video on reading a file from SharePoint online Document library to Azure ADLS/ BLOB using ADF.

  • @shockey3084
    @shockey3084 3 роки тому +2

    As usual, keeping quality maintained.

  • @AnnuKumari-mo6gz
    @AnnuKumari-mo6gz 3 роки тому +2

    Much needed .. Thanks for covering😀

  • @omkarkulkarni3346
    @omkarkulkarni3346 10 місяців тому

    Thanks for the video ,you have added your email id in action to send failure notification email but in real world production scenario how does it get handled?

  • @deepakbehera498
    @deepakbehera498 11 місяців тому

    Could you also please post how to identify the cost for these services ? Great Video. Thanks!

  • @YasminS-e1l
    @YasminS-e1l 6 місяців тому

    O365 deprication with teams, now we have to implement the workflow by power automate. Could you please explain me how to do this?

  • @MuppiriRajaVenkataPhanindraKum
    @MuppiriRajaVenkataPhanindraKum 9 місяців тому

    I'm doing just as mentioned in the video but I'm unable to capture the error message in the email alert that I'm receiving. Is there something that I'm doing wrong, could you let me know what could be the issue

  • @abhineshlal2602
    @abhineshlal2602 10 місяців тому

    its working when we are doing using directly web activity but when we are inserting web activity in pipeline and using same statement of error message through parameter it's not working.
    Every other parameter except error message are coming in email. How to do that?

  • @kathirsubramaniam4597
    @kathirsubramaniam4597 3 роки тому +2

    How to read an error message from DataFlow if failed? I tried to use expression like this "@{activity('Run DataFlow').output.errors[0].Message}" to read error message from my DataFlow activity. But there is no such expression to read the exact error message from DataFlow.

    • @vickygupta4263
      @vickygupta4263 2 роки тому

      Even i need an expression to evaluate the error msg. Pls let me know if u got the answer

  • @viveknimmagadda2397
    @viveknimmagadda2397 Рік тому

    Thank you for the detailed explanation. It is really helpful!

  • @sarmisthasarkar3009
    @sarmisthasarkar3009 9 місяців тому

    Hi @WafaStudies.. thanks for detailed videos on ADF. Can you please help to handle one scenario in ADF ? I need to get response from REST API which will response data in jsonline format (not json array) . How in ADF can read jsonline API response ? in REST API, jsonline seems not to be supported.

  • @srinivasreddymalem6494
    @srinivasreddymalem6494 2 роки тому

    @Maheer, My question is how to send a notification when all pipelines under a data factory. Much appreciated your help.

  • @bashabash3697
    @bashabash3697 Рік тому

    How to check whether this logic is already implemented or not?

  • @itsartyficial1985
    @itsartyficial1985 7 місяців тому

    Useful for interview thanks it was very helpful

  • @bharathmamidisetti3896
    @bharathmamidisetti3896 5 місяців тому

    Thanks,great efforts ❤

  • @ranjitreddy7918
    @ranjitreddy7918 3 роки тому +1

    I really appreciate your efforts.

  • @ramyanive1349
    @ramyanive1349 2 роки тому

    In my pipeline i am using more than one activity. I need to send email for 2 scneario
    1. When the file is not present
    2. When the value of the file is wrong
    So my question is for verifying these two do i need to have 2 logic app ?

  • @jagadeeshpinninti3323
    @jagadeeshpinninti3323 2 роки тому

    How much will it cost to use using Azure logic apps to send the failure ADF pipelines email notifications?

  • @Niru-tj4fo
    @Niru-tj4fo Рік тому

    Great explanation . Can we replicate this on our Azure DevOps pipeline while creating infra changes for eg . my YAML pipeline creates an storage account and if it fails or succeeds i want the pipeline to send mail . can we use logic app here ?

  • @surajviswakarma254
    @surajviswakarma254 Рік тому

    Hi, your videos are really interesting.
    I have a scenario where I need to send pipeline, activity and time taken for execution for each pipeline in a mail body.
    Can you help how can I achieve it.
    I have set up the log analytics for adf and able to run the KQL to get the results.
    This results need to passed over the email body to business user. Please help

  • @manojkiran5730
    @manojkiran5730 4 місяці тому

    Thank you Maheer bro :)

  • @johnpaulprathipati153
    @johnpaulprathipati153 2 роки тому +1

    hi maheer bro i am fan of your content..
    tq so much

  • @robinthomas7782
    @robinthomas7782 3 роки тому

    How can we get the name of the activity to send inside the mail body

  • @chaudhryalisalam3668
    @chaudhryalisalam3668 Рік тому

    Great work again mate.

  • @hari7221
    @hari7221 2 роки тому

    Hi , do we have any other ways to send emails from ADF ( other than logic app)? Like graph api or any other? Thanks

  • @iaminazure
    @iaminazure 3 роки тому +2

    Could be done in a better way...using datafactory restapi's
    Or else if we don't need custom message we can configure alerts directly in the ADF

  • @amanahmed6057
    @amanahmed6057 2 роки тому

    sir agar mera account free hai or me agar resource group banaata hu
    or agar me usko 3 din baad delete maaru toh koi problem thodi hai??

  • @alonsom.donayre1992
    @alonsom.donayre1992 2 роки тому

    Is Logic App Pricing expensive?

  • @rk-ej9ep
    @rk-ej9ep 2 роки тому

    wow..what an effort 👍👍

  • @VenkatSanthoshh
    @VenkatSanthoshh 3 роки тому

    @WafaStudies in the email section from Logic App , I have given an email in the "To" section , but I am getting "message": "Email format of a sender or at least one recipient is incorrect." I tried giving semicolon at the end of the email but still getting the error , Could you suggest me how to proceed with this?

  • @devtest8259
    @devtest8259 Рік тому

    This was failing on a notebook activity because the error included a “ which caused everything to break. I did a replace in the expression builder which solved it.

  • @samcool1504
    @samcool1504 3 роки тому

    This is a very helpful video. Can we also use one web activity for multiple pipelines? If yes, how can it be done?

  • @priyankamanjunath8565
    @priyankamanjunath8565 2 роки тому

    can we log error messages to csv file ?? can you please make video on that , if we want to capture errors from multiple activities

  • @malathin5879
    @malathin5879 2 роки тому +1

    Hello Sir, i am new to data factory. How much of coding is needed for this profile

  • @annekrishnavinod5482
    @annekrishnavinod5482 3 роки тому

    can we reuse this web activity? or we can create for all pipelines manually?

  • @小明-v3n
    @小明-v3n 2 роки тому +1

    very good video, helpful

  • @prosinging7853
    @prosinging7853 3 роки тому

    can u please add a video on 'email alert when a data is inserted into a synapse view/dmv using adfv2/logicapp'

  • @callmeruks
    @callmeruks Рік тому

    Life Saver!!!!!!!Hats Offfffffff

  • @prosinging7853
    @prosinging7853 3 роки тому

    Very helpful videos u are making for azure but some advanced topics are missing. Eagerly waiting for those advanced topic videos. One of them mentioned in the chat

  • @xelaCO14
    @xelaCO14 3 роки тому

    thanks for this video! it´s amazing and helpful

  • @bvkandala
    @bvkandala 3 роки тому +1

    I am getting this error Error code
    2108
    Troubleshooting guide
    Failure type
    User configuration issue
    Details
    {"error":{"code":"InvalidRequestContent","message":"The request content is not valid and could not be deserialized: 'After parsing a value an unexpected character was encountered: e. Path 'pipelinename', line 3, position 1.'."}}
    Thanks

    • @samcool1504
      @samcool1504 3 роки тому +1

      I'm getting the same error

    • @bvkandala
      @bvkandala 3 роки тому +1

      @@samcool1504 I figured it out. Check your code, you must be having a ) instead of }

    • @samcool1504
      @samcool1504 3 роки тому +1

      @@bvkandala can you help share the code snippet ? I seem to be having } in the dynamic content section.

    • @bvkandala
      @bvkandala 3 роки тому +1

      @@samcool1504 what's your email id, and where did you check the code? In the web activity body?

    • @bvkandala
      @bvkandala 3 роки тому

      @@samcool1504 {
      "Pipeline":"@{pipeline().Pipeline}",
      "Subject":"An error has occured in the Gov Cloud @{pipeline().Pipeline}-pipeline!",
      "ErrorMessage":"@{activity('Copy data1').Error.message}",
      "DataFactoryName":"@{pipeline().DataFactory}",
      "Runid":"@{pipeline().RunId}"
      }
      Go back to your logic app and in the click on the email activity and , click on RUN and chose the option "RUN With Payload", in the body type the following code
      {
      "Subject": "This is a TEST email"
      }
      Now run and save the logic app, comeback to your pipeline and run it.

  • @joshiabhinav
    @joshiabhinav Рік тому

    you are the Best

  • @reshavraj4090
    @reshavraj4090 3 роки тому +1

    Great Content ..!

  • @vickygupta4263
    @vickygupta4263 2 роки тому

    Can anyone pls help to get exact error message of failed activity.
    Code that i used is like -
    @('activity').output.errors[0].message
    But getting error msg as failed to parse any special character.
    Thanks!

  • @Alpa0912
    @Alpa0912 3 роки тому

    Hi Can we attached file in send email?

  • @rakeshpanigrahi577
    @rakeshpanigrahi577 7 місяців тому

    Thanks a lot foe the informative video. We can also the below logic to replace the "][ -
    regexReplace(StringList, '["\\[\\]]', '')

  • @anthony281190
    @anthony281190 2 роки тому

    11:23 Enter Email on Log In

  • @Soufullbyte
    @Soufullbyte 3 роки тому

    can we attache file in email here.

  • @sanjayschopra5316
    @sanjayschopra5316 2 роки тому

    in one pipeliene how to use multiple copy data sets

  • @shivabasayyahiremath6802
    @shivabasayyahiremath6802 3 роки тому +1

    awsome bro

  • @sankarvetti4404
    @sankarvetti4404 2 роки тому +1

    thanks a lot :)

  • @phanichaitanya8829
    @phanichaitanya8829 3 роки тому

    Perfect..

  • @sconnell194
    @sconnell194 3 роки тому

    👍

  • @SivakumarGalaxy-r5g
    @SivakumarGalaxy-r5g 9 місяців тому

    Who care your intentions buddy, you showing to baby data engineers. Atleast you just show minimum level automation instead of manual mode