How to Deploy Azure Data Factory (ADF) from Dev to QA using Devops
Рет қаралды 34,691
Just wanted to do a quick video to cover the process of deploying ADF artifacts from Development environment to higher environments like QA, etc. these are the basic steps to get it done (please watch the video for detailed instructions)
1. Create a new project in Devops if there is no project set up already
2. Make sure Repo is created along with a collaboration branch, by default you will have a main branch there, I usually create development branch where developers will pull their code in after they are done with unit testing:
3. Configure ADF to connect to Git repository in Devops (make sure to use development as collaboration branch and allow adf_publish to be the default publish branch)
4. Make sure to publish your data factory so that you can see the two json files in devops
5. Create a new release pipeline
6. Create a new release
link to blog: businessintelligist.com/2021/07/14/how-to-deploy-azure-data-factory-adf-from-dev-to-qa-using-devops/
@JohnSmith-rx2uv 2 жыл бұрын
Short and straight to the point - This is exactly what I needed! Thank you!
@victors9585 10 ай бұрын
Не ожидал, что Нагиев умеет так классно в Биг-дату!!! 😎👏🌟👍👏🌟👍Контент - АГОНЬ!!! 🔥🔥🔥🔥🔥🔥 Благодарю за труд!!! Заходит в кайф!!! 👍👍👍👍👍👍 Не останавливайся!!! 🚀🚀🚀🚀🚀🚀
@sonjoysengupto Жыл бұрын
Very fluid and extremely helpful demo, thanks a lot🙏🏾
@zahircheema38 8 ай бұрын
Very concise and to the point ...good job ...Thanks!!!
@girishrao5816 8 ай бұрын
It's very informative.... Please add more videos on ADF real time scenarios.
@srikanthp4312 2 жыл бұрын
Great Job bro..very useful. Thanks for posting it!
@Vamsikrishna-ve5gw Ай бұрын
Awesome!
@sitrakaforler8696 Жыл бұрын
Dude.... it's perfect! Thank you very much!
@ramkidec11 Жыл бұрын
Extremely helpful video. Thanks 🙏
@hutchm92 2 жыл бұрын
Great job! I was able to follow your simple steps to revisit a problem I was experiencing with adf_publish. I did not have GIT configuration Publish branch set up correctly. It was pointing to the collaboration branch.
@ankhoff 4 ай бұрын
Thank you for the video! Very nice tutorial!
@SuperMarincho 11 ай бұрын
Your Video was very helpfull for a deploy I`m doing, thanks a lot Sr
@Austin-st8yn Жыл бұрын
Great video! Thanks!
@aasthachopra 3 ай бұрын
Thanks !! You are an angel 😇
@kukkavenkatprashant8309 2 жыл бұрын
Very helpful thank you 😊
@sakthijeganathan9573 Жыл бұрын
Good tutorial. Thanks a lot
@Ignalvarez 6 ай бұрын
Great Content!
@cristophercampos3671 8 ай бұрын
Nice video bro, greetings from chile.
@scottbillings2351 Жыл бұрын
Great video Thanks
@devopstechy 7 ай бұрын
u have not shown release pipeline task
@mohamedfahfouhi3537 6 ай бұрын
thanks a lot for This tuto, 👏helpful for me
@emiliogarzacantu4296 9 ай бұрын
Great content, thanks. Just wondering, you don't need a separate repo for QA, right? Like the QA ADF won't be connected to any repos?
@ADFTrainer Жыл бұрын
Can you create video for deployment using YAML file Thanks
@davidkerr7 2 жыл бұрын
How did you get the keyvault parameter to show up in your parameter files
@veronicadesantos2840 Жыл бұрын
Do you need an extra step to publish the pipelines you deployed in QA? or how do you publish in the QA data factory?
@sumeetvachhani5321 Жыл бұрын
Is it possible to change pipeline parameters or activity settings when moving from dev to QA? In some activities like web activity URL might be different for environment, how can we handle that?
@joestopansky6375 Жыл бұрын
Does your release do anything that isn’t already done by your build pipeline? It seems like you are just deploying the ARM template to QA twice: once from build pipeline and again from release.
@sonjoysengupto Жыл бұрын
Great catch, just realized that he did not go to the details of what’s in the release pipeline at all🤔
@SameerSK52 Жыл бұрын
Exactly. But I don’t think he is deploying twice. The second release pipeline would be just earmarking the build so that we can revert back the build if needed using release number. That’s my guess but were you able to figure this out?
@miguelmercados7246 Жыл бұрын
If I created my project in QA at first, it works the same to copy from QA to DEV?
@hma262 2 жыл бұрын
Hi, sir. Thank you very much for this! It saved me a lot of time. I have one little question: what if the data factorys are in two different resource groups? Thank you very much again.
@GuyBehindTheScreen1 2 жыл бұрын
I have the same question. All of my environments are in different resource groups.
@hma262 2 жыл бұрын
@@GuyBehindTheScreen1 it's possible. I did it using "ARM template deployment" agent and specifying the target group resource
@GuyBehindTheScreen1 2 жыл бұрын
@@hma262 Yeah good call. I should have finished the video before commenting lol. He specifically says the Resource group you pick when creating the pipeline is where you want it to be deployed too (for anyone else following along).
@jakirajam Жыл бұрын
Hi....please show me Qa adf code..once deploy....in qa it should be run
@LilM0ke 4 күн бұрын
when using the template currently, there is no elipsis to click to show the files. any ideas? thank you
@KnowledgeBankPro 2 күн бұрын
sorry, this is video was recorded a while ago, and some options might have changed.. we will look into updating it soon
@eddyjawed 12 күн бұрын
Thanks for your helpful vid but I got to admit MS as usual overcomplicate everything its so long winded. Deployment should be much easier than this
@KnowledgeBankPro 11 күн бұрын
totally agreed, I recorded this video because I got so frustrated with it one day that I could only imagine how other people felt so I wanted to do something to help out.
@CallousCoder 2 жыл бұрын
This is not really the way to do it. You don’t want a deploy per environment in a classic pipeline. Using pipeline as code and then having the ARM template defined with variables and have arm template variable files per environment. You can then generate they variable files on the fly by just generating them from the template.
@eddyjawed 3 күн бұрын
omg I managed to delete several Azure resources with this stupid ARM template. THIS THING IS DANGEROUS!
@KnowledgeBankPro 2 күн бұрын
ouch
PRO Hi-Tech
Рет қаралды 110 М.