Thanks Adam for creating high quality content with absolute clear steps for anyone to understand the complete topics, just love it.

Thanks for taking the time to publish these walkthroughs. I've only recently discovered your channel but am finding that your demos are really clear and they form a great introduction when needing to deal with new unfamiliar resources in Azure. The production quality is great too, so thank you and please keep up the great work.

Thank you for this great tutorial! I looked all over the web and could not find anything to compare to your video.

This is by far the most comprehensive hands-on demo I have seen regarding such a complex topic. Thanks.

Thanks for the quality and effort you put into this tutorial, really helped me get a quick grasp on ADF and implementing a self-hosted IR with confidence.

One of the best 'how to' demo's I have seen - awesome - thanks!

Excellent video! I'm watching the whole playlist; each video is better than the previous one. Congratulations!

Absolute brilliant. You get to the point in fast pace. Thanks

Adam is just killing it, thanks buddy......live your content 😇👏

dang this is gold. thank you sir, helping a lot of 'retooled' individuals. more power!

Just fantastic, I have watched your ADF videos. They are so clear to understand and up to the mark. Great Jobs Adam 👌👌

Wow was looking for an azure Video on this subject and you created it! Thank you very much

Fantastic video - very clear, concise and easy to follow. Well done mate.

Amazing Adam! Applause for the efforts behind!

Thanks Adam for such a clear and very informative video. Every minute of the video holds new and valuable content without any kind of redundancy. Please keep up this quality work. Thanks again.

As always short, informative, perfect!

What a lucid and expert walk through ! Thanks a ton !!

Great explanation about integration runtime! thanks!

Hi Adam. This is a top quality video. Very clear, very informative. Thanks for putting this together.

Thank for creating one for self hosted, really helpful

These video's are gold, saw a couple already but surely gonna watch m all. (especially if I fail dp-200 tomorrow :p)

Thanks Adam,keep doing good work.Your explanations are really excellent,very helpful.

Great video, Adam. One recommended change: I don't know if this happened after you created the video, but when you try to connect to the VM the first, you'll automatically be rejected until you modify the inbound rule (106) to Allow instead of Deny inbound traffic on 22 and 3389. That was a stopper for me in following this video, but then I got over it.

Pretty helpful example thanks Adam

This is a very helpful video, thank you for putting this together!

Hi Adam, you have explained the concepts very nicely, it would be great if you can also make a video series for DP 203 certification. Looking forward to learn more on DP 203 from you.

Thanks for your effort .. explaining it in easy manner

Helped me understand Self Hosted IR better.

Thank you so much, you really make my day !!! Bravo

Great stuff :) very informative and helpful. Please keep on with your good work

Świetny film, jak zwykle :) fajnie jest wysyłać klientom anglojęzycznym tak porządne instrukcje stworzone przez Polaka !!! :)

This demo is so spot-on!

Thank you so much Adam for making this high quality video!

Thank you so much for clear and crisp video tutorial. Any guidance on capacity planning for self hosted integration runtimes? how to setup multiple instances of integration runtimes for load balancing and high availability.

Great explanation, thanks Adam!

Thank you for this clear explanation and demo!

Thanks Adam for a great video.

Hi Adam, Thanks for the great video, only one question- in case of site-to-site VPN connection between Azure VN and On-premise corporate network do we still need Self hosted Integration environment or the normal Azure Integration runtime will work?

Thanks very much Adam, it is fabulous video, it is video what I am looking for and solved my problems. Thanks

Hi Adam, All your videos are very informative and very clear step by step explanation., If could create a video on - load data from access DB using Access dataset in azure ?

Thank you for your time

Excellent video Adam! Thanks

Hej Brat, Very cool content, just subscribed and checked your website, really nice as well...... Now I will check the rest of your content, take care

Really good work Adam. Big Thank you. :)

Adam! It's wonderful. Could you help me with this? 1. In order to connect to azure iaas server from ADF, should i use Self- Hosted IR or it will work with Native Azure IR itself?

So good, thanks.

Hello Adam You are a legend by explaining all the logics clearly in diagrams. Could I ask 1 question: 1. Self-hosted IR, for the on premises blocked inbound database in local VPC , I saw in the video that we install a proxy and then enable the database the database to be connected to the Azure data factory. Is the technic used behind the scene , the proxy is like a NAT gateway , which will let the traffic from the ADF to be routed into the database , the route path could either be the Express Route or Public Internet

Really good work, thanks a lot

Great. Love it.

Hi Adam, It is really nice video. Can you tell me what does company mostly prefer MIR or Self-hosted IR?

Hi, thank you for your content it's very helpful , is this approach valid when using real-time data ?

Hi Adam, thanks for the great video here. Can you connect without setting up the virtual machine?

Hi Adam, thanks for the clean explanation! At the end you are talking about sizing the VM in order to make it efficient. Will you do a video on it of do you have it already which I have overlooked? With kind regards Jeroen

Hi, very good video! Integration Runtime question, does it encrypt the data it transports? does it apply any hash? If I want to communicate from the cloud to my data center, which ports should I open to achieve the integration, is this not a security issue? Thanks.

Thanks!

Thanks Adam

Hi Adam, your videos have given me great head-start in Azure. Thumbs up! Quick question tho, I am accessing on-Prem sql server through a vpn using ssms. Can I install the self hosted IR on my local machine or it has to be on the server? 2. I’m pulling data from multiple servers from different locations, how do I handle their respective IRs? Many thanks for your quick anticipated help.

Liked with both my accounts

Hi Adam , first of all thanking to you for great and quality contents your shared in this video , I have question , that I have excel files stored in personal PC and currently I have setup a Power BI on prem gateway already in to the same machine. What I was thinking is to migrate same workaround to store data from excel files to Azure DB instance , in that case I was looking to setup Self Hosted Runtime Integration into the same machine. Do you think which is not possible as you mentioned it in the video it is not good to have installed SHRI on same machine as Power BI gateway , If yes what are the problem we will face or difficulties we may concern about. Thank you in Advance.

Thank you for the video, it is great. I have a quick question about the vm, in the demo, you used Windows vm to install the integration run time agent, can it be installed on Linux VM as of April 2021, if not, by any chance you know it is on Azure's product roadmap to support later on?

Hi, could you explain when I should enable option "Enable remote access from an intranet". Docs says that when I use more than one node - this is ok but I don't understand this case "If you use PowerShell to encrypt credentials from a networked machine other than where you installed the self-hosted integration runtime"? Thanks

Many thanks Adam for such a wonderful content. Quick question - How can I choose between AutoResolve and Self Hosted IR to run my ADF pipeline? Looks like by default, ADF takes self hosted IR to run pipelines.

Great video Adam. Any specific reason behind the consideration "Don't install it on the same machine as Power BI gateway". Infact we did it in production and facing issues for a week now. Any help on this would be appreciated @Adam Marczak - Azure for Everyone

Hi Adam, thanks for this quick tutorial. I was wondering how can I share a self-hosted IRT already registered to a Data Factory, to reuse at a Synapse Workspace ? Is there a way so I don´t have to provision another IRT to use with Synapse ? Thanks in advance !!

Why did you create two virtual machines , self-hosted IR can be installed in the same VM where sql server is installed right?

Since Dataflow uses Databricks cluster, why do people expect Dataflow to use Integration runtime(self-hosted or other-wise)? Does ADF DataFlow use IR for any reason?

Great content, Adam... One question.. it is possible to use this method to integrate an Oracle database located in OCI using a private endpoint?

How to read an error message from DataFlow if failed? I tried to use expression like this "@{activity('Run DataFlow').output.errors[0].Message}" to read error message from my DataFlow activity. But there is no such expression to read the exact error message from DataFlow.

Hi Adam, Nice video. Is it possible for you to share more information on how to access On-Premise Database to Azure SQL by installing the VPN and the Self-hosted integration runtime on Azure VM

why dataflow allow only Auto-resolve IR ? and how to be sure that there is no security issue sending data outside of our internal self hosted IR... and is there any alternative, to use internal IR with Data flow ?

Hi, nice video, originally we want to get data from SHIR (private endpoint). However, we also want to use "Data Flow" (public only?). How can we make it safe as this feature only for public network? Thx.

Thank you

Would you say Azure Data Factory is better than Azure Synapse when it comes to data ingestion from On-prem to Azure Data Lake?

thankyou adam

Thanks Adam I have setup self-hosted ir in my on-premises machine to connect on-premises sftp. I can see ip-address of nodes from ir. My question is does this IP address is dynamic or static? I want whitelist this ip address in sftp server.

how we can handle incremental or delta changes from sql database to blob.,???

Well done, thanks

Hi Adam.. I want to merge or upsert data from on source table on one cluster to target table which is on second cluster through a stored procedure in synapse using adf. Could you please let me know how to acheive this?

Hello Adam, thank you very much for such great videos with demos. Please pose more videos on Azure or something related to certifications as well. I have a question in this tutorial. This demo will export everything from the table correct? Can we write our own custom queries, run on the on prem SQL server and import it to Blob storage?

Hello Adam. I'm having trouble with an ADF with SSIS IR. I have a fully parameterized data factory that is deployed across multiple subscriptions/vnets via Azure Devops, but I can't figure out how to parameterize vnet and triggers for those different environments. What is the best approach to do that? Thanks for your great work!

Whil testing the connection, I'm getting this error "The system could not find the environment option that was entered". Please help

Why IR Runtime should not be installed on the same machine as Power BI Gateway?

Hi Adam, Thanks for your video. I am also interested to know about question asked by varun tyagi. Moreover, if you could also share your thought on Self Hosted IR in case of Express Route as well. Thanks in advance

Hi Adam! First of all. Thanks for this video and your material. It's very helpful. And tried this "lab" and work it, but when I try to extract the data with a Data Flow, it was not possible because the IR must be configured via VNet. Do you have any example or another tutorial on configuring a Data Factory via Private Link to an Om Prem SQL behind a VPN? I appreciate much your collab. see you soon!.

Perfect!

Hi Adam, Very well explained. I have a question for you. I need to copy the files from on-prem vm to ADLS Gen2 using ADF and for that as I understood from your video we need to install SHIR in on-prem vm. My question here is, while creating ADF, do I need to change any network settings(like creating a vnet, endpoints etc) in ADF in order to do the copy data activity in a secure way or it will be taken care by ADF/SHIR? Also note, we have an express route setup. Your response will be appreciated. Thanks in advance!

Hi Adam, just wondering if there is a way for the Self Hosted IR to talk to a SQL MI and how should I go about this. Thanks for your videos, they are the first place I come looking for answers!

Hi Adam. Thanks for sharing this. I have question related to the SQL servers which are in availability group. So that if primary server fails secondary will act as primary without any issue. In such scenarios where we can install Integration runtime? On Primary SQL server(VM) or secondary SQL server(VM) or it is advisable to use separate VM for integration runtime?

You are awsome sir

Hey @Adam Marczak. Would you consider installing one SHIR for Dev and another one for Prod or using a shared SHIR for both dev and prod is ok? Looking for best practices

Hello Adam, I know its bit old video. Assuming we don't need any custom drivers - can we now use Azure IR instead of Self Hosted IR with Virtual Network enable feature in Azure IR? The Vnet would enable it to connect to on-prem resources using Express Route or other private Vnets. Thank you!

I want to use data flow to move data from blob to SQL on premises db .. how i will do it ..

Hi Adam, thanks for the tutorial. One question, is it possible for DataFactory to trransform the data extracted from the on-premise database to a CosmosDB table?

Hi, Thanks for the video. I tried to create Azure SSIS IR and trying to deploy SSIS package, but getting bellow error: TITLE: SQL Server Integration Services ------------------------------ The current transaction cannot be committed and cannot support operations that write to the log file. Roll back the transaction. (Microsoft SQL Server, Error: 3930) Could you please help me to sort out this error.

Hey Adam, Can we connect source as on-premise postgresql database and then do mapping data flow transformations in Azure data factory. Once done send the transformed data back onto On-premise Postgresql database. For performing the above task, which drivers should we use.

Hi sir, is it possible to have sink as on premise database using self-hosted IR in azure data factory?

Thanks Adam, great video, I have a question though, what if I want to connect to on-premise SQL server but first I need to connect to VPN. Is there an option to configure that in ADF ?

Hi Adam, will the Self Hosted Integration Runtime work to connect SQL Server 2008? just wonder if it supports such an old version of SQL server. many thanks.

Hi Adam, Is it possible to run a batch file (.bat) or drop a text file on to an on-premise windows server from a pipeline in ADF using self-hosted integration runtime? Requirement is to trigger a report on-premise server once data refresh from ADF pipeline.

Hi Adam, thanks for your video. Just have an IR update question: i want update IR because i can see in Synapse. When i click update now, just have an 'upgrading' notification but don' have other information. Wait more than an hour and nothing. So it should go to the VM update manually or what should i do?