hello! thanks for the excellent videos. They help me a lot to understand the cloud and the fundamentals of data engineering in the Microsoft cloud. If I have two virtual machines and in each of them I install the same version of integration runtime, would configuring a single integration runtime in datafactory be okay? Can I use the same authentication key on both virtual machines?
Yes. Basically you described the setup to make SHIR highly available so it will be still working even if one of VMs goes down. Take a look here for more details: learn.microsoft.com/en-us/azure/data-factory/create-self-hosted-integration-runtime?tabs=data-factory#high-availability-and-scalability
It depends what you mean by monitoring. Maybe from costs point of view you would like to know if they are used at all as they have a price just for their existence. What authentication keys do you have in mind in context of rotation?
@@TybulOnAzure My bad, i meant account keys not authentication :) okay i just watched another video ADLS security #17 and you just said we shouldnt use account keys in linked services as it gives too much control. Also you mentioned why keys should be rotated so i know everything :
@@TybulOnAzure Great, thanks, I think this will more than cover the exam. But would you say all 30 videos + SQL will cover most Data Engineer job roles (from a theory point of view)? or is this too hard to say?
These videos are awesome! Concepts are explained very clearly. Thank you!!
Thanks!
I found this gem recently. I am on the way in this series. Thank you so much for your videos. Appreciate your help in making this videos.
Complicated Networking topic explained in very simple way. Thanks for your efforts.
Thanks for the information❤
34:31 Compelete invasion
Thank u so much
hello! thanks for the excellent videos. They help me a lot to understand the cloud and the fundamentals of data engineering in the Microsoft cloud. If I have two virtual machines and in each of them I install the same version of integration runtime, would configuring a single integration runtime in datafactory be okay? Can I use the same authentication key on both virtual machines?
Yes. Basically you described the setup to make SHIR highly available so it will be still working even if one of VMs goes down.
Take a look here for more details: learn.microsoft.com/en-us/azure/data-factory/create-self-hosted-integration-runtime?tabs=data-factory#high-availability-and-scalability
@@TybulOnAzurethanks for the information. 😊
we use here shir to connect to aws data sources
Learned SHIR !!
Does private endpoint needs to be monitored? Or authentication keys should be rotated after some period of time?
It depends what you mean by monitoring. Maybe from costs point of view you would like to know if they are used at all as they have a price just for their existence.
What authentication keys do you have in mind in context of rotation?
@@TybulOnAzure
My bad, i meant account keys not authentication :)
okay i just watched another video ADLS security #17 and you just said we shouldnt use account keys in linked services as it gives too much control.
Also you mentioned why keys should be rotated so i know everything :
how many are in the series for whole of DP203
I don't know yet, time will tell. But for sure at least 30.
@@TybulOnAzure Great, thanks, I think this will more than cover the exam. But would you say all 30 videos + SQL will cover most Data Engineer job roles (from a theory point of view)? or is this too hard to say?
It should cover most of it and at least give you a solid theoretical background to get started with real-life projects.
Amazing thank you Tybul