This was amazing and fun session to follow along. Thanks a ton for providing such informative content sir!! I had the same question of dynamic API in keyvault but i checked the comments, its been covered. Thanks again. On to the next one.!!
i actually wanted to skip this episode because I thought that as synapse will be retired at some point in the future will not be needed to know but actually concepts revolves around data factory concepts that every data engineer must know . great video! thanks Tybul
Hi Piotr, i believe this is the best video of whole series. Data ingestion process was explained so easily. Thanks a lot. I have a question if i won’t add statement that we shouldnt take pages with null value in “Next” is it possible that we will be trying to ingest multiple null values forever?
Thanks, I also like that episode. As for the question: no, I don't think it would keep trying to ingest the data forever. Even if it tried, then the pipeline should fail very quickly as ADF wouldn't be able to connect to null URL.
What is your own opinion now about shifting to fabric rather than synapse? Also, do you recommend taking DP-203 or moving to DP-600 instead (from different perspective aspects)?
I wouldn't choose Azure Synapse Analytics for a new project, as it no longer appears to be a top priority for updates and new feature rollouts. DP-203 and DP-600 require distinct skill sets, so they aren't directly comparable. A better comparison would be between DP-203 and DP-700, as both focus on data engineering. Your choice should depend on the tools you currently use or plan to use: choose DP-203 if you’re working with Azure, and DP-700 if you’re using Fabric. Personally, I would do both :)
@@TybulOnAzure thank you very much. Words can't explain how valuable and money you saved me after spending so much from different training program which is not up to the standard of your classes. As soon as I got notification around 11:30 pm of my time yesterday , I quickly start the class. Once more thank you very much.
Great video! Thanks for posting this ! Easily understandable.. I have a question- how to to store the secrets in the key vault dynamically if they need to be generated after a 24hr period
Suppose I have an api which is secure -which allows me to access data only after using a username and password and then there is additional layer of security where I can access the data in a folder only after I provide a bearer token which expire after 24hrs . how can I store the bearer token as secret in the key vault whenever it is generated on login
@@shilpajbabu You could use Key Vault REST API to add a secret to Key Vault once you have new token available. More details: learn.microsoft.com/en-us/rest/api/keyvault/#secret-operations-key-vault-only
Excellent video, after the test for viewers episode will you be covering spark/databricks? If possible can you tell what all things will be covered in it? Ik this is a dp203 playlist but if you can cover just a bit more than what's in certification like say pyspark I think it'll be really helpful for people looking to go in data engineering role. Saying this because the way you teach, the flow, the quality, ease to understand, everything is just phenomenal and you are a very gifted teacher, so leaning from you is a blessing hence want to learn as much as we can from you 😄😄
I plan to have one more episode between the "challenge" and Databricks one. About Databricks - there will be several videos about it but I don't have a detailed plan yet. But for sure I won't go deep into pyspark as it is not a pyspark course.
I have a question for students : How can I get a free Azure account? I had one, but after one month, I couldn't use it anymore because my subscription was disabled.
According to Microsoft documentation: "After you use your credit, wait until the 12 months are over and sign up again if you’re still a student. You'll get $100 credit and free services-just like before." Source: azure.microsoft.com/en-us/free/students
Was waiting for the synapse analytics part👍
Thanks
Its really a brief introduction to Synapse Analytics and great content to learn !! thanks Tybul!!
You are the goat Tybul!
Thanks!
This was amazing and fun session to follow along. Thanks a ton for providing such informative content sir!! I had the same question of dynamic API in keyvault but i checked the comments, its been covered. Thanks again. On to the next one.!!
i actually wanted to skip this episode because I thought that as synapse will be retired at some point in the future will not be needed to know but actually concepts revolves around data factory concepts that every data engineer must know . great video! thanks Tybul
Thanks!
Hi Piotr, i believe this is the best video of whole series. Data ingestion process was explained so easily. Thanks a lot.
I have a question if i won’t add statement that we shouldnt take pages with null value in “Next” is it possible that we will be trying to ingest multiple null values forever?
Thanks, I also like that episode.
As for the question: no, I don't think it would keep trying to ingest the data forever. Even if it tried, then the pipeline should fail very quickly as ADF wouldn't be able to connect to null URL.
What is your own opinion now about shifting to fabric rather than synapse?
Also, do you recommend taking DP-203 or moving to DP-600 instead (from different perspective aspects)?
I wouldn't choose Azure Synapse Analytics for a new project, as it no longer appears to be a top priority for updates and new feature rollouts.
DP-203 and DP-600 require distinct skill sets, so they aren't directly comparable. A better comparison would be between DP-203 and DP-700, as both focus on data engineering. Your choice should depend on the tools you currently use or plan to use: choose DP-203 if you’re working with Azure, and DP-700 if you’re using Fabric. Personally, I would do both :)
much awaited episode have fianlly landed .Thank you very much and remain bless..Please sir,are you going to cover streaming in this series.
Yes - streaming will be covered
@@TybulOnAzure thank you very much. Words can't explain how valuable and money you saved me after spending so much from different training program which is not up to the standard of your classes. As soon as I got notification around 11:30 pm of my time yesterday , I quickly start the class. Once more thank you very much.
Thank you. Will this playlist have content about Stream Analytics and Purview?
Steam Analytics - yes, Purview - probably yes
Thanks,@@TybulOnAzure
I worked both of them through MS DP-203 documentation but I'm looking forward to your videos, whenever they come out.
Great video! Thanks for posting this ! Easily understandable.. I have a question- how to to store the secrets in the key vault dynamically if they need to be generated after a 24hr period
I don't quite understand. Could you please add some more context to this question?
Suppose I have an api which is secure -which allows me to access data only after using a username and password and then there is additional layer of security where I can access the data in a folder only after I provide a bearer token which expire after 24hrs . how can I store the bearer token as secret in the key vault whenever it is generated on login
@@shilpajbabu You could use Key Vault REST API to add a secret to Key Vault once you have new token available. More details: learn.microsoft.com/en-us/rest/api/keyvault/#secret-operations-key-vault-only
thank you so much.. 😊
Excellent video, after the test for viewers episode will you be covering spark/databricks? If possible can you tell what all things will be covered in it?
Ik this is a dp203 playlist but if you can cover just a bit more than what's in certification like say pyspark I think it'll be really helpful for people looking to go in data engineering role. Saying this because the way you teach, the flow, the quality, ease to understand, everything is just phenomenal and you are a very gifted teacher, so leaning from you is a blessing hence want to learn as much as we can from you 😄😄
I plan to have one more episode between the "challenge" and Databricks one.
About Databricks - there will be several videos about it but I don't have a detailed plan yet. But for sure I won't go deep into pyspark as it is not a pyspark course.
@@TybulOnAzure Yes, that'll be helpful, Thank Youu
A GOAT !!!
If Azure Synapse is (or will soon be) dead (not much used) , why is the DP-203 exam so heavily focused on it?
I guess that when DP-203 was released, Microsoft wanted to promote Synapse a lot.
Great video
I have a question for students :
How can I get a free Azure account? I had one, but after one month, I couldn't use it anymore because my subscription was disabled.
According to Microsoft documentation: "After you use your credit, wait until the 12 months are over and sign up again if you’re still a student. You'll get $100 credit and free services-just like before."
Source: azure.microsoft.com/en-us/free/students