DP-203: 27 - Azure Synapse Analytics: Overview, Pipelines
Вставка
- Опубліковано 2 сер 2024
- Hey data engineers! Let's discuss yet another service for data ingestion - Azure Synapse Analytics, which was promoted as the "one-stop shop for all your data engineering and analytics needs".
Join me in the 27th episode of my free DP-203 course where I cover the following topics:
• What exactly is Azure Synapse Analytics?
• Which component of Synapse is suitable for data ingestion, and how does it compare to ADF?
• How to ingest data from a REST API and what does a Lego minifig have to do with it?
Enjoy!
▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬
My LinkedIn profile: / piotr-tybulewicz-81a8793
GitHub with my drawings: github.com/TybulOnAzure/DP-203
"Is Synapse Dead" by Paul Andrew? mrpaulandrew.com/2024/02/04/i...
ADF vs Synapse Pipelines: learn.microsoft.com/en-us/azu...
▬▬▬▬▬▬ MEMBERSHIP ▬▬▬▬▬▬
Join this channel to get access to perks:
/ @tybulonazure
▬▬▬▬▬▬ CHAPTERS ▬▬▬▬▬▬
00:00 Introduction
00:35 What is Synapse Analytics?
06:38 DP-203 vs Microsoft Fabric
08:34 Provisioning Synapse workspace
13:48 Scenario for today
24:05 Ingesting data from Rebrickable
1:06:11 Summary - Авто та транспорт
![Azure Synapse | Azure Synapse Analytics [Full Course] ☁️](http://i.ytimg.com/vi/lLrjaVdBuM0/mqdefault.jpg)
This was amazing and fun session to follow along. Thanks a ton for providing such informative content sir!! I had the same question of dynamic API in keyvault but i checked the comments, its been covered. Thanks again. On to the next one.!!
You are the goat Tybul!
Thanks!
Its really a brief introduction to Synapse Analytics and great content to learn !! thanks Tybul!!
Was waiting for the synapse analytics part👍
Thanks
Great video
Great video! Thanks for posting this ! Easily understandable.. I have a question- how to to store the secrets in the key vault dynamically if they need to be generated after a 24hr period
I don't quite understand. Could you please add some more context to this question?
Suppose I have an api which is secure -which allows me to access data only after using a username and password and then there is additional layer of security where I can access the data in a folder only after I provide a bearer token which expire after 24hrs . how can I store the bearer token as secret in the key vault whenever it is generated on login
@@shilpajbabu You could use Key Vault REST API to add a secret to Key Vault once you have new token available. More details: learn.microsoft.com/en-us/rest/api/keyvault/#secret-operations-key-vault-only
thank you so much.. 😊
much awaited episode have fianlly landed .Thank you very much and remain bless..Please sir,are you going to cover streaming in this series.
Yes - streaming will be covered
@@TybulOnAzure thank you very much. Words can't explain how valuable and money you saved me after spending so much from different training program which is not up to the standard of your classes. As soon as I got notification around 11:30 pm of my time yesterday , I quickly start the class. Once more thank you very much.
Excellent video, after the test for viewers episode will you be covering spark/databricks? If possible can you tell what all things will be covered in it?
Ik this is a dp203 playlist but if you can cover just a bit more than what's in certification like say pyspark I think it'll be really helpful for people looking to go in data engineering role. Saying this because the way you teach, the flow, the quality, ease to understand, everything is just phenomenal and you are a very gifted teacher, so leaning from you is a blessing hence want to learn as much as we can from you 😄😄
I plan to have one more episode between the "challenge" and Databricks one.
About Databricks - there will be several videos about it but I don't have a detailed plan yet. But for sure I won't go deep into pyspark as it is not a pyspark course.
@@TybulOnAzure Yes, that'll be helpful, Thank Youu
Thank you. Will this playlist have content about Stream Analytics and Purview?
Steam Analytics - yes, Purview - probably yes
Thanks,@@TybulOnAzure
I worked both of them through MS DP-203 documentation but I'm looking forward to your videos, whenever they come out.