Unity Catalog setup for Azure Databricks

In this video I walk through setting up Unity Catalog on Azure and quickly exploring the cataloging features for a couple tables with a workflow. This includes setting up storage and access connector, then a quick walk through of lineage and other metadata tracked at the table level.
* All thoughts and opinions are my own *
Learn more about Unity Catalog with one of the below videos:
Short intro from Databricks - • Databricks Unity Catal...
Data Lineage - • Automated Data Lineage...
Deeper dive introduction - • Introduction to Unity ...
More from Dustin:
Website: dustinvannoy.com
LinkedIn: / dustinvannoy
Github: github.com/datakickstart
CHAPTERS
00:00 Intro
01:35 Setup Metastore
4:58 Assign workspace + explore
9:20 Outro

[@kacho2580]

Thanks for the video Dustin. I just wanted to ask, the data and metadata that already exist on hive_metastore will be affected after I create the Unity Catalog?

[@DustinVannoy]

That data will still be available under a catalog named hive_metastore. So you would now have a 3 part name available: {catalog}.{schema}.{table}

[@abisheksubramanian8069]

Awesome content Dustin

[@thedatamaster]

Thanks for this video Dustin.
When I click on manage account in Azure Databricks workspace. I am not able to get account console. Could you please help me on that?
Thanks in advance.

[@thekydang5720]

You need Azure AD - Global Admin Roles to access Manage Account

[@maira9648]

thanks for this video! just wondering if unity catalog allows us to create functions to flag invalid data? I was thinking of have all business rules validation in the unity catalog rather than spread across its own individual ETL solution.

[@DustinVannoy]

For doing check when processing the data, I like to create Python libraries stored along with notebooks in Databricks Repos so you can reuse logic. You can create UDFs that are stored in Unity Catalog. learn.microsoft.com/en-us/azure/databricks/udf/unity-catalog

[@TheDataArchitect]

Can delta sharing works with hive_metastore?

[@nielshoogeveen3767]

I have an admin account. However I do not see "Create catalog". What could be wrong?

[@DustinVannoy]

Has a Unity Catalog metastore already been created and assigned?

[@TJ-hs1qm]

Only 2min in and he already lost me. 1:53 can't see the referenced screen 😆?!
For future videos: it would be greatly appreciated if the necessary prerequisites could be at least listed in the description box.
this -> ua-cam.com/video/M7C-MyVHyrU/v-deo.html