All About Delta Lake | Databricks | Lakehouse | Deep Dive into Delta

Databricks tutorial for beginners
In this tutorial, you will understand the All About Delta Lake | Databricks | Lakehouse and Deep Dive into Delta. Introduction to Azure Databricks.
Databricks playlist for complete beginners
#deltalake #databricks #lakehouse #delta #deltalivetablesdatabricks #LearnAzureDatabricks #WhatisAzureDatabricks #AzureDatabricksCourse #databricksforFree #CommunityEdition #deltaCorpsharelatestnews #LoginWithDatabricksCommunityEdition #Cluster #CreatingTheNotebook #AzureDatabricksTutorial #AzureDatabricksforBeginners #MicrosoftAzureDatabricks #AzureDatabricks #AzureDatabricksTraining #navalyemul
Link For Databricks Creating Community Edition Account:
www.databricks...
Link For Databricks Playlist:
• Databricks
Link For SQL Playlist:
• MySQL
Link For Power BI Playlist:
• Power BI Full Course |...
Link For Python Playlist:
• Python
Link For Azure Cloud Playlist:
• Azure Cloud
Link For Big Data: PySpark Playlist:
• Big Data with PySpark
1:47 What is Lakehouse
2:31 About Delta Lake (Data Warehouse, Data Lake, and Delta Lake)
7:48 Key Features
9:24 Introduction of Pipeline using separate storage systems
10:34 About Using Delta Lake for both stream and table storage
11:37 Databricks Hands-On about the Delta Kake
12:12 Start Creating a Notebook in Databricks
15:07 How to Create a Delta Table
16:26 Creating an Empty Delta Table
17:34 Create a Database using SQL in Databricks
20:36 Describe extended using SQL in Databricks
23:56 How to Display the File Path in Databricks
29:55 Create Delta Table using Parquet File with SQL in Databricks

[@ComedyXRoad]

thanks for your efforts

[@ashishbhardwaj1655]

I mentioned in your other video also.. you explained very well, specially ""what and where"" all components exists..

[@thedatamaster]

Thanks for your kind words! I'm glad you found the explanation helpful. If you have any more questions, feel free to ask!

[@learnwithfunandenjoy3143]

Thanks Naval for creating such powerful video. You have explained the things so easily that everyone would able to understand all concepts very easily. Great Going Naval.

[@sumitambatkar3903]

so much helpful video sir keep suporting...

[@thedatamaster]

Thank You 🙏
Glad it helped you. 😊

[@Pankaj_Dhome]

Thank you so much for such granular details🎉

[@thedatamaster]

You're very welcome! I'm glad you found the details helpful 🎉.

[@prabhatgupta6415]

Just a small confusion. In hive i studied that if internal gets dropped both data and metadata get deleted.
but if we drop external only meta data get deleted the actuall is stored in hdfs/s3/adls.
but here u r saying for external if we drop this meta data wont get deleted only data get deleted.
I did not get this plz explain

[@suchitranair683]

When you drop an external table, the table gets dropped from the hive metastore, i.e. you lose the schema definition for the table, but the external location still has your data in parquet format along with metadata (your transaction logs in json format and your history).

[@VishalSharma-lz6ky]

Just adding a point in external table data is external and metadata is in databrick
when we drop the table only meta data will be deleted ,data is safe in ADSL

[@suman3316]

Best explanation about delta thanks

[@rushikeshsonune8779]

You explained it very well Sir.

[@akhtarattar2744]

Best explanation bro..I have seen lot of videos but you explained in a very simple way.Thank you.

[@divyamsaxena3198]

Thank you very much brother..

[@thedatamaster]

Thank you so much for your kind words! 😊 We're thrilled to hear that you're enjoying our content.

[@pankajjagdale2005]

very well explained Thank you😊

[@thedatamaster]

You're very welcome! I'm delighted to hear that you found the explanation helpful. If you ever have more questions or need further clarification on anything, please don't hesitate to ask. Thanks for watching, and I appreciate your support! 😊👍

[@priyankasrivastava3247]

Well explained video.. helped to clear lots of concepts thanks

[@KaunteyaShaw]

For an external table, when the drop command is issued, metadata is deleted, data is still there in adls/storage. for a managed table, both data and metadata are deleted. Correct me if I am wrong.

[@thedatamaster]

You're absolutely right!

[@ChanduShekhar-vg7qk]

Nice explanation. One correction for external tables only the metadata gets deleted from your external location that can be your S3 or ADLS. Still you can access to the data.

[@rushikeshsonune8779]

Very helpful video 👍

[@user-qn7ll8hb1u]

When you drop an external table, Databricks removes the table metadata but leaves the underlying data in the external location intact. correct me If I am wrong.

[@samarpittuli4113]

Correct

[@DesiGodOfWar]

Incorrect information at 30:02. When an external table is dropped, only the metadata is deleted. Data stays.

[@Ajjeshh]

Nope.
When an external table is dropped, data only gets dropped but metadata always stays as we are storing outside dbfs ..

[@user-qn7ll8hb1u]

r u sure??@@Ajjeshh

[@rohitsharma-mv5xw]

@@Ajjeshh correct me if im wrong Dropping Table: When you drop a managed Delta table, both the table metadata and data are deleted from the storage layer. However, when you drop an unmanaged Delta table, only the table metadata is deleted, and the data remains intact in the external storage layer. Therefore, you need to be careful when dropping unmanaged tables, as you could lose your data if you’re not careful.

[@anantghuge6258]

Thanks sir 😅

[@thedatamaster]

Glad it helped you.

[@aslamnaturalfarming2128]

Much appreciated

[@thedatamaster]

You're most welcome! If you have any more questions or need assistance in the future, don't hesitate to ask.

[@sandhyauppu2472]

Is it mandatory for databricks you should have handson experience of 6months

[@shubhamavhad9269]

thanks

[@thedatamaster]

You're welcome!

[@user-zv9um9pb6w]

Lake House is more than delta. Its open meaning open technology, its the same treatment and technology for streaming and batch ie not lambda or kappa. Ect ..

[@user-nc8co6se4b]

Could you please make a video how to read delta tables in powerbi ?

[@thedatamaster]

Check out my video on connecting it to Power BI
ua-cam.com/video/IOSVRkguuHg/v-deo.htmlsi=t-TGk0lgMijHSMLs