Yes, you can perform insert, delete, and update operations in both types of tables. Delta Lake's support for these operations allows you to easily maintain the data in your tables by providing functionality similar to what you would find in a traditional relational database management system. Note that the ability to perform these operations is one of the features that separates Delta Lake from simpler file-based data storage formats. However, while you can perform these operations on both Managed and External tables, it's crucial to remember that in the case of External tables, these operations will only affect the table view Delta Lake is managing, not the underlying data in the external storage.
Although we are creating the internal and external tables using files available in dbfs ,under the hood tables are stored as parquet files only. And the all the history of delta table are stored as transaction log files which are in json format. For internal tables when we delete the tables the data and metadata will be be deleted. But in case of external table if we delete the table only the metadata will be deleted. The underlying files will not be impacted by this as it is stored in external storage like adls and s3.
I know this video is been up for a while, but I'm curious what catalog/schema in the meta catalog the table is being created in lesson 3 step 2 (1:25:00 ) in video? Can Create table SQL specifiy bronze.health.health_tracker_processed for example? Will these tables be visually depicted in the "Data" tab in the DB IDE?
Material is well articulated but it looks like the trainer was asked to work on weekend :P
True, great material but the trainer is soo low energy that the video is hard to listen to.
Where can i get the notebook?
Where do you get the materials promoted in this video?
I'm wondering the same. I replayed a few times to be sure I didn't miss it.
it is in databricks academy. course name: Lakehouse with Delta Lake Deep Dive
What is difference between MANAGED delta table and EXTERNAL Delta table in azure databricks? Can we do insert , delete , update in both the types.
Yes, you can perform insert, delete, and update operations in both types of tables. Delta Lake's support for these operations allows you to easily maintain the data in your tables by providing functionality similar to what you would find in a traditional relational database management system. Note that the ability to perform these operations is one of the features that separates Delta Lake from simpler file-based data storage formats.
However, while you can perform these operations on both Managed and External tables, it's crucial to remember that in the case of External tables, these operations will only affect the table view Delta Lake is managing, not the underlying data in the external storage.
Although we are creating the internal and external tables using files available in dbfs ,under the hood tables are stored as parquet files only. And the all the history of delta table are stored as transaction log files which are in json format. For internal tables when we delete the tables the data and metadata will be be deleted. But in case of external table if we delete the table only the metadata will be deleted. The underlying files will not be impacted by this as it is stored in external storage like adls and s3.
Link to the databricks notebooks?
I know this video is been up for a while, but I'm curious what catalog/schema in the meta catalog the table is being created in lesson 3 step 2 (1:25:00 ) in video? Can Create table SQL specifiy bronze.health.health_tracker_processed for example? Will these tables be visually depicted in the "Data" tab in the DB IDE?
i like the delta lake design pattern
Well articulative.
hi I'm Ariful Islam leeton im software
Super articulative
needs to work on her presentation skills
her speech is so unclear and slurred, the other speaker was so much better