Great episode as usual thanks men In addition to Mostafa’s last question about metadata to be stored in JSON files vs RDBMS. I had a case last week where I had to query hive metastore, MySQL DB, to get some metadata like list all tables with their columns and partitions also tables location and more Is this applicable with iceberg catalog where metadata stored as JSON or of their is a high level API that can be used for this type of inquiries? Thanks again
Could we have a follow-up on this now that it was a big offering from both Databricks and Snowflake? From a tech-side. How do the two offerings compare?
@@GarageEducation Yes I mean with relation to iceberg and delta integration. How they two file systems compare? Specific scenarios where one would shine over the other, limitations of both. I think after the summits of both Snowflake and Iceberg there is a focus to be more open in regards to storage/table formats and always working on improving performance.
شكرا يا بشمهندس على الحلقة
كم من المعلومات حلو جدا وسهل للمبتدئين
Great episode as usual thanks men
In addition to Mostafa’s last question about metadata to be stored in JSON files vs RDBMS.
I had a case last week where I had to query hive metastore, MySQL DB, to get some metadata like list all tables with their columns and partitions also tables location and more
Is this applicable with iceberg catalog where metadata stored as JSON or of their is a high level API that can be used for this type of inquiries?
Thanks again
Could we have a follow-up on this now that it was a big offering from both Databricks and Snowflake? From a tech-side. How do the two offerings compare?
Nice point. Do you mean comparing features between Databricks and Snowflake in general or with related to Iceberg or delta integration.
@@GarageEducation Yes I mean with relation to iceberg and delta integration. How they two file systems compare? Specific scenarios where one would shine over the other, limitations of both. I think after the summits of both Snowflake and Iceberg there is a focus to be more open in regards to storage/table formats and always working on improving performance.
yeees, that will be super helpful