So based on what I understood it's basically a service to centralize data lakes within large organizations and manage its metadata so that you can pass the data to everyone who actually needs it.
bigquery assets must to be a dataset in order to add them to a lake zone ? is it possible to add a bigquery table to a zone ? I wish to have a lake adding tables from different datasets
To the best of my knowledge, that isn't a supported permutation. When we add an "asset" to a zone, the unit of addition is either a dataset or a bucket. If a dataset, then ALL tables in the dataset become visible in the zone. I haven't seen any pattern where a table that exists in a dataset can be made known to a zone without ALL the corresponding tables in the dataset also being added.
So based on what I understood it's basically a service to centralize data lakes within large organizations and manage its metadata so that you can pass the data to everyone who actually needs it.
Wow data mesh pulls a lot of concepts from data vault. Interesting stuff.
hum... how is this approach different than building many more data silos after breaking down the data silos?
bigquery assets must to be a dataset in order to add them to a lake zone ? is it possible to add a bigquery table to a zone ? I wish to have a lake adding tables from different datasets
To the best of my knowledge, that isn't a supported permutation. When we add an "asset" to a zone, the unit of addition is either a dataset or a bucket. If a dataset, then ALL tables in the dataset become visible in the zone. I haven't seen any pattern where a table that exists in a dataset can be made known to a zone without ALL the corresponding tables in the dataset also being added.
Understand😢❤😂😮😊
Holy cow!
So many bookish words used....very difficult to understand at first 🤦♂