Scalefree
Scalefree
  • 154
  • 22 640
Bridging Domain Ownership and Data Products in Data Mesh Using Data Vault 2.0
Discover how the principles of Data Mesh and Data Vault 2.0 combine to revolutionize data management! Learn about domain ownership, treating data as a product, and federated governance, all while creating a self-service data platform that empowers teams and enhances usability. Perfect for businesses looking to scale their data ecosystems with decentralized control and high-quality data products.
Inside Modern Data Teams
Register now for the next session: scalefr.ee/modern-data
Ask your questions: scalefr.ee/modern-data-question
#DataMesh #DataVault2 #DataGovernance #DomainOwnership #DataAsAProduct #SelfServiceBI #DataManagement #DecentralizedData #DataProducts #BusinessIntelligence
Переглядів: 3

Відео

How to Tackle GDPR with Data Vault
Переглядів 177 годин тому
In our ongoing series, our CEO Michael Olschimke discusses a question from the audience: "I heard that Data Vault is a great solution when dealing with GDPR. Could you elaborate on this?" Michael talks about GDPR. Join the next live session: sfr.ee/friday Ask questions via sfr.ee/dvfriday Learn about Scalefree: www.scalefree.com Learn about Data Vault: scalefree.com/blog LinkedIn: sfr.ee/vdviLh...
How to Explain Data Vault to Business Users?
Переглядів 4616 годин тому
In our ongoing series, our CEO Michael Olschimke discusses a question from the audience: "How do you explain what a Data Vault does to someone who is not a data expert, but more a commercial executive?" Michael explains Data Vault to a commercial executive. Join the next live session: sfr.ee/friday Ask questions via sfr.ee/dvfriday Learn about Scalefree: www.scalefree.com Learn about Data Vault...
Creating Data Vault Stages with Coalesce
Переглядів 5921 день тому
Learn how to build and optimize Data Vault stages in this step-by-step guide! Discover the importance of stages in the Data Vault methodology, key features like hash keys, multi-batch processing, and how to streamline your workflow using Datavault4Coalesce. Perfect for data engineers and architects looking to master Data Vault techniques. Coalesce Transformation Talks Register now for the next ...
Tackle GDPR with Data Vault 2.0
Переглядів 7221 день тому
In our ongoing series, our BI Consultant Lorenz Kindling discusses a question from the audience: "Why use Data Vault 2.0 to Tackle GDPR?" Lorenz talks about GDPR. Join the next live session: sfr.ee/friday Ask questions via sfr.ee/dvfriday Learn about Scalefree: www.scalefree.com Learn about Data Vault: scalefree.com/blog LinkedIn: sfr.ee/vdviLh Twitter: ScalefreeCOM Call us: 49 (511...
Building Responsible AI Systems Under the EU AI Act
Переглядів 21221 день тому
Discover how the EU AI Act is transforming the way artificial intelligence is regulated across Europe. From risk-based approaches to responsible AI principles, this video covers the Act’s timeline, key compliance requirements, and the steps organizations can take to build ethical, transparent, and accountable AI systems. Stay ahead of the curve and learn how tools like AI Marts can help ensure ...
Using PIT and Bridge Tables in Business Vault Entities
Переглядів 6628 днів тому
In our ongoing series, our CEO Michael Olschimke discusses a question from the audience: "In the DV architecture, is it ok to use/re-use created PITS and BRIDGES in the code of the BV Business rules?" Michael talks about PIT and Bridge Tables. Join the next live session: sfr.ee/friday Ask questions via sfr.ee/dvfriday Learn about Scalefree: www.scalefree.com Learn about Data Vault: scalefree.co...
Semantic Models and Metrics on dbt
Переглядів 151Місяць тому
Discover how semantic models and metrics revolutionize data analytics by bridging the gap between raw data and actionable insights. Learn about their key components-entities, dimensions, and measures-and how they enable consistency and reusability across tools. Plus, explore dbt’s MetricFlow commands to streamline your analytics workflow. Master the foundation of the dbt Semantic Layer and unlo...
Maintaining the Hash Diff
Переглядів 49Місяць тому
In our ongoing series, our BI Consultant Julian Brunner discusses a question from the audience: "Our source system is delivering new columns for existing tables from time to time. When we add new columns to existing satellites we load new deltas for every business key in the next load, as the hash difference is now calculated differently. Is there a possibility to avoid the manual recalculation...
Working With Semi-structured Data on WhereScape
Переглядів 31Місяць тому
Learn how to effectively work with semi-structured data like JSON! Should you store it as-is or flatten its structure? Discover the pros, cons, and best practices for each approach, including tips on Data Vault modeling. Perfect for anyone navigating complex data structures, database performance, and scalability. Watch now to optimize your data workflows! WhereScape Expert Sessions Register now...
Delta Lake vs Data Vault
Переглядів 92Місяць тому
In our ongoing series, our CEO Michael Olschimke discusses a question from the audience: "How does Data Vault add value when we have the Delta Lake?" Michael talks about Delta Lake. Join the next live session: sfr.ee/friday Ask questions via sfr.ee/dvfriday Learn about Scalefree: www.scalefree.com Learn about Data Vault: scalefree.com/blog LinkedIn: sfr.ee/vdviLh Twitter: ScalefreeC...
Salesforce Account Engagement and Domain Management
Переглядів 90Місяць тому
Discover the essentials of domain management in Salesforce Account Engagement. This guide covers email sending domains, tracker domains, and tracking codes, highlighting how they improve email deliverability, security, and branding. Designed for Salesforce marketers and admins, this video provides actionable insights to optimize your email marketing strategy and enhance campaign performance. 00...
Custom Node Types in Coalesce
Переглядів 74Місяць тому
Discover the power of Custom Node Types in Coalesce! Learn how to create reusable, tailored database objects that fit your unique data workflows. We’ll break down the components-UI, DDL, and DML-and show you why custom node types are essential for flexibility and reusability in your data projects. Watch now to unlock your full data modeling potential! Coalesce Transformation Talks Register now ...
CDC, Status Tracking Satellite, and Delta Lake
Переглядів 71Місяць тому
In our ongoing series, our Managing Consultant Marc Winkelmann discusses a question from the audience: "1. Some time ago, my question ‘Loading CDC Data into Multi-Active Satellites and Status Tracking Satellites’ was handled in Data Vault on Friday by Marc Winkelmann. However, the second part related to Status Tracking was not covered. Could you please handle this part? At the moment, I only se...
Expanding Agile Practices and Embracing Data Governance
Переглядів 145Місяць тому
In this video, we explore why evolving agile practices and adopting Data Mesh are essential for staying competitive. Learn how frameworks like Disciplined Agile enhance workflows and how data governance strategies, including domain ownership and federated governance, foster agility and compliance. Discover the impact of standardized DevOps, data catalogues, and automation on creating a robust d...
The Need for a Data Warehouse
Переглядів 65Місяць тому
The Need for a Data Warehouse
Snapshots in dbt
Переглядів 1482 місяці тому
Snapshots in dbt
Federate Multiple Sets of Non-Historized Data
Переглядів 442 місяці тому
Federate Multiple Sets of Non-Historized Data
Non-Historized Links and Their Satellites
Переглядів 812 місяці тому
Non-Historized Links and Their Satellites
Building and Running an Agile Data Warehouse
Переглядів 382 місяці тому
Building and Running an Agile Data Warehouse
From Zero to Data Vault 2.0
Переглядів 712 місяці тому
From Zero to Data Vault 2.0
Combining Data Fabric and Data Mesh
Переглядів 542 місяці тому
Combining Data Fabric and Data Mesh
Use Generative AI to Assist in DV 2 Implementation
Переглядів 872 місяці тому
Use Generative AI to Assist in DV 2 Implementation
SQL with LLMs: Chat With Your Data
Переглядів 372 місяці тому
SQL with LLMs: Chat With Your Data
Data Mesh Governance
Переглядів 742 місяці тому
Data Mesh Governance
AI Based Knowledge Management
Переглядів 452 місяці тому
AI Based Knowledge Management
Data Mesh and Semantic Layer
Переглядів 1022 місяці тому
Data Mesh and Semantic Layer
Evolve To an AI-Driven Business
Переглядів 352 місяці тому
Evolve To an AI-Driven Business
Data Vault Journey in the Financial Sector
Переглядів 392 місяці тому
Data Vault Journey in the Financial Sector
Identifying Non-Historized Links
Переглядів 662 місяці тому
Identifying Non-Historized Links

КОМЕНТАРІ

  • @MandiLiou
    @MandiLiou 3 години тому

    Thanks for the breakdown! A bit off-topic, but I wanted to ask: I have a SafePal wallet with USDT, and I have the seed phrase. (air carpet target dish off jeans toilet sweet piano spoil fruit essay). What's the best way to send them to Binance?

  • @WoshimMia-i1o
    @WoshimMia-i1o 3 години тому

    Don't you want your channel to grow bigger?Don't you want your video to come to the top of UA-cam's search results so that your video gets more views?Don't you want to follow a method where your channel will be known all over the world?Don't you want this small channel of yours to be known in front of everyone?

  • @Pixelements
    @Pixelements 4 дні тому

    The link does not work, any idea where i can read the article? Since we are developing datavault on databricks.. thanks!

  • @charlotteogtorbenlucking9438
    @charlotteogtorbenlucking9438 8 днів тому

    Øjvind AI

  • @АртёмМеркулов-ю3к
    @АртёмМеркулов-ю3к Місяць тому

    Thank you so much for this video!

    • @scalefreeCOM
      @scalefreeCOM Місяць тому

      Thank you! Subscribe for more videos like this one...

  • @mattiasthalen
    @mattiasthalen Місяць тому

    Satellite views sound like a perfect topic for a blog ☺️ I’m playing with data vault in a dbt project, and build it on top of snapshots, because I don’t want to lose data and I’m afraid of doing something wrong 😂

    • @scalefreeCOM
      @scalefreeCOM Місяць тому

      Hi Mattias, I can understand your concerns, doing the right thing requires knowledge and proper tools. You can check some blog articles on our website www.scalefree.com/?s=Satellite

  • @hammadsaeedlodhi
    @hammadsaeedlodhi Місяць тому

    Excellent. Can you pleaseupload more videos on MuleSoft integration with Salesforce

    • @scalefreeCOM
      @scalefreeCOM Місяць тому

      Thank you! We will be publishing more Salesforce videos soon, and MuleSoft will definitively be one of the topics.

  • @gilespanaceas7014
    @gilespanaceas7014 2 місяці тому

    It would illustrate your point much better if you include a small Data Model of what you are describing.

    • @scalefreeCOM
      @scalefreeCOM Місяць тому

      Hi, thanks for your suggestion. We will take that into consideration.

  • @navneetsajwan765
    @navneetsajwan765 2 місяці тому

    Why do we need hashkey if we have businesskey?

  • @SartreBaby
    @SartreBaby 2 місяці тому

    I want to join eliminate

  • @SartreBaby
    @SartreBaby 2 місяці тому

    I want to join eliminate

  • @boseashish
    @boseashish 3 місяці тому

    are you going to keep all the fact aggregates in the bridge table?

  • @MalikahFreydel
    @MalikahFreydel 3 місяці тому

    Thanks for the analysis! 🔍 I’ve got a question: 🤨 I only have these words 🤔. (behave today finger ski upon boy assault summer exhaust beauty stereo over). I don't know what they are. What should I do with them? 🤷‍♀️

  • @benim1917
    @benim1917 4 місяці тому

    Thanks for this valued video. What do you think if I rather build my satellite with the below columns: Customer_address, LDTS, Address_1, Address_2, City - Address_1 will store type HOME - Address_2 will store type WORK We will have 1 record

    • @scalefreeCOM
      @scalefreeCOM Місяць тому

      Thanks Benin! Yes, possible. Just be careful of future types. You have to create additional Satellites then as well.

  • @nimitsavant3127
    @nimitsavant3127 4 місяці тому

    So by shift left here you mean to keep security checks and CI in pipeline to check what is happening, and these checks are responsible for bad code to not go forward.

    • @scalefreeCOM
      @scalefreeCOM 4 місяці тому

      Yes, exactly. 'Shift Left' in this context means moving testing to an earlier stage of software development. This can involve various types of testing, such as functional tests to ensure the code works correctly, security tests to identify vulnerabilities, or quality tests to ensure the code follows best practices. When the tests are properly configured for the specific use case, they should catch 'bad code' before it gets released and causes further problems.

  • @afrazsalim1748
    @afrazsalim1748 5 місяців тому

    Need communication skills.

  • @morozandaniel
    @morozandaniel 7 місяців тому

    Thank you for the recording! Sorry that I was not able to attend the meeting on Friday. Very well explained, I hope this will help my case on the model discussion that we had in the project. 🤞 Thank you! Daniel

    • @scalefreeCOM
      @scalefreeCOM Місяць тому

      Thank you so much Daniel! We hope to see you more often.

  • @makkaronifreunddernudel1266
    @makkaronifreunddernudel1266 7 місяців тому

    Of course there are different ways to model exchange rates. When using OLAP cubes you could create two fact tables for exchange rates (one for base line currency the other for reporting currency) and an MDX script which is triggered at that moment when the user is selecting the wanted reporting currency. I mean you could do that stuff inside the information mart layer. That means there is no need to do that inside the raw data vault layer. I think it depends from the busines requests what is the better way to model exchange rates. Because you are the Data Vault specialist you are doing it that way but please consider that there might be other ways!

    • @scalefreeCOM
      @scalefreeCOM Місяць тому

      Hi, thanks for your comment. Yes, there are different ways, and we talk about them on other videos. Nevertheless we will take your suggestion into consideration.

  • @fishsauce7497
    @fishsauce7497 9 місяців тому

    I agree that most used descriptive header level attributes can be kept in HUB or LINKS and need not be modelled in satellites, but then consider a case where you have different channels of sales, then in such case it makes sens to have satellite as per source, whilst HUB can be single. So if it's a single channel of sales it makes sense to have the header level info fused in HUBs but in case of different channel it makes sense to have them seperate (offerring agility and book of record in case of change to channel or decomissioning of channel or addition of channel). What are your thoughts on that please?

  • @menthalbreed
    @menthalbreed 9 місяців тому

    I want to point out that Oracle Big Data SQL has a feature to directly load messages from kafka directly, without unloading them to a Data Lake first. Google: Query Kafka using Oracle SQL Access to Kafka (OSaK)

  • @savaskulah7807
    @savaskulah7807 10 місяців тому

    good explanation, thanks!

  • @savaskulah7807
    @savaskulah7807 11 місяців тому

    nice explanation.

  • @MrRanoren
    @MrRanoren 11 місяців тому

    didnt understand anything said.. such poor quality and leaves the watcher in hiding...

  • @MrRanoren
    @MrRanoren 11 місяців тому

    its really impossible to understand what you speak about without any visual. or maybe its me who does not know much about anything

    • @pasupathydevaraj9671
      @pasupathydevaraj9671 11 місяців тому

      I actually felt the same ! I couldn't make much of it either !

  • @mobime6682
    @mobime6682 Рік тому

    Thanks for approaching this important question! Materialised views certainly sounds like an interesting approach, although Databricks would probably claim that Lakehouse doesn't need it (not sure why!). A follow up video would be an concrete example. BTW, the link does not work.

  • @ralfvaessen2792
    @ralfvaessen2792 Рік тому

    Nice video. I guess a small error in the coalesce functions being displayed: should be coalesce(MD5(BK1),'32x1') instead of coalesce(BK1,32x1). Right?

  • @nataliejudt7001
    @nataliejudt7001 Рік тому

    'Promosm' 🙋

  • @nikunj150188
    @nikunj150188 2 роки тому

    Thank you for sharing! Very useful

  • @nikunj150188
    @nikunj150188 2 роки тому

    I have a similar problem at hand and this gave me an idea I have a hub for which i am getting event data. Tried to model it as a non historized link but there js no other hub that i can put in this non historized link. I was worried if its the right approach as a link always have atleast two hubs. I heard Michael say there can be one hub in a non historized links in some cases. Thanks for a reassurance.

  • @errolloldham9995
    @errolloldham9995 2 роки тому

    🤪 [̲̅p][̲̅r][̲̅o][̲̅m][̲̅o][̲̅s][̲̅m]