Data Modeling - Why Data Engineers Need To Understand It - An Introduction To Data Engineering

Поділитися
Вставка
  • Опубліковано 20 гру 2024

КОМЕНТАРІ • 46

  • @SeattleDataGuy
    @SeattleDataGuy  Рік тому +2

    If you guys want to learn more about data engineering, then sign up for my newsletter here seattledataguy.substack.com/ or join the discord here discord.gg/2yRJq7Eg3k

  • @talin331
    @talin331 Рік тому +25

    would be awesome to see example of conceptual data modelling. There are tons of materials about logical and physical, but not about the conceptual. At the interviews people really like to ask how you are going to gather business requirements. Would be even better if you can record an interview-cracking video. I couldn't find anything decent on youtube for conceptual modelling.

  • @skarthik5459
    @skarthik5459 Рік тому +5

    Absolutely love your videos!!! Thanks for paving the way for millions of people to get their hands into data engineering and land a job. If I land any data engineering job, you definitely provided a major chunk of guidance !!

    • @SeattleDataGuy
      @SeattleDataGuy  Рік тому

      Glad I could help! Thank you for all your support!

  • @sanjayplays5010
    @sanjayplays5010 Рік тому +3

    Yessss very excited about your next video on data modelling. Seeing actual examples will be incredibly useful, especially things like when to use one big table vs kimball etc.

    • @SeattleDataGuy
      @SeattleDataGuy  Рік тому +2

      Yup! It'll be coming in the next one, probably in january

  • @ominhquanho3860
    @ominhquanho3860 Рік тому +4

    What is the difference between data modelling for data storage compared to data modeling as in applying ML models to data? Thank you so much

  • @jonathandeamer
    @jonathandeamer 11 місяців тому +1

    Looking forward to the follow-up videos to this! 👍🏻

    • @SeattleDataGuy
      @SeattleDataGuy  10 місяців тому

      thank you! I have got an intro to data warehousing in the works and then another one that i am going to try to film soon.

  • @DamsBuoyInUSA
    @DamsBuoyInUSA Рік тому +1

    This is the best explanation on the internet

  • @ripner111
    @ripner111 7 місяців тому +1

    thanks for solid intro. I found it very useful. I'd like to provide feedback in that studies have shown that all caps are more difficult to read so I'd recommend sentence case for your slides. Also, the yellow and black contrast on the slides is a little jarring but I love the content!

    • @SeattleDataGuy
      @SeattleDataGuy  5 місяців тому

      Thanks for watching, I have stopped using the yellow in black in my new videos

  • @Luchox5006
    @Luchox5006 10 місяців тому +1

    Excellent video. Where can I see the video of Joe that is mentioned?

    • @SeattleDataGuy
      @SeattleDataGuy  10 місяців тому

      the video should be here - ua-cam.com/video/g82HUtjTPMg/v-deo.html

  • @caraziegel7652
    @caraziegel7652 10 місяців тому

    serve data in a useable way - thats pretty much how i've always explained what i like to do. Doubt i'll ever manage to get into a data modeler role though

  • @fzrbigman
    @fzrbigman Рік тому +2

    great video, please talk about data modeling more

  • @awjenning
    @awjenning 3 місяці тому +1

    Excellent presentation!

  • @Ilyabugivugi
    @Ilyabugivugi Рік тому +1

    Benjamin, thank you for sharing these insights! This is an off-topic question but essential for me to - if I want to know more about data engineering/data modeling, what courses would you recommend? I am not a data person, these topics are becoming increasingly interesting to me, so I thought I could change my career

    • @marisharodriguez2995
      @marisharodriguez2995 2 місяці тому

      Did you ever get this question answered? I have the same question. :)

  • @PascalFriedrich-tv3gq
    @PascalFriedrich-tv3gq 3 місяці тому

    Great job! Thanks for the explanation

  • @rashshawn779
    @rashshawn779 10 місяців тому

    Imo, not all entities require to be extracted out as a table. Sometimes the business value is not there, even though the business folks might talk about it. The perfect model doesn't exist, that is why migration exists when changes happen.
    It is the products or the production process that generate the data, checking how the product and process work will reveal more than what the business folks might talk about. Just my 2 cents.

  • @gogyoo
    @gogyoo 5 місяців тому

    Are custom fields the equivalent of feature engineering in Data Analysis? Are they decided on the business side through requirements, or does the DE make the best guess and present their model to the business stakeholders, who then accept or reject them?

  • @Omer698
    @Omer698 Рік тому +1

    I know that data engineers have to learn python but how much python is utilized for data engineering? What I'm saying is, do I need to know python inside out or should i direct it as specific aspects used for data engineering

  • @avialexandru3071
    @avialexandru3071 10 місяців тому

    Do you recommend a tool to create diagrams for data models?

  • @emwingharekelvin8492
    @emwingharekelvin8492 7 місяців тому +1

    This is beautiful!!!!

  • @florianseurre5961
    @florianseurre5961 Рік тому +2

    Hi ! I’m a junior analytics engineer, and I’m building my first data warehouse. What’s your opinion about the books from Kimball “The data warehouse toolkit, 3rd edition” ?
    Is it good to understand the therocial part data modeling, or is it obsolete ?
    Thanks

    • @FunctionalOdyssey
      @FunctionalOdyssey Рік тому +5

      Data Engineering with Dbt: A Practical Guide to Building a Cloud-based, Pragmatic, and Dependable Data Platform with SQL

    • @florianseurre5961
      @florianseurre5961 Рік тому +1

      @@FunctionalOdyssey thanks ! I’ll look into it

  • @AngryWolf-sq5wx
    @AngryWolf-sq5wx 7 місяців тому +1

    Thanks for another fine video. But the yellow backgrounds just want to make my eyes explode!

    • @SeattleDataGuy
      @SeattleDataGuy  5 місяців тому

      I did recently stop with the yellow..

  • @allanmogley
    @allanmogley Рік тому

    SHare the tool you used to create the database tables visualization models

  • @eltoncarvalho9456
    @eltoncarvalho9456 11 місяців тому +1

    thank you

  • @marisharodriguez2995
    @marisharodriguez2995 2 місяці тому

    Do you have to be an engineer to work in data modeling? I am not an engineer but my brain organizes data in this way and I have experience with having to conceptualize how data is organized for efficient business queries. I think I'd be good at this with the proper training. I'm wondering how someone gets started in data modeling without a developer or tech background? Is that even possible?

  • @cloudpathshala5192
    @cloudpathshala5192 8 місяців тому +1

    Thanks for the nice information, if you could decrease your talking speed around 10% then it'll help more to non-native english speaking guys like me :)

  • @aidanthompson5053
    @aidanthompson5053 Рік тому

    8:46

  • @DANG3R0USS
    @DANG3R0USS 10 місяців тому

    lol things table. Is atoms table too far?

  • @kunhan4264
    @kunhan4264 11 місяців тому

    hard to understand