Data Pipelines Explained

Поділитися
Вставка
  • Опубліковано 15 чер 2022
  • Learn more about Data Pipelines → ibm.biz/BdPEPM
    Data is a lot like water; it often needs to be refined as it travels between a source and its final destination. That’s where data pipelines come in - they merge, filter, and summarize raw data, providing the end user with a clean product to analyze. Luv Aggarwal, a Data Solution Engineer at IBM, explains how several processes often embedded within data pipelines - like ETL, replication, virtualization, machine learning, and batch processing - help generate actionable business intelligence.
    Get started with IBM Cloud free of charge → ibm.biz/BdPEPS
    Subscribe to see more videos like this in the future → ibm.biz/subscribe-now
    #Data #DataPipelines #DataAnalyses #DataIntegration #BusinessIntelligence #ETL

КОМЕНТАРІ • 59

  • @Geeee33
    @Geeee33 Рік тому +36

    Now that's one of the best explanations with the simplest examples for data pipelines! Thank you

  • @vishalk02
    @vishalk02 2 роки тому +8

    Explained simply & effectively. I would like to see more elaborate content on big data & data science fields.

  • @emrepiristine7967
    @emrepiristine7967 11 місяців тому +1

    Thank you very much, it was the most explanatory and beautifully explained video I've ever watched.

  • @balakrishnanr7149
    @balakrishnanr7149 Рік тому +3

    Very precise explanations with simple examples. 👏👏👏

  • @victorgromov1548
    @victorgromov1548 Рік тому +4

    Great explanation with easy to follow examples!

  • @saikiranmahajan5981
    @saikiranmahajan5981 Рік тому +1

    Awesome Luv! You made it simple for the Sales guys.

  • @well9851
    @well9851 Рік тому +2

    Greatly explained. Easy to understand and clearly.

  • @peterluo1776
    @peterluo1776 Рік тому +1

    This is some good work.
    Well done.
    Thanks for sharing 👍

  • @Manav-zo9bn
    @Manav-zo9bn Рік тому +2

    such a Quality content . Very well explained

  • @ChanceMinus
    @ChanceMinus Рік тому +1

    Thank you. Extremely helpful.

  • @alexpishvanov736
    @alexpishvanov736 2 роки тому +40

    I think, Data Virtualization would be a great topic for the next educational video from this instructor.

    • @carsonmasterson
      @carsonmasterson 2 роки тому

      Hey Alex -- check this out: ua-cam.com/video/2XB4UaBIvNI/v-deo.html

    • @1apocalyps
      @1apocalyps Рік тому +1

      Yes I agree. When I hear virtualization, I get locked into is it based off data models, Is it "place holder data"? I'm assuming we have no information about the data without the transformations

  • @harshalh3513
    @harshalh3513 Рік тому +1

    Greatly explained , would be more great if you could explain a few more processes to build pipelines in a breif

  • @LeonidAndrianov
    @LeonidAndrianov Рік тому +1

    Nice analogy and explanation!

  • @Flankymanga
    @Flankymanga 2 роки тому +20

    I would like to know how the Data Virtualization works. At first i thought that it is just "faking" a real data source in order to test data pipeline configuration?

  • @keviin077
    @keviin077 Рік тому +1

    Thanks for the amazing explanation

  • @hasanmougharbel8030
    @hasanmougharbel8030 Рік тому +3

    Hey dear, god bless your efforts in this channel.
    I have a general enquiry as a new sql learner.
    How could i create a pipeline to extract and load data from existing accounting program into our SQL server instances.
    How can i know if the export mechanism in the software permits me to undertake this extraction process, and how can i know if an application have an api?
    Thanks for taking care of my enquires.
    Looking forward to gain more knowledge from you

  • @davidallyn1818
    @davidallyn1818 6 місяців тому

    Beautiful tutorial!!

  • @obiradaniel7391
    @obiradaniel7391 2 роки тому +16

    Nice video, just when you think you have heard it all, here comes "Data Virtualization". If possible that could be elaborated more.

    • @kikitauer
      @kikitauer 2 роки тому +8

      My company uses data virtualization when rendering a final picture from our car configurator. It doesn't physically download the pictures, it just calls for the chosen color, wheels, accessories interiors etc and caches them - stores them in the temporary storage.

    • @pritamdaware9674
      @pritamdaware9674 Рік тому

      Does this technology use all automobile industry?

  • @surabhijagadish5210
    @surabhijagadish5210 Місяць тому

    Awesome explaination.

  • @suck-myballs1152
    @suck-myballs1152 Місяць тому +1

    I love these IBM videos. No organizations simplifies things the way they do.

  • @user-uh6vk2zl1k
    @user-uh6vk2zl1k Рік тому +1

    This is excellent!

  • @msbthedataengineer
    @msbthedataengineer 2 роки тому +1

    Good Explanation!!.....

  • @alaad1009
    @alaad1009 9 місяців тому

    Excellent analogy

  • @Trendykid
    @Trendykid 11 місяців тому

    Cant wait for data virtualization video.

  • @aniruddhabhosale6715
    @aniruddhabhosale6715 5 місяців тому

    Explained really well
    .👊🔥💖✨💯

  • @uwalakab
    @uwalakab 2 роки тому +3

    Great analogy. 👍🏿👍🏿👍🏿

  • @f-alzahraa_Ahmed
    @f-alzahraa_Ahmed Рік тому

    thanks, realy usful

  • @Eyenn_n
    @Eyenn_n Рік тому

    Awesome video!

  • @chuachua-hj9zd
    @chuachua-hj9zd 8 місяців тому

    Very good example quote using examples

  • @claudiusdsouza2379
    @claudiusdsouza2379 Рік тому +1

    well explained

  • @babasahebmane3473
    @babasahebmane3473 Рік тому

    Well explained

  • @explorertribe
    @explorertribe Рік тому +1

    Data virtualization is something looks interesting

  • @evanshlom1
    @evanshlom1 2 роки тому +2

    I WILL IMPLEMENT STREAMING MACHINE LEARNING AT WORK VERY SOON

  • @pudgewars6447
    @pudgewars6447 2 роки тому +3

    I would like to know how does your screen board work? Are you writing iin inverted xd?

    • @Lilwar195
      @Lilwar195 2 роки тому +6

      I believe they are writing normally but the video is inverted post production

    • @Tordekh
      @Tordekh 4 місяці тому

      ua-cam.com/video/wCOuu0-o5YI/v-deo.html Lightboard videos

  • @dxwallace55
    @dxwallace55 29 днів тому

    Off topic, but how are you typing backwards/reverse?

  • @Helloimtheshiieet
    @Helloimtheshiieet 9 місяців тому

    In a roundabout way this is why ERP systems are so popular

  • @vansf3433
    @vansf3433 Рік тому

    Your l English language is ambiguous because streaming data and transforming data are 2 different process. Streaming data is to make it concise or compacted, while transforming data can be changing it into another form to make it suitable for a certain purpose

  • @splashoui3760
    @splashoui3760 8 місяців тому

    How this kind of videos are made? Typing to the screen and it shows up on camera? What is the tech behind this?

  • @faisalk.7520
    @faisalk.7520 Рік тому +1

    How was this video made? How are the words not backwards lmao. This is crazy

  • @user-xx1sw1dj9o
    @user-xx1sw1dj9o 8 місяців тому

    yooo i just relaized this man just wrote all those letters and words backwards so we can see it normally....... right ? or is this some camera trick

  • @rohannair4039
    @rohannair4039 6 місяців тому

    how is he writing in reverse

  • @ScriptureFirst
    @ScriptureFirst Рік тому +1

    Whiteboards suck. Spring for the full blown motion graphic. Too slow (even at 2x) didn’t finish

  • @samwelemmanuel7976
    @samwelemmanuel7976 7 місяців тому

    My only question is why do they always ask lefties to do these videos?

    • @IBMTechnology
      @IBMTechnology  7 місяців тому

      See ibm.biz/write-backwards --they're actually righties.

  • @dharanik7530
    @dharanik7530 9 місяців тому

    worst experience guy

  • @vansf3433
    @vansf3433 Рік тому

    Your explaining chart is nonsense because you do not need to clean water from a lake or river for agricultural activities

    • @temitopekade590
      @temitopekade590 Місяць тому +1

      Appreciate efforts. This explanation is basic and it does not mean there are no other use cases like the agriculture you mentioned. He is talking obout end use of water in this case. Majority of us understood this. Be more positive!