Data Pipeline Overview

Get our 158-page System Design PDF for free by subscribing to our weekly newsletter: bit.ly/bytebyt...
Animation tools: Adobe Illustrator and After Effects.
Checkout our bestselling System Design Interview books:
Volume 1: amzn.to/3Ou7gkd
Volume 2: amzn.to/3HqGozy
The digital version of System Design Interview books: bit.ly/3mlDSk9
ABOUT US:
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

[@meuk336]

First creator whose reels give clear picture of the topic.

[@AboZain-dt9gw]

True

[@tekboyz15]

can we get a full video about this please

[@cunty]

no

[@dip00007]

ua-cam.com/video/kGT4PcTEPP8/v-deo.htmlsi=d9p035lvnSYv3fYG

[@data_eng_tuts]

No

[@Jackovasaur]

Just read Designing Data Intensive Applications

[@Var_]

Maybe a short about MapReducs / Hadoop could be cool.

[@u_ziben]

Yes please

[@ingenieroriquelmecagardomo4067]

That's no longer used buddy

[@maddriven07]

@@ingenieroriquelmecagardomo4067 what's its alternative rn?

[@priyantha.buddhika]

@@maddriven07 Apache Spark / Databricks

[@Gauravop101]

There are many, Flink, Spark, BigQuery, Snowflake, etc​@@maddriven07

[@fabio.1]

Full blown course please

[@dip00007]

ua-cam.com/video/kGT4PcTEPP8/v-deo.htmlsi=d9p035lvnSYv3fYG

[@gxsuen5062]

Hi, Could you tell me about the flow chart tool used in the video, or how to make this kind of flow chart, thank you very much😊

[@ManendraG]

Did you get a tool which he is used for... Even I want to know that

[@MyGhostnote]

I am looking for the same answer too

[@yassinekhechane]

What tools do you use to design the diagrams plz ?

[@kicheko4980]

Looks like adobe(photoshop and illustrator)

[@СултанАбдрахманов-ц2ю]

Animation tools: Adobe Illustrator and After Effects.

[@AbsolutelyNOW]

woww this is excellent video to explain ETL activities in each phase.Thank you.Subscribing.

[@kaalmansur]

This is golden. Thank you! Would you be open to share/create a powerpoint slide with these steps and the diagrams?

[@julianandres4193]

Thanks subtitles you made me got it

[@AppySpaces]

really cool way of teaching

[@jamessound]

This is amazing and very helpful. Thank you!

[@aducaale328]

Full breakdown amazing 🙏🏽💯

[@felixinit]

Pipeline data Workflow. Great insight

[@namesurname6491]

So the last two steps are both Compute?

[@JustinLietz]

They involve compute yes, but this whole process involves computation. The migration of data from one store to another requires compute

[@JustinLietz]

The last one especially requires more compute if you’re using machine learning models to find insights

[@fordnightlg7300]

Full course would be big opportunity

[@chaitanyamuttanapalli3264]

on which tool this infographic is designed?

[@fabio.1]

@@chaitanyamuttanapalli3264 good question

[@davidlinares7070]

Great video! what software do you use for the visual graphics?

[@shitluna50kgonedogegogogo87]

Msft power bi, tableu are the most famous ones

[@raj4sap]

Great work, How do we draw these diagrams?

[@1000xdigital]

What software did you use to animate the video

[@muralikrishna9796]

Can you throw light on File based sources common data ingestion process using Hadoop

[@DangBrian-u2g]

Thanks, It's useful for me.

[@tjdgmlchl6305]

Do you have books you recommend on this topic? Thank you

[@mohamedsalimbensalem6118]

keep it up a ghassen

[@HazelLiz-nk3us]

Which tool have you used to create the presentation

[@limkangwei6339]

I am learning product management, and feature testing before full rollout is important to us. However, how do organization track "clicks" across their entire interface in such a high traffic environment?

[@connectingthedots5987]

Hi do you do training on tech ?

[@emanuel22223]

How did you do this kind of diagram ?

[@ManojKumar-DataHulk]

Great video, may i know which tool you have used to demonstrate the process pipeline here …

[@93hothead]

UA-cam itself is a database and we are the data

[@beefbakestasty2044]

Why two “compute”? Maybe it’s “visualization”😮

[@KarthickRao-q8h]

May i know the software been used here to generate the flow diagram?

[@KrishnaDasPC]

Where did you worked?

[@PrafullOnUTube]

Thanks You!

[@zeroburn4843]

Does this change for AI use cases ?

[@balogunjeremiah2664]

send link

[@timothymcglynn1935]

🎉

[@PR0-TUBER]

IS YOUR EYES NEVER BLINK? 😮😅

[@healthytips-s7v]

who is this guy

[@zimzimzim8722]

thats more for fortune 500 companies hehe

[@promethesured]

this is psychotic

[@mymechanicfriend6017]

✊🏾✔️📠

[@ThoughtSeer-keen]

Stop calling it data processing. It's just biasing and outdating

[@kaalmansur]

pls explain

[@eltonsolid]

\o/

[@conordaly5429]

Super insightful, but dog are you a real person or AI? Like why do you move like that? Why don’t you blink?

[@thkhan]

dint notice that before reading your comment. need to apply a AI model to find if its a real human or not :D

[@jo-fe9mb]

this is all buzzzword soup