Netflix Data Engineering Tech Talks - Building Reliable Data Pipelines

Holden Karau, OSS Engineer, Data Platform Engineering, talks about the importance of reliable data pipelines and how to build them covering tools from testing to validation and auditing. The talk uses Apache Spark as an example, but the concepts generalize regardless of your specific tools.
Some related projects include:
github.com/hol...
github.com/uni...
github.com/tar...
and
github.com/ten....
#netflix
#datascience
#dataengineering
#etl
#bigdata

[@aditya_pawar]

Wow, Must see video for every reliable data engineer!

[@rembautimes8808]

Quite interesting that a survey was performed so that the points were grounded by data

[@ritaokonkwo]

So insightful. Thanks!

[@TamilSelvanSS]

Straight up talk 👏

[@jonassteinberg3779]

"my ducatti is current broken again" lollll

[@grawss]

Wtf is this guy wearing?

[@jonassteinberg3779]

doesn't really matter tbh