This is a great question. Airflow and Luigi are more like pipeline schedulers (pipeline runners), and are really good at coordinating the running of pipelines and individual nodes. Kedro is more like a framework that allows you to Write those pipelines and Write those nodes.
Best business description I have ever seen from data engineer!😍
Discuss this video at kedro.community: discourse.kedro.community/t/what-is-kedro-why-is-it-useful-a-non-technical-intro-to-kedro/167
cristal clear, thanks for that kind of video.
I need some help with setting up and running kedro on aws EMR
can anyone help?
Is kedro similar to apache airflow or Luigi
This is a great question. Airflow and Luigi are more like pipeline schedulers (pipeline runners), and are really good at coordinating the running of pipelines and individual nodes. Kedro is more like a framework that allows you to Write those pipelines and Write those nodes.
@@DataEngineerOne Can you make a video about Kedro-airflow please?
At last ! Despite all the videos I still don't understand what it is...
Hahaha. Please let me know if I can clarify anything.