Відео

If you are facing the Error: No such command 'run' do: Still in the venv - cd <kedro directory> pip install -r requirements.txt After that the run command will work.

an example of how to get data from parallel workers and join that dat would have been great

kedro-wings last commit Jul 28, 2020, so basically dead

Would be great to have synchornization in the opposite direction and automatic notebook creation with all of the dependencies

this channel awesome! Thank you

That helped me a lot! Thank You!

How i can pass parameters from KEDRO CLI in catalog.yml?? Any reference to it would be helpful.

awesome!

can i have a codebase of this video ?

Is there any newer method to use structured streaming with Kedro? Do you have another suggestions?

What's the better it gives on comparison to prefect ?

Thanks for the video!

How can we developed an engine which determines which rules applied on given dataset automatically

To be able to make a full series on kedro while constantly smiling, your dealer must be lit! Hook me up please! (pun unintended)

How do we call async await func with kedro node?

Excelent tutorial, now I can get all the benefit of using parameters, modular pipelines, and viz. This has made a positive change in my workflow. In my work I complement with "kedro catalog create --pipeline name_pipeline" and everything flows very smooth. Thanks a lot for sharing!

Great video and great example of a custom command as often need to run multiple pipelines. Quick question how do you find the kedro_cli.py file? I've created a new kedro project but there's no file there like you've shown?

Great approach! What to do when your latest partition also needs historical partitions to calculate variables such as "total sales last 6 months" but prior partitions had their variables already computed?

Kedro seems to be full of compatibility issues. Better not to use such a tool.

Thanks for video. kedro 0.18.2 has no 'load_context' function in the class 'kedro.framework.context.context', what shall we do?

good high level explaination. Think things are broken with new versions. Need a updated tutorial.

is it possible kedro running every nodes/function in different environment (conda, pip, ,docker) in one pipelines?

I need some help with setting up and running kedro on aws EMR

will u pls help me to code Deployable REST Enabled Data Pipelines with Django, Kedro?

Traceback (most recent call last): File "C:\Users\sduque\.conda\envs\kedro-tutorial\lib\site-packages\kedro\framework\cli\cli.py", line 682, in load_entry_points entry_point_commands.append(entry_point.load()) File "C:\Users\sduque\.conda\envs\kedro-tutorial\lib\site-packages\pkg_resources\__init__.py", line 2458, in load return self.resolve() File "C:\Users\sduque\.conda\envs\kedro-tutorial\lib\site-packages\pkg_resources\__init__.py", line 2464, in resolve module = __import__(self.module_name, fromlist=['__name__'], level=0) File "C:\Users\sduque\.conda\envs\kedro-tutorial\lib\site-packages\kedro_viz\launchers\cli.py", line 8, in <module> from kedro.framework.cli.project import PARAMS_ARG_HELP ImportError: cannot import name 'PARAMS_ARG_HELP' from 'kedro.framework.cli.project' (C:\Users\sduque\.conda\envs\kedro-tutorial\lib\site-packages\kedro\framework\cli\project.py) Error: Loading global commands from kedro-viz = kedro_viz.launchers.cli:commands Help!

Great stuff

how to combine csv without pandas?)

Can we build a Redis + Celery backed queue runner?

Very useful! Just getting into Kedro. Excited to try this tomorrow :)

Thanks you for the tuto ! Have a question could share pls the documentation steps and i have a question: how to link the env with kedro using ssh connexion on pycharm ?

can u tell versions of kedro, python and kedro great used in this video please

great how happy und smiling you are all the time! thanks for the demo! 😀 Is it possible to save the raw data in two new tables? One in which only goes the success rows and one in which goes the failure rows? (So that the next ETL steps can run on a "validation_passed_table")

The Kedro documentation on their site is utter shit. Heck their "hello world" tutorial doesn't even work. They don't give examples on how to implement features....just really hard to get into it

You're the goat lmk if you need a job

Hi, Awesome video! If we are not going to use credentials.yml file in production, how are we going to access the required credentials?

Hey, Great videos, really enjoying it! I had a question. I tried using transcoding for the Byte64DataSet as well, but I found that I get the following error, kedro.pipeline.pipeline.OutputNotUniqueError: Output(s) ['iris_scatter_plot'] are returned by more than one nodes. Node outputs must be unique. I simply changed my catalog file to look like this, iris_scatter_plot@base64: type: iris.io.base64_data_set.Base64DataSet filepath: data/iris64.txt What exactly is the issue here?

Hi, great video, it's really a great series of tutorial videos on kedro, i'm rewatching a bunch of them whenever needed! So as i understand you have refactored one node , that you wrapped with a function that provides it with the datasets in the given dict and thus a new node is created. But let's say that i have a pipeline that has multiple nodes that does etl work on a txt file, and now i want to pass a bunch of txt files in a folder to the pipeline, is the only solution availlable to wrap all my nodes(or pure function python function) into one? Cause then in kedro-viz i would only see one node i.e. the one that is encompassing all the others.

cristal clear, thanks for that kind of video.

kedro is unable to save pyspark model. it says TypeError: cannot pickle '_thread.RLock' object. is there any method to save a pyspark model?

Hi, I'm working with Kedro but when I tried to visualize with kedro viz it is empty. In the PyCharm terminal, there is a warning saying that the catalog and parameters files are empty (which is not the case, both have yml files) Any idea why kedro viz can not see the yml files? Thanks!

Thank you so much for the tip by changing "script" to "module", was stuck at setting the run profile for a while and it works like a charm!

Best business description I have ever seen from data engineer!😍

Thank you for sharing! This is very useful. My team benefit from you a lot, by the way.

You have created great stuff. Thanks for all your efforts!! In entire video series I missed few advanced concepts like Kedro Plugins. Why don't you make video on creating kedro plugins?

This was a big help, thank you so much! And I love your energy!

Really great video! Thanks for taking the time to craft a very easy-to-follow demo, Tam!

Please don't say "KLI". It's called a "C" (letter C pronounced "see") "L" (letter L) "I" (pronounced "eye"). Thanks!

Kedro is interesting! well while creating a new project I don't see the option of asking for example pipeline why is that so ? could you please help me

Really enjoying your Kedro tutorials! Is the kedro-wings usage different in Kedro version 0.17.5? There is no `run.py` file.

What if you don’t want to save the table to sql? But instead want to save the metadata of the dataset in SQL, and store the dataframe itself on s3? (If it it is a large dataframe), similar to how one might save an image for a profile? This is important when you have multiple (timeseries) datasets you want to save.