Kestra
Kestra
  • 67
  • 69 066
Rollback Your Workflow with Revisions in Kestra | Concepts
Flows are versioned by default. Whenever you make any changes to your flows, a new revision is created. This allows you to rollback to a previous version of your flow if needed.
Read more about it in the docs: go.kestra.io/revisions
Like, and Subscribe for more quick guides on using Kestra!
0:00 - Introduction
0:17 - View Revisions
1:14 - Restore Revision
1:36 - View Full Revision
1:43 - Line by Line View
2:02 - Revisions with Replay
4:21 - Summary
----------
📖 Read the documentation: go.kestra.io/docs
⭐ Start your journey with Kestra: go.kestra.io/github
🚀 Join the Kestra Community: go.kestra.io/slack
For more information, visit Kestra's Website: go.kestra.io
Переглядів: 47

Відео

Manage Multiple Executions with Concurrency | Workflow Components
Переглядів 1129 годин тому
Control concurrent executions of a given flow. The flow level concurrency property allows you to control the number of concurrent executions of a given flow by setting the limit key. Read more about it in the docs: go.kestra.io/workflow-components/concurrency Like, and Subscribe for more quick guides on using Kestra! Timestamps 0:00 - Introduction 0:31 - Example 2:08 - Summary Read the documen...
Blueprints: Ready-to-use examples designed to kickstart your workflow in Kestra 🏗️
Переглядів 6514 годин тому
Blueprints are a curated, organized, and searchable catalog of ready-to-use examples designed to help you kickstart your workflow. View all the blueprints here 👉 go.kestra.io/blueprints-yt Like, and Subscribe for more quick guides on using Kestra! Read the documentation: go.kestra.io/docs ⭐ Start your journey with Kestra: go.kestra.io/github 🚀 Join the Kestra Community: go.kestra.io/slack For ...
Automate Batch Workloads on Google Cloud GKE with Kubernetes Task Runners in Kestra | How-to Guide
Переглядів 6216 годин тому
Run tasks on GKE with the Kubernetes Task Runner. This guide will walk you through how to configure Kubernetes Task Runners to use GKE directly inside of Kestra. Note: that after the launch of Task Runners in GA, some task runner plugins require a license. Check the Task Runner documentation for more details. 0:00 - Introduction 0:24 - Example overview 1:10 - Setup Cluster on Google Cloud 2:22 ...
Manage Server Costs with Timeout | Workflow Components
Переглядів 7121 годину тому
Timeout allows you to set a maximum duration for a task run. If the task run exceeds the specified duration, Kestra will automatically stop the task run and mark it as failed. This is useful for tasks that may hang and run indefinitely. Read more about it in the docs: kestra.io/docs/workflow-components/timeout Like, and Subscribe for more quick guides on using Kestra! Timestamps 0:00 - Introduc...
Run Batch Workloads with Kubernetes Task Runners in Kestra | How-to Guide
Переглядів 7721 годину тому
Run tasks in pods with the Kubernetes Task Runner. This guide will walk you through how to configure Kubernetes Task Runners directly inside of Kestra. Note: that after the launch of Task Runners in GA, some task runner plugins require a license. Check the Task Runner documentation for more details. 0:00 - Introduction 0:27 - Example overview 0:39 - Use kubectl to setup config 1:12 - Add config...
Run Jobs as a Process with Task Runners in Kestra | How-to Guide
Переглядів 104День тому
Run tasks as local processes with the Process Task Runner. This guide will walk you through how to configure it and use it inside of Kestra. Note: that after the launch of Task Runners in GA, some task runner plugins require a license. Check the Task Runner documentation for more details. 0:00 - Introduction 0:28 - Example 1:00 - Dependencies Example 1:34 - workingDir Example 2:21 - Summary Ful...
Fix and Rerun Failed Tasks with Kestra's Replay in 60 Seconds! 🔧
Переглядів 7714 днів тому
There's nothing worse than having a workflow nearly complete and fail due to one simple typo That's where Replay in Kestra comes in handy to solve this problem💡 Replay allows you to rerun individual tasks with updated code so you don't need to rerun the whole workflow. Especially useful when your workflow contains tasks that take a long time to complete! 🕙 Learn more about Replay here 👉 go.kes...
Run Jobs in Docker Containers with Task Runners in Kestra | How-to Guide
Переглядів 18814 днів тому
Run tasks in containers with the Docker Task Runner . This guide will walk you through how to configure Docker Task Runners directly inside of Kestra. Note: that after the launch of Task Runners in GA, some task runner plugins require a license. Check the Task Runner documentation for more details. 0:00 - Introduction 0:24 - Example 1:10 - workingDir Example 2:14 - Example with additional prope...
Automate your Workflows with Triggers | Workflow Components
Переглядів 13614 днів тому
Trigger is a mechanism that automates the execution of a flow. Triggers can be scheduled or event-based providing lots of flexibility in how you can automate the execution of your workflows. This video will walk you through how to use them in Kestra. Read more about it in the docs: go.kestra.io/workflow-components/triggers Like, and Subscribe for more quick guides on using Kestra! Timestamps 0:...
Run Batch Workloads on Google Cloud Run with Task Runners in Kestra | How-to Guide
Переглядів 5014 днів тому
Run tasks as containers on Google Cloud Run. This guide will walk you through how to configure Google Cloud Run and connect it to your task in Kestra. Note: that after the launch of Task Runners in GA, some task runner plugins require a license. Check the Task Runner documentation for more details. 0:00 - Introduction 0:31 - Create Project 0:46 - Enable Cloud Run Admin API 1:09 - Create Service...
Run Batch Workloads on Azure Batch with Task Runners in Kestra | How-to Guide
Переглядів 6414 днів тому
Run tasks as containers on Azure Batch VMs. This guide will walk you through how to configure Azure and connect it to your task in Kestra. Note: that after the launch of Task Runners in GA, some task runner plugins require a license. Check the Task Runner documentation for more details. 0:00 - Introduction 0:25 - Create Batch and Storage account 2:10 - Create pool 3:48 - Create container 4:34 -...
Install Kestra in 60 seconds! 🚀
Переглядів 30821 день тому
Want to get started with Kestra? Look no further! In 60 seconds, you'll have an instance of Kestra running on your machine! Installation Command: go.kestra.io/install Like, and Subscribe for more quick guides on using Kestra! Read the documentation: go.kestra.io/docs ⭐ Start your journey with Kestra: go.kestra.io/github 🚀 Join the Kestra Community: go.kestra.io/slack For more information, visi...
Run Batch Workloads on Google Batch with Task Runners in Kestra | How-to Guide
Переглядів 8321 день тому
Run tasks as containers on Google Cloud Batch VMs. This guide will walk you through how to configure Google Cloud and connect it to your task in Kestra. Note: that after the launch of Task Runners in GA, some task runner plugins require a license. Check the Task Runner documentation for more details. 0:00 - Introduction 0:28 - Create Project 0:58 - Enable Batch API 1:11 - Create Service Account...
Retry Failed Workflows with Retries | Workflow Components
Переглядів 11421 день тому
Retry Failed Workflows with Retries | Workflow Components
Run Batch Workloads on AWS Batch with Task Runners in Kestra | How-to Guide
Переглядів 8021 день тому
Run Batch Workloads on AWS Batch with Task Runners in Kestra | How-to Guide
Organize your Workflows with the new Namespaces View | Kestra Feature Showcase
Переглядів 10521 день тому
Organize your Workflows with the new Namespaces View | Kestra Feature Showcase
Make your Workflows Stateful with the KV Store | Kestra Feature Showcase
Переглядів 23021 день тому
Make your Workflows Stateful with the KV Store | Kestra Feature Showcase
Tasks Runners Now GA 🎉
Переглядів 38928 днів тому
Tasks Runners Now GA 🎉
Kestra 0.18 Release - What's New ⚡
Переглядів 2,1 тис.28 днів тому
Kestra 0.18 Release - What's New ⚡
Handle Errors in your Workflows | Workflow Components
Переглядів 245Місяць тому
Handle Errors in your Workflows | Workflow Components
Build Modular Flows with Subflows | Workflow Components
Переглядів 208Місяць тому
Build Modular Flows with Subflows | Workflow Components
Avoid repetition with Plugin Defaults | Workflow Components
Переглядів 120Місяць тому
Avoid repetition with Plugin Defaults | Workflow Components
Meet Kestra: The Unified Orchestration Platform for All Engineers ⚡️
Переглядів 4,4 тис.Місяць тому
Meet Kestra: The Unified Orchestration Platform for All Engineers ⚡️
Organize Your Workflows with Labels | Workflow Components
Переглядів 149Місяць тому
Organize Your Workflows with Labels | Workflow Components
Reuse values across your Workflows with Variables | Workflow Components
Переглядів 200Місяць тому
Reuse values across your Workflows with Variables | Workflow Components
Manage Executions for your Workflows | Workflow Components
Переглядів 332Місяць тому
Manage Executions for your Workflows | Workflow Components
Organize your Workflows with Namespaces | Workflow Components
Переглядів 230Місяць тому
Organize your Workflows with Namespaces | Workflow Components
Kestra - Fast, Scalable, Declarative Orchestrator: Product Overview (July 2024)
Переглядів 3,9 тис.2 місяці тому
Kestra - Fast, Scalable, Declarative Orchestrator: Product Overview (July 2024)
Install Kestra on Google Cloud in 15 minutes | How-to Guide
Переглядів 1442 місяці тому
Install Kestra on Google Cloud in 15 minutes | How-to Guide

КОМЕНТАРІ

  • @bx1537
    @bx1537 7 днів тому

    kestra making things quite more simple for us ...

  • @rafaelquintero2874
    @rafaelquintero2874 8 днів тому

    Awesome!!! 🙌

  • @smithsondmello
    @smithsondmello 10 днів тому

    Is replay feature a function of when the Job was created? As I understand, this Job execution metadata for the previous run might be cached somewhere; which could have a possible timeout. So, is this feature only available, if this code fix & re-run is to be tried in next few minutes(backoff time expiry) only?

    • @kestra-io
      @kestra-io 7 днів тому

      Replay works for any execution. Executions are stored forever unless you manually purge them so you can go back and use Replay whenever!

  • @otisrancko
    @otisrancko 15 днів тому

    Can Kestra build images programmatically with buildkit or dagger like Jenkins server???

    • @kestra-io
      @kestra-io 14 днів тому

      We have a dedicated Docker plugin allowing you to build and run images. Is this what you're after? kestra.io/plugins/plugin-docker/tasks/io.kestra.plugin.docker.build

    • @kestra-io
      @kestra-io 14 днів тому

      However, with our Shell task, you can set it up to do anything so there's loads of flexibility here. kestra.io/docs/developer-guide/scripts/custom-docker-image

  • @kuldipsatpute9866
    @kuldipsatpute9866 22 дні тому

    Can we use this with other repo providers like gitlab and bitbucket…

    • @kestra-io
      @kestra-io 21 день тому

      Yup this works with any sort of Git based platform! The method for authenticating might be slightly different though for each.

  • @garagix9746
    @garagix9746 29 днів тому

    Very Nice. Can't wait to update the current environment.

  • @mnejmantowicz
    @mnejmantowicz Місяць тому

    Hello. At timestamp you mentioned something like "if you have Kestra running locally you will want to use something like "engrot" to tunnel it to the web. Can you please elaborate on what "engort" is?

    • @kestra-io
      @kestra-io 27 днів тому

      ngrok is the tool! it allows you to take a localhost address and make it public - useful as we needed to make our Kestra instance publicly accessible to work with the GitHub webhook!

  • @IM-tu2ep
    @IM-tu2ep Місяць тому

    Hi, I have some problem regarding using webhook in workflow, I want to pass file in formdata and use that file to upload in google drive but in kestra trigger not have that option , please help me, how to handle file in webhook trigger

    • @kestra-io
      @kestra-io 24 дні тому

      This is a great question for our Slack community! kestra.io/slack

  • @pylotlight
    @pylotlight Місяць тому

    so n8n sort of but more code/template based..?

    • @kestra-io
      @kestra-io Місяць тому

      Similar for sure - With a good blend between defining everything as code or by using the UI!

  • @Meatwad1171
    @Meatwad1171 Місяць тому

    you should make multi-user support available on the open source version. without this support your product is incomplete

    • @afire007
      @afire007 Місяць тому

      have to agree, right now kestra is just not worth exploring. Not to mention the scale up architecture involves kafka and elastic which just makes it more tedious to manage at scale.

  • @jakobkristensen2390
    @jakobkristensen2390 Місяць тому

    Is this like a self hosted Zapier?

    • @kestra-io
      @kestra-io Місяць тому

      Similar but with the ability to define everything in YAML as well as the UI gives you more control over your workflows!

  • @jakobkristensen2390
    @jakobkristensen2390 Місяць тому

    Is it possible to take en entire Kestra condifuration, including all flow definitions etc. and export it to a file (sync it with a Git repo), similar to infrastructure as code?

    • @kestra-io
      @kestra-io Місяць тому

      Absolutely - we have a Git plugin that handles this. I'd recommend checking it out, as well as the tutorial videos!

  • @jakobkristensen2390
    @jakobkristensen2390 Місяць тому

    Is it possible to run python scripts from a git repository? Instead of editing it inside the GUI

    • @kestra-io
      @kestra-io Місяць тому

      Yup! You can sync files known as namespace files from a git repository and then use the Python Commands task to execute the file with a command.

  • @IM-tu2ep
    @IM-tu2ep Місяць тому

    hey i am facing problem with connecting to mysql databse id: mysqlll namespace: company.mysqlll tasks: - id: select_data type: io.kestra.plugin.jdbc.mysql.Query url: jdbc:mysql://localhost:3306/my_database username: root sql: | SELECT * FROM tbl_student store: true see it something is wrong and let me know (it doesnt have any password and all credentials are correct)

    • @kestra-io
      @kestra-io Місяць тому

      Hey there! If you're running it in docker, you might need to swap localhost to host.docker.internal so Kestra can see it

    • @IM-tu2ep
      @IM-tu2ep Місяць тому

      @@kestra-io thanks

  • @dkryptonut
    @dkryptonut Місяць тому

    Hi Will, are you able to direct me to the documentation where it shows how to run the docker compose file without root? As far as I can tell, the documentation only shows how to get it up and running using root. It has a comment saying that's for development only and to consult the documentation for how to run it as non-root but I can't find it for the life of me.

    • @kestra-io
      @kestra-io 27 днів тому

      This is a good question for our community channel! kestra.io/slack

  • @niccommander
    @niccommander 2 місяці тому

    Is "Sync" directional from the repo to kestra here? Or will it also automatically commit and push to the Repo on changes in Kestra?

    • @kestra-io
      @kestra-io 2 місяці тому

      We have a separate task called PushNamespaceFiles for committing and pushing back to the repo. This gives you the control which direction the sync goes. ua-cam.com/video/-bEnwR5t7VI/v-deo.html

    • @niccommander
      @niccommander 2 місяці тому

      @@kestra-io so the "sync" type, in your language, is a "pull" type in my language?

    • @kestra-io
      @kestra-io 2 місяці тому

      ​maybe... there's nothing in sync that prevents it from being unidirectional, you can have bidirectional sync by combining Push and Sync tasks

  • @dkryptonut
    @dkryptonut 2 місяці тому

    Nice! Is this an Enterprise / Hosted only feature, or is it also available in the Community Edition?

    • @kestra-io
      @kestra-io 2 місяці тому

      This is available in both Open Source and Enterprise!

  • @sandeepreddy3994
    @sandeepreddy3994 2 місяці тому

    Hello Will, Thank you very much for your knowledge , Really appreciate it…!! Would you mind helping us to know, how to connect windows server(using yaml code)in kestra and what are the requirements we should meet before connecting?

  • @julianorocha2280
    @julianorocha2280 2 місяці тому

    Very Nice, i'm learning the basics to try to use in a personal ML project. If possible, in next videos would be nice to use some visual indicator of mouse interaction, sometimes it is hard to keep track of what is happening.

    • @kestra-io
      @kestra-io 2 місяці тому

      Thanks for the idea!

  • @AussieBazzo
    @AussieBazzo 3 місяці тому

    Looks amazing, some more hard work and you'll take on the big names

  • @ashortrant
    @ashortrant 3 місяці тому

    hey i like the concept, but you need to improve the amount of space the interface that it uses, like a quarter of the screen is code, even in notoriously bad case like visual studio have more space for the code by default.

    • @kestra-io
      @kestra-io 3 місяці тому

      Thanks for the feedback! It's worth noting that Will had the page zoomed in a lot to make it easier to read. Normally, it would be much larger as you'd expect

  • @mohsinhassan88
    @mohsinhassan88 3 місяці тому

    In the outputFiles segment, how would i handle multiple files? My python script outputs multiple files with different names, which i would like to upload to s3 bucket. under documents of outputFiles, i just do see how to do that!

    • @kestra-io
      @kestra-io 2 місяці тому

      Any file that you save in your Python script will be available under `outputFiles`. You'll be able access them in later tasks by using `{{ workingDir }}`/(the name of your file), e.g. `{{ workingDir }}`/data.csv.

    • @mohsinhassan88
      @mohsinhassan88 2 місяці тому

      @@kestra-io thank you for your reply. All examples I see online and in documentation refer to the to be uploaded directly with a name. However in my use case I don't know the file name so how do I achieve that?

    • @kestra-io
      @kestra-io 2 місяці тому

      @@mohsinhassan88 your best bet is to join our slack at kestra.io/slack where our team can look into your use case in more detail to suggest the best action!

  • @nkofr
    @nkofr 3 місяці тому

    how does this compares to n8n?

  • @EjiroAsiuwhu
    @EjiroAsiuwhu 4 місяці тому

    The AI voice makes this cringe to watch

  • @RaulEduardoFloresNajera
    @RaulEduardoFloresNajera 4 місяці тому

    Excelent video i try to execute python in Kestra for networking automation use case

    • @kestra-io
      @kestra-io 4 місяці тому

      Nice! Would love to hear more about this!

  • @robosergTV
    @robosergTV 4 місяці тому

    did you by any chance chose a Half-Life logo for the "lambda" brick? :)

  • @GeorgeKer
    @GeorgeKer 4 місяці тому

    Great tut! I really prefer simple local kestra flows, to learn using it for everyday tasks ... and finally develop confidence on complex pipelines Please more beginner level python flows like this!

    • @kestra-io
      @kestra-io 4 місяці тому

      Glad to hear it! We'll definitely be producing more beginner friendly content soon! Stay tuned! 🚀

    • @robosergTV
      @robosergTV 4 місяці тому

      you might like Kedro, which is much more developed and has good funding

  • @sur0x
    @sur0x 5 місяців тому

    docker compose says that is not good to run as root and to search on how to run it without, can someone please let me know where is this doc ?

    • @kestra-io
      @kestra-io 5 місяців тому

      Here is the rootless Docker Compose version: github.com/kestra-io/kestra/blob/develop/docker-compose-dind.yml - it's not placed prominently as it's more advanced (and complex)

  • @medbahba6364
    @medbahba6364 5 місяців тому

    wow it's amazing demos. i think it s a real alternative to apache airflow. what do you think ?

  • @hamidrazavi1400
    @hamidrazavi1400 5 місяців тому

    Wow, that's awsome and interesting.

  • @rickr937
    @rickr937 5 місяців тому

    Can you show the same but for Azure, with terraform? :)

    • @kestra-io
      @kestra-io Місяць тому

      We'll bear that in mind for an upcoming video! :D

  • @danieljorge5481
    @danieljorge5481 5 місяців тому

    Hey man, thanks for the tutorial, but this is unwatchable. We can't see what is going on in the screen with this zoom so we form a complete picture in our heads and put things in context...

    • @kestra-io
      @kestra-io 5 місяців тому

      It's optimized for mobile. Thanks for your feedback!

    • @danieljorge5481
      @danieljorge5481 5 місяців тому

      @@kestra-io Hey man, thanks for replying, but it is really not optimized for mobile. The problem is not that. The problem is that there is "nothing" showing in the screen, so what you are showing is almost useless. (Just to be clear, it is not your content that is useless, it is awesome, it is just that the way it is, it might as well be a podcast instead of a video)

    • @tylerdurden4285
      @tylerdurden4285 5 місяців тому

      ​@@danieljorge5481something must be wrong with your phone. A very clear tutorial that needs no zoom on my phone. Best of luck figuring it out.

    • @kestra-io
      @kestra-io 20 днів тому

      @@danieljorge5481 appreciate the feedback, we'll do better for future videos!

  • @PavloKurochka
    @PavloKurochka 5 місяців тому

    How about a terraform script to do all this?

    • @kestra-io
      @kestra-io 5 місяців тому

      It's on the roadmap, stay tuned!

  • @FadilahRiczky
    @FadilahRiczky 5 місяців тому

    Awesome

  • @user-cz3tt4jq4f
    @user-cz3tt4jq4f 6 місяців тому

    This is so amazing

  • @nelsonatuonwu7547
    @nelsonatuonwu7547 6 місяців тому

    This looks awesome!!!

  • @gomespgp
    @gomespgp 7 місяців тому

    Great tutorial! Thanks for that! I plan to start using Kestra! Just the zoom in and zoom out all the time that annoyed me a little. I don't think you need to zoom 200%.

    • @dataslinger6379
      @dataslinger6379 7 місяців тому

      Thank you for the feedback. Always hard to know the right size so all the code will be clear. Will try to find the "sweet spot" and stick too it.

  • @SRiech
    @SRiech 7 місяців тому

    Great Job! Thanks for that…

  • @w0ode198
    @w0ode198 8 місяців тому

    I'm in two minds between Kestra and semaphore as I'm currently studying cloud operations. This is at the top of my list to put serious time into but I'm afraid to get hit with a big paywall later down the line.

    • @kestra-io
      @kestra-io 7 місяців тому

      Kestra is open-source github.com/kestra-io/kestra

  • @ersonusaini
    @ersonusaini 8 місяців тому

    ❤❤❤keep it

  • @w0ode198
    @w0ode198 8 місяців тому

    I can't wait to give this a go. This is on my Christmas time off list with a few others to play with during my holidays.

  • @lasaucissemasquee4421
    @lasaucissemasquee4421 8 місяців тому

    Yaay :)

  • @oskarlindberg4869
    @oskarlindberg4869 Рік тому

    great video!!

  • @juankvr96
    @juankvr96 Рік тому

    Really good video, very helpful