- 155
- 52 637
Dagger
United States
Приєднався 12 лис 2021
Transform your Messy CI Scripts into Clean Code
What is Dagger?
Powerful, programmable open source CI/CD engine that runs your pipelines in containers - pre-push on your local machine and/or post-push in CI
This has several benefits:
- Instant local testing
- Portability: the same pipeline can run on your local machine, a CI runner, a dedicated server, or any container hosting service.
- Superior caching: every operation is cached by default, and caching works the same everywhere
- Compatibility with the Docker ecosystem: if it runs in a container, you can add it to your pipeline.
- Cross-language instrumentation: teams can use each other's tools without learning each other's language.
What is Dagger?
Powerful, programmable open source CI/CD engine that runs your pipelines in containers - pre-push on your local machine and/or post-push in CI
This has several benefits:
- Instant local testing
- Portability: the same pipeline can run on your local machine, a CI runner, a dedicated server, or any container hosting service.
- Superior caching: every operation is cached by default, and caching works the same everywhere
- Compatibility with the Docker ecosystem: if it runs in a container, you can add it to your pipeline.
- Cross-language instrumentation: teams can use each other's tools without learning each other's language.
Let's teach an AI to use Dagger
In this video, Solomon Hykes, co-founder of Dagger, embarks on an exciting experiment to teach an AI (specifically ChatGPT) how to use the Dagger Shell, a new, powerful, and intuitive way to interact with the Dagger CLI. Solomon walks through creating interactive pipelines, exploring Dagger modules, and demonstrating how the AI can run commands, fetch knowledge, and even self-correct by using the Dagger API. Along the way, he shows how Dagger can be used as an agent to enhance automation and improve developer workflows.
Have questions? Ask us on Discord! discord.com/invite/dagger-io
Have questions? Ask us on Discord! discord.com/invite/dagger-io
Переглядів: 161
Відео
How Civo + Dagger simplify Kubernetes and caching with Terraform
Переглядів 10221 день тому
Learn how Civo Cloud uses Terraform and Dagger to optimize pipelines, leveraging Civo Object Storage for caching and achieving cost-efficient scaling. Want to see the code? Check out the repo here: github.com/DMajrekar/civo-dagger-engine Want to learn more or have questions? Join us on discord.com/invite/dagger-io
How to Leverage a Remote Nvidia GPU On-Demand: Using Ollama, Fly.io, and Dagger
Переглядів 108Місяць тому
Sam demonstrates how to use NVIDIA GPUs in Dagger pipelines for efficient and cost-effective workloads. By deploying a Dagger engine on Fly.io with GPU support, Sam showcases running inference tasks on an NVIDIA GPU while keeping the setup secure via VPN and caching to optimize performance. The pipeline integrates GPU usage only when needed, allowing resources to be released immediately after u...
Dagger Engine Goes Virtual
Переглядів 154Місяць тому
Yanik from Puzzle ITC demonstrates how their team uses Dagger in their CI/CD infrastructure on Kubernetes with OpenShift. By hosting the Dagger engine on ephemeral virtual machines managed by KubeVirt, they achieve better scalability and isolation while integrating seamlessly with GitLab and ArgoCD. This setup simplifies upgrades, enhances resource management, and showcases Dagger's flexibility...
Avalonia Windows App Using Dagger
Переглядів 123Місяць тому
Patrick demonstrates how he uses Dagger to streamline development and CI/CD processes for a personal project-a DOTA helper application. The app integrates with the DOTA game to provide customizable timers and audio alerts, making gameplay more accessible for beginners. Patrick showcases how Dagger helps automate tasks such as license generation, version management, and building cross-platform ....
Dagger 0.14 Recap
Переглядів 178Місяць тому
Guillaume shares the highlights from our recent 0.14 release, including the Git credential helper for seamless corporate repo access, exit code APIs for flexible test handling, and OCI annotations for better container metadata management. Additional improvements, like host name isolation, faster caching, and optimized disk usage policies, ensure smoother performance for developers and teams. Mo...
How Ubisoft uses Dagger
Переглядів 423Місяць тому
Vincent and Thomas from Ubisoft demonstrate how they leverage Dagger to improve CI workflows for Unity projects and internal tools. They share practical examples of simplifying builds, managing Unity licenses, and testing backend services locally using containerized environments. Check out how Dagger is integrated into Ubisoft’s pipelines to boost efficiency and modularity. Want to learn more o...
Building a Secure and Local AI Code Interpreter with Dagger
Переглядів 111Місяць тому
Myles demos the new Python and SQL notebook tool Marimo, which heavily leverages Dagger. Marimo offers a reactive alternative to Jupyter with features like Python-native file formats, seamless tool integration, and secure code execution. Watch how he builds a chatbot, running Python scripts safely and leveraging WebAssembly for fast, browser-based computing. Want to learn more or have questions...
Git Credential Helpers for Seamless Private Module Access
Переглядів 60Місяць тому
With Dagger 0.14, working with private Git repositories just got easier! Dagger now supports Git’s native credential management system, known as “Git credential helpers,” straight out of the box. Whether you’re using Personal Access Tokens (PATs), Git Credential Manager, or other secure methods, Dagger enables effortless access to private modules with zero additional setup. In this demo, we’ll ...
Building an MLOps pipeline with Dagger and KitOps
Переглядів 167Місяць тому
Gorkem from Jozu demonstrates three Dagger modules tailored for AI and MLOps workflows. In this demo, you’ll see how to package AI/ML models into OCI-compliant registries, integrate with Hugging Face, and convert model formats for streamlined deployment. Learn practical techniques to simplify CI/CD pipelines and optimize model management with Dagger's capabilities. Want to learn more or have qu...
Getting Started With Dagger and Harness
Переглядів 1362 місяці тому
Getting Started With Dagger and Harness
Scaling GenAI Inference With GPU-Optimized VMs on Shadeform
Переглядів 1042 місяці тому
Scaling GenAI Inference With GPU-Optimized VMs on Shadeform
Deploying to Fly.io Using Dagger and Github
Переглядів 1752 місяці тому
Deploying to Fly.io Using Dagger and Github
PocketCI: End-to-End CI With No YAML in Sight
Переглядів 2132 місяці тому
PocketCI: End-to-End CI With No YAML in Sight
Meet devs where they are: Why IaC must be real code
Переглядів 3593 місяці тому
Meet devs where they are: Why IaC must be real code
Self Corrective Agentic Workflow Powered by Dagger
Переглядів 1,1 тис.3 місяці тому
Self Corrective Agentic Workflow Powered by Dagger
Solomon Hykes at the CNCF San Francisco Meetup - August 28th, 2024
Переглядів 2404 місяці тому
Solomon Hykes at the CNCF San Francisco Meetup - August 28th, 2024
Dagger 101 - Dagger Ahmedabad & GIFT City Meetup Recording
Переглядів 2234 місяці тому
Dagger 101 - Dagger Ahmedabad & GIFT City Meetup Recording
Dagger In Practice - Revolutionizing DevOps with Dagger (NodeJS/GitHub Actions example)
Переглядів 4964 місяці тому
Dagger In Practice - Revolutionizing DevOps with Dagger (NodeJS/GitHub Actions example)
Bootstrapping a Cloud Native Platform: Tackling Private Cloud Access
Переглядів 1534 місяці тому
Bootstrapping a Cloud Native Platform: Tackling Private Cloud Access
A Dagger Pipeline to Generate The Github Actions Pipelines That Call My Dagger Pipelines
Переглядів 3584 місяці тому
A Dagger Pipeline to Generate The Github Actions Pipelines That Call My Dagger Pipelines
Kubernetes Infinity Stones: Can Dagger Complete My Set?
Переглядів 2625 місяців тому
Kubernetes Infinity Stones: Can Dagger Complete My Set?
Simplify Host Input with Context Directory
Переглядів 1365 місяців тому
Simplify Host Input with Context Directory
Building the Future of CI/CD: Solomon Hykes at AIQCon 2024
Переглядів 4965 місяців тому
Building the Future of CI/CD: Solomon Hykes at AIQCon 2024
Introduction: Running Dagger Pipelines on Jenkins
Переглядів 6365 місяців тому
Introduction: Running Dagger Pipelines on Jenkins
I have no idea what this is demo'ing it goes completely off the rails.
that interactive feature is really good 👍
I like your approach specially the advanced CI: what you do is that you transform/parse the payload into a structure/object and then you can do "things" according to the structure and handle it as code. One question: do you know in typescript a library that would enable me to do the same thing in dagger ? (specially the `github.parseWebHook`...)
If I understand right, the caching is not related to terraform other than you use it to set up the cluster, the object store and the secrets, right?
Got the link to the video walk through?
More people in the call than UA-cam viewers
Did I see a "password: ubuntu"? :D
Can you share the code please?
Does that work and link to Java-SDK source as well?
This was super helpful! Thank you so much.
Neat! So far I haven't found GHA yaml using the dagger-for-github action to be overly complicated to warrant the extra code generation (at least for my minimal use case), but I am curious if the niceties shown here like the summary markdown and engine prewarming in a separate step can be integrated into the dagger-for-github action.
maybe add option to like module on daggerverse site? so that way you can also sort by number of likes
This seems like a terrible idea. CI/CD should be declarative. And it should be declarative for a reason.. Programmers cannot get "creative" and f**k shit up. Every time i see the imperative approach on CI/CD i tend to go "oh how junior are these kids then"... You really need to sit down a build for real "large" systems and then come back again and allowed to have a voice..
Currently you must glue yaml and scripts together. Seems easier to have it all in one language
@@chris_cann why would you glue other languages together with it? If you try to loop and make stuff dynamic in a pipeline you are doing it wrong and really setting your self up to chase rabbits down the black hole of insufferable errors.. We redploy about 11-18000 servers every 24 hours.. If one line of imperative code is found in that i will personally string that mf up outside as warning example..
If Solomon Hykes speaks...then we don't have to watch another video for the explanation 😊
this is amazing! I'd love to see a deep dive into customizing things. I'll stay tuned. thanks!
I believe this is useful. I daggerized my project and I thought there was a way to go all-in with Dagger and not have to write that yml file to invoke dagger. It would be awesome to write even the GitHub Actions' workflows in code.
Link to Slide Deck?
If I tell my boss that Im gonna keep the token alive for 15 mins after the workflow is done running, he will laugh on my face. Why would you not just use secrets and pass the creds that way? Its secure and simple and doesn’t require creating this OIDC mess. After working on Github Actions for the last 2 years, I can confidently say that its a very underwhelming and undercooked solution in its current state. It really needs some major breaking changes or some competition will take over with a better solution.
This accent is difficult to listen to.
use auto-generated cc
❤
Can the RAG consume structured and unsturured data . How is the embedding of structured data done. I read embeddings use wither KNN or ANN type of circles.
Dagger is pretty cool
Is it posible to interact and give some inpute to the pipeline on the run? For example I execute a terraform validate ,then pipeline should pause and I manualy check the tf changes. If everything is fine I like to resume the build and execute a terraform apply
There is no first-class way to pause a Dagger pipeline this way (yet!), but this is where it starts to play really nicely with Jenkins stages. For example you could use the input step to pause and wait for input www.jenkins.io/doc/pipeline/steps/pipeline-input-step/
Thank you. Very interesting. I would like to see how can I pass parameters from a result of a previous stage to another. Maybe in one stage I would like to grep informations from a Jira ticket and in the next stage I like tobwork with them.
Great question! There are a few ways to approach this. If you are taking the approach where you use Dagger to programatically express your pipeline, then this becomes simple because you have a variable hold the value of the JIRA API response that you pass along into another function that knows what to do with that value. If you want to split this up by Jenkins stage, it becomes a bit trickier but still possible through file artifacts for example. Please join us in Discord if you have any follow up questions, we've got a great community of folks that are exploring Dagger for various use cases and would love to see you there. discord.com/invite/dagger-io
Good job, do you also have a repo about the project that you can share?
How to use DinD along with testing containers using dagger?
This was an awesome update guys. Love the bit with the black text on the last slides, someone had fun trolling Solomon! 🤣
Awesome - will you share the example code?
how do I do something like a RUN apt-get update && apt-get install -y git this doesnt seem to work: .with_exec(["apt-get", "update", "&&", "apt-get", "install", "-y", "git"]) e.g. this is important to keep images slim
is it possible to update one deployment from a YAML file with multiple deployments?
great video, looking for updates on the java sdk, thank you for this demo.
watch from 7:25 to see new Capability by Ollama
Great replay of the night! ❤🚀
WOW Dynamic Dagger Compose with AI 🤯
*Promosm*
To the Dagger Noobs: This tutorial is helpful when you want to put together some Python code so that it can be available to other languages, using the "modules" approach.
Previous version in Nodejs was far better then the current version
You explain this so well. 🤩
It might help to make the font size larger.
Adding a logo to mugs and t-shirts is very easy using Photoshop.
Is it possible to improve a bit the quality of the uploaded videos? Not sure if just me but I can barely read anything in the shared screen :(
I went to find the blog post but couldn't.
Hello,Dear I hope you are well. I saw your UA-cam channel'Dagger Analytics". Your channel subscriber 684 and video 66. Your channel and video content are very good. Also, the thumbnail design is very attractive. But here are some problems: 1. SEO score is very low 2. No title - description - tags are SEO friendly 3. Not sharing on social media platforms and your UA-cam channel is a lot of trouble. As a result views, likes and subscribers are not increasing. Benefits of 100% SEO Score: 1/ Views will increase 2/ Likes will increase 3/ Customers will increase 4/ Viewing time will increase 5/ Business will increase 6/ Audience will increase. 7/ Sales will increase. So, if you want your channel to increase subscribers, views, likes and comments with proper video SEO, Google ads and monetization. It will be your right decision. Do you want to increase your SEO score? I am waiting for your response.
Nice ❤
Nice ❤❤❤
Nice ❤