Why Agent Frameworks Will Fail (and what to use instead)

Поділитися
Вставка
  • Опубліковано 20 лис 2024

КОМЕНТАРІ • 217

  • @LeonardoAmigoni
    @LeonardoAmigoni 2 місяці тому +30

    I have been building business processes for 20 years. This is the way!

    • @daveebbelaar
      @daveebbelaar  2 місяці тому +3

      I've been getting a lot of mixed comments on this video (I know the title is a little triggering, but hey, that's how UA-cam works). I'm glad I'm not the only one that thinks this is the right approach.

    • @alexjenkins8026
      @alexjenkins8026 2 місяці тому +6

      No1 said you had to setup an Agent Team as a dynamic randomized flow... you can have agents pass variables down the line... the best part is, it doesn't have to fit neatly into a pydantic model with error handling everywhere... if the previous agent just blobs back a full text instead of a dict - the next agent can still get the info it needs and make it work.
      Handling nulls, errors, variations, if/else logic, retries and structured input/output is what agents do away with.

    • @jonbrown7962
      @jonbrown7962 Місяць тому

      This is 100% the future of AI apps. I do think there should be a framework around this idea. Has anyone seen one?

    • @prozacsf84
      @prozacsf84 29 днів тому

      You have a new sub, Sir, I agree, this is the way not swarm

    • @quietmoney1232
      @quietmoney1232 5 днів тому

      @@daveebbelaar too bad you don't know what you're talking about. The purpose of AI agents is NOT data pipelines or automation. Agent frameworks are precisely designed for work that is not predictable and can NOT be put into a DAG. If the idea can be put in a data pipeline, then don't use an agent framework at all, its overcomplicated for no reason.

  • @maheshagodekere
    @maheshagodekere 3 місяці тому +82

    Use an AI agentic framework when dealing with complex, non-linear tasks with unpredictable workflows that require dynamic decision-making and flexibility. Use traditional pipelines when dealing with linear, predictable processes that demand consistency, precise control, and efficiency.

    • @procrastinationbusters107
      @procrastinationbusters107 2 місяці тому +2

      can you please a few examples?

    • @jindrichsirucek
      @jindrichsirucek 2 місяці тому

      Top!!🎉

    • @Inceptionxg
      @Inceptionxg Місяць тому

      Hi, we thought to build a platform for AI agents. So I would like to ask you, do you think there are real use cases for AI agents??? What are the technical challenges that will be there if we are creating thousands of them???

  • @istvandarvas3372
    @istvandarvas3372 4 місяці тому +60

    I mostly agree with everything. But there are two kinds of pipelines. The first one is when you have a finite amount of transformations, and the second one is when you don't know all the transformations in advance and need to delegate decision-making (in this case, you need an agentic approach). However, every pipeline can be represented as a finite transformation when you know it. for example classification. and t
    that is the key. So, if your pipeline is research-like, then you can't know it in advance; in other cases, you can.

    • @matterhart
      @matterhart 4 місяці тому +3

      I like this distinction. I build UI heavy pipelines with a lot of human input where there's a ton of variability/decision-making in both the E and the T, and only the L is known in advance.

    • @daveebbelaar
      @daveebbelaar  4 місяці тому +6

      Good point. In those cases, agentic workflows make perfect sense.

    • @ShpanMan
      @ShpanMan 4 місяці тому +4

      @@daveebbelaar So you admit your title is extremely silly.

    • @kartPatrol
      @kartPatrol 4 місяці тому

      I completely agree with your viewpoint. The whole point of these frameworks are to get LLMs to perform such abstract tasks which we have no predefined idea about. There should be data pipelines that satisfy the needs other than that and that is obvious - If you don't need the computation power of LLMs why use them?

    • @m4rtin419
      @m4rtin419 3 місяці тому +2

      This is a great distinction. I am wondering though if we really have use cases for the second type at the Moment? In other words, I have the impression that agentic approaches are mostly used for problems that don’t need agentic approach and can be solved much simpler.

  • @michaelirey
    @michaelirey 4 місяці тому +90

    While your critique of agent frameworks is spot on and compelling, it seems there's a misconception about their potential. Your custom system resembles langchain+langgraph, highlighting a need for deeper understanding before dismissing existing frameworks.

    • @imacuser101
      @imacuser101 4 місяці тому

      I was thinking the same thing or the ability to do “flow engineering” on autogen. I do think it’s a good idea to build your own but it will also be a lot of work so it’s all trade off but it’s more or less the same thing by the end of the video

    • @wml816
      @wml816 4 місяці тому +23

      There are some valid points in this video that agent frameworks are not remedy to all solutions, but I don't agree with lots of the things there:
      1. the title is just click-baiting and misleading and I really hate it - there is nothing showing agent framework will fail, just that they are too heavy for some simple tasks like what is demoed here, and is too complicated for some data scientists to fully adopt to
      2. the whole video is talking about why a DAG is more straight-forward approach, but did not talk about why agent framework and abstractions are bad. Abstraction always comes at the cost of design complexity, but also with the benefit of things like decoupling, extensibility, etc.
      3. it is trying to advocate for building your own DAG framework, while there are already many DAG orchestration frameworks available and I don't see the point building such thing by yourself.
      4. I doubt if the author understands those agent frameworks well enough to call them fail. The agent frameworks aim at resolving enterprise level problem at large scale, and it provides a lot of features to make a solution stable, maintainable, and scalable. Making it work on as a PoC is only the first step towards a production ready system. Discarding frameworks and trying to re-invent the wheels on all these pieces are not the right way to go.

    • @deter3
      @deter3 3 місяці тому

      agent concept is a misleading concept and we shall come up with more advanced concept than agent . if you hold up with agent concept , the workflow will be really complicated .

    • @mohammadhatoum
      @mohammadhatoum 3 місяці тому

      I completely agree with your point. I was just about to mention that there is a common misconception or a lack of information regarding the capabilities of agents. LangChain, combined with LangGraph, can indeed perform the same tasks effectively.

    • @m4rtin419
      @m4rtin419 3 місяці тому

      Could you specify what you think is the misconception about their potential?
      Agent frameworks add inflexibility in a space that is very early in its development and still evolving. As a result, in my view, the potential must be really big to counter the disadvantages.
      Or, in other words, what outcomes can the frameworks provide that I cannot create by building my own pipelines or sequences, or however you approach it?

  • @hailrider8188
    @hailrider8188 4 місяці тому +15

    Cyclical/recursive algorithms are needed for many problems which in part, is what agentic frameworks attempt solve. Your sequential processing only paradigm is applicable only to certain problems.

    • @martinlorentsen4704
      @martinlorentsen4704 2 місяці тому +1

      Breaking down the problem is however a good point.

    • @jonbrown7962
      @jonbrown7962 Місяць тому +1

      I don’t think there’s really any kind of problem that agent workflows can solve that this can’t.

  • @MrEnriqueag
    @MrEnriqueag 4 місяці тому +35

    I agree with tour core message.
    But i dont think you've used langchain at the designed level or maybe dont know about langraph?
    Its not opinionated and you can (and should) orchestrate the flow however you want, you can make it linear, acyclical (every langraph example), you can decide the flow however you want, deterministally, defined by the LLM output etc.
    None of my agents are even driven by any default langchain agents, i have my own prompt, output format, tools etc.
    The framework is there to:
    1. Standarize the way you interact with the models
    2. Have a trackable verifiable analyzable way to build those graphs

    • @mayankraj2763
      @mayankraj2763 3 місяці тому

      On the spot, and most accurate comment!

  • @koen.mortier_fitchen
    @koen.mortier_fitchen 4 місяці тому +3

    Agreed. Take a simple airtable, input cell connected to an llm, and an output cell for its response. There you have your first step of an agent. The hours I lost on learning Langchain, Flowise, you name it

  • @chadsly2
    @chadsly2 2 місяці тому +2

    Dave, thank you for making this video. I can't tell you many times I thought I was the problem when trying to get AutoGen and CrewAI to do anything beyond the most basic tutorial. The more I look at these frameworks, the more I realize how green this field is.

    • @daveebbelaar
      @daveebbelaar  2 місяці тому +2

      Everyone is trying to figure this out

  • @Fezz016
    @Fezz016 4 місяці тому +39

    Basically what this video is saying is this, "I do not understand the Agentic Framework Flow yet, so I will just critique it in the meantime because I do not understand it"

    • @Chris_Faraday
      @Chris_Faraday 3 місяці тому +1

      Kind of LOL - its early and maturing as a more intelligent layered (much needed) framework - agentic with RAG / Lang is still highly compelling

    • @m4rtin419
      @m4rtin419 3 місяці тому +1

      I am curious, what actual results (eg in terms of performance) does the Agentic workflow provide for you that you couldn’t generate with a more flexible approach (eg pipeline, as outlined in the video)

    • @meh8099
      @meh8099 2 місяці тому

      Agents can work back and forth, basically discussing the output and improving if needed. A pipeline is one way.

    • @JerryLJackson
      @JerryLJackson Місяць тому +4

      For Now Agentic NoCode Frameworks are seeing explosive growth (replacing traditional pipeline automations) because of ease of use, I predict this will also be disrupted by LLMs soon with their own fully automated Agent builders that create 100% of the workflow automations including seamless connections to sub agents, tools and other integrations as needed beginning from a simple questionnaire prompt level.
      I’m a newbie to all this, so I may be over simplifying how this evolves, but it seems to me AI (insert a leading LLM company here) realizes it’s full potential when they can automatically build their own Agentic managers capable of solving very simple problems to very hard and niche problems in a fully automated way. These Agentic Managers will automatically build the worfkow and add sub agents and help users easily integrate with their systems and tools then easily deploy on their websites and apps to serve their customers, all from a few q&a prompts. A perfect solution for SMBs who don’t have an IT dept

    • @Algardraug
      @Algardraug Місяць тому +1

      Seems like he understands it though. He argues that for most actual business applications, a pipeline model is easier both to implement and reason about, as well being more in line with what you actually want

  • @EmilioGagliardi
    @EmilioGagliardi 4 місяці тому +17

    Interesting. Working on a CrewAI project atm and I found I was using a DAG approach to tasks because of my experience with Kedro. One task, one transformation, one output and keep working sequentially. In a nutshell, you're describing Kedro's approach and philosophy. Its just not fine-tuned for generative AI use cases yet. What I've found with multi agent apps is that I end up building tools that do all the heavy lifting and the agent Is used to generate a piece of data (like a query string) used in subsequent processing. The challenge is building guardrails to prevent an agent from going off the reservation when something doesn't work. If you give an agent access to a tool as simple as a search tool, if it gets stuck, it could end up calling the tool in a loop and there goes your credits. So we're still having to treat agents like toddlers... would be interesting to see your take on kedro.

    • @ricasco
      @ricasco 3 місяці тому +1

      Hi! I believe you are Italian like me, and I also already built agents with crewai related to content creation for ig and x. Atm I’m building a lead gen agent linked to another agent that then sends email to those leads
      We can share knowledge, it’s not so common find people of our country which are working on CrewAi. If interested reply to this comment 🙏

    • @bxkayy
      @bxkayy 3 місяці тому

      ​@@ricasco Hi, could you maybe tell me more about how exactly your lead gen agent works? Which sources does it use to find the leads? Sounds quite interesting :)

    • @daburritoda2255
      @daburritoda2255 2 місяці тому

      This guy definitely worked at McKinsey

    • @LeonardoAmigoni
      @LeonardoAmigoni 2 місяці тому

      Ciao Belli!!

  • @NakedSageAstrology
    @NakedSageAstrology 3 місяці тому +3

    I am working on a project that uses a combination of agents and pipelines. It has agents that each roleplay a specific function of mind, each agent working together to simulate a human mind.
    They are divided up according to the ancient Yogic philosophy of mind, Ahamkara for Ego, Manas for processing, Bhuddi for decisions, and Chita as the store house of memories.

    • @chadsly2
      @chadsly2 2 місяці тому

      Where can we see this work? Sounds fascinating

    • @hugosilva2441
      @hugosilva2441 Місяць тому

      cool af. Few days ago I was thinking about if someone out there was implementing something similar (although I was mainly thinking about the western philosophy portrait of human mind, i.e. mostly freudian concepts like id, ego and superego and/or even jungian like shadow etc).
      Is there any update to the project?any repo that we can learn more about?

  • @ibrahimmusah2015
    @ibrahimmusah2015 4 місяці тому +2

    I strongly agree with you using the ETL approach. Considering building a pipeline each step or agent flow can be accessed in any order, given the developer more flexible and ease in assigning tasks to agents. Thanks for sharing Dave

  • @alexanderandreev2280
    @alexanderandreev2280 4 місяці тому +6

    langgraph + function calling + langsmith = production
    "LangGraph is a way to create these state machines by specifying them as graphs."(c) LangChain

  • @SeuMuniz
    @SeuMuniz 2 місяці тому +4

    Many points you mentioned make a lot of sense. However, as stated in a previous comment, this approach can lead to numerous transformations in a scenario that might require multiple steps. In other words, you would always have to go through a three-step transformation. And not all tasks need three steps. The issue with fixing it this way is that, first, it can cause delays in response time, and second, you won't fully leverage the best aspect of artificial intelligence, which is its ability to, for example, assess the difficulty level of a question.
    My proposal for improving the workflow is to use the first question asked, that is, the input for the first step when you mentioned 'transformation' or 'manager.' I would pass a prompt in this step. And in this prompt, as a response, it would have to classify the difficulty level of the question, with levels ranging from 1 to 5. I would create a logic where, if the difficulty level is between 1 and 3, or between 1 and 2, for example, there would be no need to go through all these steps.
    Because there are many trivial questions that wouldn't require so many steps, which is how the human mind works when we ask someone a question. If the question demands more time for reasoning, the person takes time to think. But when, for instance, you ask someone how much 1 plus 1 is, they quickly respond that it's 2, without needing to go through three steps for trivial questions.
    So, in the first prompt, I would include a difficulty rating mechanism. You would then establish a programming logic for each of these difficulty levels, allowing an agent with more resources than other agents to handle the reasoning, even based on previous contexts. And in this same step, using the response, you would receive both the difficulty rating of the question, which would be passed to the next step, that being the generation of the response. In this return, there could also be an analysis, based on what is being said, about the quality of the previous response given within the context, assigning it a level of assistiveness.
    For example, if you ask someone to activate the email and they don't understand correctly, then, as previously mentioned, the response would receive a rating indicating that it wasn't a good response. This would be added to the agent's context, so when it generates a new response, it would take into account that the previous answer wasn't adequate. This way, with a single step, we would have feedback on the previous situation and the current situation to process.

  • @Crates-Media
    @Crates-Media 4 місяці тому +7

    Here's something you can help me understand, as an intermediate-level coder learning all of the nuances of AI/ML and their applcations.
    You're extolling the value of the directed acyclic graph approach towards data processing pipelines, to avoid sending data to earlier stages.
    As a fan of idempotency and functional programming, I _think_ that I somewhat understand where you're coming from in your premise.
    But in my studies of models, I'm also seeing a lot of buzz around the differentiation between methodologies of KANs vs MLPs.
    My question is this: wouldn't there be some value in using information uncovered later in the pipeline to refine what you're doing earlier on?
    For instance, let's say you're entertaining guests, and planning to serve appetizers. A very early step might be purchasing ingredients.
    Later on, you realize that not all of the guests show up. If we're just going to keep moving forward, we make more appetizers than are needed.
    The alternative: when less guests show up or RSVP, instead of making as many apps as your ingredients/plans dictate, you make less.
    Now you have less appetizers and you store or freeze the ingredients you didn't use. You _could_ make them, and freeze the unused portions.
    But by sending the information collected later back to an earlier step, you instead have the raw ingredients to use in other recipes instead.
    This is a really lousy and forced metaphor, but it's all I could come up with off the top of my head. It just seems like there's value in the concept.
    On a different level, isn't this just sort of a form of backpropagation? The ability to reinform earlier calculations with the results of later ones?

  • @fighterjockey246
    @fighterjockey246 Місяць тому +6

    BS... clickbait title ...

  • @drwho8576
    @drwho8576 Місяць тому

    Glad somebody finally brought that up. 90% of things that folks use agents for can be done with proper flow engineering. For all AI tasks (F1000 prod quality) I use DSPy which allows me to define the flows very nicely, similar to PyTorch. For larger, more complex systems I use Prefect for the workflow, but still DSPy for the individual AI calls. Agents have their place, but most of the time when you think hard about the problem, you don't need them.

  • @ContextFound
    @ContextFound 4 місяці тому

    You have a solid point about agentic frameworks usually not being the right tool for tangible business applications. It's about automating the repetitive.

  • @Whiskey9o5
    @Whiskey9o5 12 днів тому

    I agree. This is the way. I found the same thing. I start from blank and build up without all the different framework that bloat the system.

  • @kc0tlh
    @kc0tlh 8 днів тому

    I have been involved in enterprise software buildout/integration processes in the Fortune 500 (including automated ETL flows for financial reporting) and what you're saying here makes a ton of sense.

  • @Blebona
    @Blebona 13 днів тому

    This is amazing! Where can I find the deep dive to this? I need it ASAP🤞🏾

  • @kdhrubo
    @kdhrubo 3 місяці тому +1

    You are right - use BPM workflow engine instead and call AI wherever needed.

  • @paulshirer
    @paulshirer Місяць тому

    Yep, it also follows OOP principles -- injecting data into an encapsulated object and getting an output. You could then have objects strung together, each doing their specific job. So a GPT is in a way an object that does a narrow thing and produces an output that could be injected into another GPT.

  • @opensky1710
    @opensky1710 4 місяці тому +57

    My problem is having hard time to find girl friends.

    • @Mangini037
      @Mangini037 4 місяці тому +34

      You need a bigger pipeline son.

    • @Dreamingofyou317
      @Dreamingofyou317 4 місяці тому +10

      Build an agent to do your tinder for you

    • @f1l4nn1m
      @f1l4nn1m 4 місяці тому +2

      @@Mangini037and longer, maybe.

    • @christianboning2732
      @christianboning2732 3 місяці тому +1

      Don't waste your time with them.

    • @sahilchavan5173
      @sahilchavan5173 3 місяці тому

      Trust me we are done something this - Tinder 😂

  • @teprox7690
    @teprox7690 4 місяці тому +3

    I think we will see special models trained for the agent workflows. Right now, they are trained with way too much knowledge for this workflow. Then the latency will also go down. I'm currently wondering why we haven't heard anything about this approach yet.

  • @brianhauk8136
    @brianhauk8136 4 місяці тому +3

    You said this is a work in progress, and I'm wondering if you've compared the results of traditional Mixture of Agents responses with your pipeline approach for various common use cases.

  • @noduslabs
    @noduslabs 4 місяці тому

    Good take. All those frameworks are good for getting familiar with the principles but if you want to make a unique specialized product you need to code everything on your own. Probably you won’t need agents for some tasks even.

  • @f1l4nn1m
    @f1l4nn1m 4 місяці тому

    Thanks for sharing. There’s a tradeoff that a developer needs to balance between reasoning agility and hallucinations minimization that results in how much one wants to constrain the dialog flow. Your case is naturally well suited to be solved by two steps, always the same, ETL-like pipeline. If you test your paradigm with a real chat interaction where a user wants to order at Starbucks you will easily get tired framing it with the ETL-like paradigm. Indeed there’s art in being able to see apparently complex dialogues as more linear pipelines but the overall feeling it that you’re losing much of the flexibility that LLMs can provide you.

  • @dustindustir521
    @dustindustir521 3 місяці тому

    We did exactly that approach in a current Projekt and it works great.

  • @UNCCNICK
    @UNCCNICK 3 місяці тому +1

    The discussion about the data pipeline is accurate, but it cannot be used to prove that a multi-agent system is ineffective or failing. You are still thinking like a software/data engineer instead of an AI engineer. Consider this: when developing any new data pipeline or system, do you ever need an LLM to help? If yes, then there must be a way to integrate the LLM directly as part of the pipeline or system too.

  • @deter3
    @deter3 3 місяці тому +3

    The concept of an agent is very naive due to the current limited capabilities of LLMs. I've seen too many solutions to current problems that are just stacks of LLMs with higher costs, higher latency, and suboptimal solutions.
    When thinking about humans as agents, each agent should have specific capabilities (not just role-playing) and specific workflow inside to deal with complex problems at light speed. However, looking at current LLMs, they are slow, lack of specific capabilities and workflows with less reliability .

  • @jonasgabrielmbn
    @jonasgabrielmbn 3 місяці тому

    AutoGen allows groups of agents to have a specific order of execution, so you can have them interacting like in a DAG workflow

  • @alvandal
    @alvandal 4 місяці тому +2

    Great video, I am not big on UA-cam, but this is the first time I see someone really understanding the current state of the tech.

  • @syberkitten1
    @syberkitten1 5 днів тому

    I totally agree with your premise, good video 🎉

  • @teprox7690
    @teprox7690 4 місяці тому +1

    Everything is great. I have built a few tools myself with Instructor. To really automate business processes, however, I see the problem with data protection. In the EU, I can't just put a complete e-mail into an LLM. How do you solve this? It would be great if you could shed more light on the subject of data protection! Thank you very much for your excellent content!

    • @RealEstate3D
      @RealEstate3D 4 місяці тому

      Exactly what I build for my company. Small AI that discovers PII in a text that I want to give our offices for use in their intranet before sending it out to public LLMs. Beforehand I tried Presidio and octopii. Both use regexp. Got bad results.

  • @Artem-jm9xd
    @Artem-jm9xd 2 місяці тому

    Bro, you are a genius! Data Pipeline??! wow, eureka!

  • @sjkba
    @sjkba 23 дні тому

    Great video! I would love to see the source code of the project that you have open, and a walkthrough of how and why you put it together.

  • @theanush123
    @theanush123 2 місяці тому

    I have been in dilemma when and where to use the existing agent-based frameworks vs ETL kind of workflow. I have been given similar work as my thesis as to developing a Multi-Agent RAG System for cross-domain information extraction and retrieval. Could you provide guidance on the following:
    Agent Specialization: How can I design specialized agents for different Confluence spaces and internal services (e.g., sick leave, vacation request, IT ticket)?
    Coordination: What strategies can I employ for a coordinator agent to manage cross-domain information retrieval effectively?
    Domain Adaptation: How can I implement transfer learning techniques to adapt agents to new domains?
    Framework Flexibility: What considerations should I keep in mind to create a flexible framework that can accommodate new spaces and internal functions?
    Additional Questions:
    Are there any existing frameworks or tools that could be adapted for this purpose?
    What are some potential challenges and best practices to consider during development and implementation?
    I'm eager to explore different approaches and learn more about this topic.
    Please suggest!

  • @QuinnEschenbach
    @QuinnEschenbach 2 місяці тому +1

    Super interesting, I have come to the same conclusion about most "agentic" frameworks, the react approach is to inconsistent for production applications.
    Have you tried langgraph? It goes into a very similar direction like you datapipline approach.
    And together with function calling and structured output it allows you to build super powerful apps.

  • @mmasa1
    @mmasa1 2 місяці тому

    I get where you are coming from, but...
    1) CrewAI has sequential processing. Works pretty similar to traditional pipelines.
    2) There are a number of use cases where criss-crossing agents is necessary (i am thinking validation tasks).
    Finally, traditional pipelines are nice but I always find myself solving problem that others have already solved..
    so it's either copy paste into my custom Pipeline or embrace the OS. I find a lightweight framework like crewai is very useful for many of today''s tasks (in production).
    With the ability to include and write custom tools easily - it';s like having a traditional pipeline on steroids.

  • @KirillEgorov-p7y
    @KirillEgorov-p7y 4 місяці тому +2

    Hey, looks very reasonable. Have you looked at prefect and its new controlFlow libraty?. It helps to manage this data pipeline pattern for LLM

  • @AI4Ever4Life
    @AI4Ever4Life 3 місяці тому +1

    Can you help me understand on what's the difference between the idea of building agentic applications using LangGraph vs the one you proposed in this video?
    You did mention about LangChain style of making agents but LC completely revamped their agentic application building framework using LangGraphs where one can get full control of the behaviour or the agentic workflow with principles from DAGs.

  • @GauravDhiman
    @GauravDhiman 3 місяці тому +1

    Very nice and detailed video, but whatever you explained as exactly the same as LangGraph. Rather than writing from the ground up its better to use LangGraph to determine the flow between intermediate steps.

  • @NockyLucky
    @NockyLucky 4 місяці тому +3

    This was so wrong

  • @andydataguy
    @andydataguy 4 місяці тому

    Step 1) understand how the tech works
    Step 2) use it to it's best ability
    Hasn't this always been the case with new technology for decades?

  • @afazeli8361
    @afazeli8361 4 місяці тому

    Awesome content, Keep up the good work

  • @Rusputin-eo6tv
    @Rusputin-eo6tv 4 місяці тому +1

    framework in the end is just how you organize your code.

  • @iham1313
    @iham1313 3 місяці тому +1

    pipelines are good for linear - step a then step b then step c - tasks. using a team of agents is imho meant for nonlinear tasks, where you might need step a then step c and then step b, or even adding or removing steps from the - here it comes - DYNAMICALLY formed pipeline based on the decisions of an (managing role) agent.
    using the wrong tool for the wrong task is always an easy way to critique something or someone.

    • @Shri
      @Shri 2 місяці тому

      Where would you ever use such a system except for chatbots? Business is deterministic and everything in this World is a business process. 99.9% of the time you wouldn't need dynamically formed pipelines at all.

  • @nirvanaseeker1
    @nirvanaseeker1 2 місяці тому +1

    How would this work if we used a BPM engine instead ?

  • @vitalyl1327
    @vitalyl1327 4 місяці тому

    I found that critical agent feedback is exactly what you need to *constraint* the output. It should shut down all the hallucinated, mal-formed and simply incorrect outputs. Also, tool use is better in agentic architectures - you can have dedicated agents to format tool calls and process their output before it's fed back.

  • @liron92
    @liron92 4 місяці тому

    Thank you, very informative. Which pipeline registry tool do you use?

  • @aimattant
    @aimattant 4 місяці тому

    I followed through. Your system looks, great, with content creation processing with your AI generative pipeline. However, I think the point of Agentic, which is not there for sure, is to be able to work in a non-rigid system, the bottom-up approach, but where all systems are communicating together. So it is a build-up on pipelines that you have. Which is amazing by the way 😊 And putting them all together in a system that works autonomously. The idea is to get AI to the point where it will work as a team without instruction. The whole point is why Sam and all the others are building these huge systems now. One thing I want to get my head around is nongenerative AI; is content base. One thing I am seriously delving into now is API endpoints of all kinds with AI LLM model support. With some tasks, they are not required. But with many where data is involved, they are. Hope this makes sense. Not here to put a dent in your wonderful work. You are great at coding and putting the AI infrastructure together. Look forward to following along with you. AI agent workflows are the way forward now.

  • @LeonardoLeao-of5di
    @LeonardoLeao-of5di Місяць тому

    I have reached the same conclusion, but for other reasons. In fact I dare to say that these frameworks have been slowing down actual innovation. They are very helpful when you are starting end experimenting, but when it comes to go to production they will give you a hard time. Managing token count, tool calling, structured output, entry/exit rules, logging and all the "boring" stuff production needs will be very messy and will force you to rewrite the native modules. My take on data pipeline: it will depend on the task, but I have 2 approaches: (auto managed agent) setting agents as tools and work with tool calling or state machines, to control steps and transitions (what you built from scratch).

  • @theguygrossi
    @theguygrossi 2 місяці тому

    Super helpful, ty!

  • @mdfaysal7753
    @mdfaysal7753 11 днів тому

    Would like to know more about the design pattern you have used here and why?

  • @zhengwei-yy6hs
    @zhengwei-yy6hs 27 днів тому

    ou have really pinpointed the current issues with agents-there’s often a huge gap between aspirations and reality. There are so many agent frameworks out there, but the key to consistent performance still lies in having an effective and stable workflow to guide it, which should essentially be a data flow. Also, could you share the code from the video?

  • @tonykipkemboi
    @tonykipkemboi 4 місяці тому +2

    So what you're trying to say is it's simple to build agentic workflows, hence do it yourself and don't use the existing frameworks?
    If yes, your video/take would have been much better and persuasive if you dug into the implemetation of the said frameworks while pointing out the cons. Your example is very basic and doesn't even need an agentic process tbh. You can write a script to handle this like you did.
    All am asking is a more in-depth comparison and not a one-sided take.

  • @threevia.travel
    @threevia.travel 3 місяці тому

    Agree on the idea not to use frameworks and build custom, however, the data pipeline / sequential DAG based approach will not achieve the fluidity that gen ai promises.

  • @agi_lab
    @agi_lab 3 місяці тому

    One very good usecase for agents is the ability to take a decision on using the tools which they have at their disposal. A very lightweight less bloated framework which can do this (Basically function calling but with consciousness) will win the race. I am thinking of a design pattern instead of a framework will work.
    This is coming from my experience of putting crewai in prod and see it fail miserably at times

    • @Shri
      @Shri 2 місяці тому +1

      But why would you even need that ability except for when building chatbots? Your business processes are not dynamic. They are pretty static. What is dynamic is the data being fed into the process. If your business process is itself dynamic then your problem is not AI but your business process itself.

    • @agi_lab
      @agi_lab 2 місяці тому

      @@Shri you dont really need agents for such tasks. Normal bots would do the same thing (static requirements and needs). Think of an agent which can generate ppts for you project, searching internet, compiling from various sources and writing the ppt content. This is what we should aim for when working with agents.

  • @jackprophesy
    @jackprophesy 2 місяці тому

    wish i had seen this before beating my head against dify, flowise, n8n... 100% spot on

  • @jonm691
    @jonm691 4 місяці тому

    I really liked your video, and the message, but I just kept thinking that you'd just done LangGraph 'properly'. It has much more capability, more transparency, more enterprise considerations. etc. I'm not sure I agree that you must never under any circumstances loop back. All that means is that you leave open a need to fail a process and with additional context, get it resubmitted. Did I miss something?

  • @JohnDoe-m6s
    @JohnDoe-m6s 4 місяці тому +1

    @13:33 Please create an in-depth video on these concepts using the example that you are showing in this video !

  • @ds920
    @ds920 3 місяці тому

    Yeah, that’s true…!
    (that’s why I’m working on a open source execution environment for agents)

  • @MyStatement
    @MyStatement 15 днів тому

    What If, the agent pattern is intended to lead to raise up the number of necessary api calls resulting in higher revenue of the llm owner or demanding higher computational power of your local System.
    Who benefits from which approach?
    Its worth to think about different approaches how to get efficient Output of llm s

  • @arkodeepchatterjee
    @arkodeepchatterjee Місяць тому

    hey could you please share the video about the instructor library that you talked about in this video

  • @shobhitsadwal6081
    @shobhitsadwal6081 Місяць тому

    The only thing I understood from this video is not build your project solely depending on agents, build a solid pipeline upto the level where you have proven systems running it.

  • @maazmusa3192
    @maazmusa3192 13 днів тому

    What about acyclic workflows? For example a crawler which is trying to find a login page for a website?

  • @bgriffin5447
    @bgriffin5447 4 місяці тому

    It’s simpler for you because of your ability but for 95% of people having a framework is a better option

    • @dievas_
      @dievas_ 4 місяці тому

      No its not, basic python is enough for any kind of agentic flow, these frameworks only complicate things.

  • @The_Grand_Zand
    @The_Grand_Zand 4 місяці тому

    I would LOVE to see your design pattern in depth

  • @Nathan-pu9um
    @Nathan-pu9um 2 місяці тому

    Just checking, are you giving the agents their own vector database with the business information/logic needed? Im looking into this using something like pinecone, then it can specifically interact with its own information

  • @qredence
    @qredence 4 місяці тому

    Not 100% agree but largely clearly on our side!
    In fact the currents frameworks are not enterprise ready, unpopular opinion you seem to share too !
    Imo Orchestration is the real key ;)
    but agentic systems with stateflow nested pattern connected to external tools/fabric/composio/else can be a part of solution
    The other key is RAGsystem, uncertainty first focus based framework that adds more complexity but as we think is that is almost mandatory for companies.
    Greate video !
    You should follow closer Microsoft Fabric and Semantic Kernel

  • @АндрейПонамарев-ж2г

    Think about AI Assistant that replaces chat-bots in sales tunnel. IMHO the best use case to cover it with RAG and agentic approach

  • @hannesg.3586
    @hannesg.3586 4 місяці тому

    Thanks for the video. What kind of whiteboard tool do you use?

  • @not_a_human_being
    @not_a_human_being 4 місяці тому

    existing frameworks are bloated, you have a point there, it's like they only make sense to people who created them. but I'm not sure what exactly is Celery adding here? extra complexity with no extra gain. Defining DAGs is fun, but usually doesn't add much value

  • @stewartfarquhar1280
    @stewartfarquhar1280 4 місяці тому

    great work. please publish the next tutorial. is there a github for the code?

  • @juliovac2113
    @juliovac2113 4 місяці тому

    I'm a noob with coding so I find crewai a lot easier to create from scratch than your toolkit, but I'd like to change that, what do you recommend to get started on grasping it properly from the start?

  • @mikekidder
    @mikekidder 4 місяці тому +2

    state machines, state machines, state machines...

  • @dalaun
    @dalaun 3 місяці тому

    does openAis structured output release change your opinion ?

  • @AIgencify
    @AIgencify 4 місяці тому

    very interesting i was applying this kind of tasks in my company too like email reading attached files processing etc. is code avaible? thanks alot

  • @blackpete5877
    @blackpete5877 2 місяці тому

    From what I see, your key argument about data pipeline flows vs agentic structures does not work in dynamical systems. In linear, simple and pre-determined flows maybe. In chaotic systems? I don't see how.

  • @goat-of-neptune
    @goat-of-neptune Місяць тому

    is there a way that the user gets to know in an agent framework, which llm is solving his task, so that he gets consistant and repeatable results?

  • @laurensbulthuis3366
    @laurensbulthuis3366 2 місяці тому

    I've been using crewai to see if it was something I could use in a production setting. The future is definitely going to be more of agentic workflow with agents having the freedom to respond to requests (eg it can handle a variaty of inputs.. not just 1) but I totally agree that the current state is far from the future state. Currently it is very creative and it can do a lot but its a real struggle to get database connections and then do some pandas dataframe actions, and dont even get me started about the excess prompting and inconsistencies. Yeah i know shocking.. but then again i am looking at this from a business intelligence perspective. So for now the pipeline route is the preferred solution.. this however can quickly change when better frameworks come out.

  • @AtAllAnAlias
    @AtAllAnAlias 4 місяці тому

    Good old Programming: Imperative Programming
    "AI" programming: Declarative programming

  • @gregkendall3559
    @gregkendall3559 3 місяці тому

    Have you seen Agent-Zero? Very much a clearer way to do some tasks.

  • @agnivamahata3870
    @agnivamahata3870 4 місяці тому

    This works, but giving AI to take decisions are supercool, new libraries will emerge check agency-swarm.
    These works for data driven processes but first creative processes agentic systems make sense

    • @dievas_
      @dievas_ 4 місяці тому

      Yeah, but you dont need frameworks for that, agents are just basic methods that call each other or tools. You also create some class for state management. Function calling is also easy. All those frameworks are opinionated and only adds bloat.
      Unless youre making something with 20 agents, but that would be nonsense...

  • @vidfan1967
    @vidfan1967 4 місяці тому +1

    Agents are good for one-off activities, where you want the agent system to find a sequence of activities that gets the job done. Nice for non-coders or not-knowers.
    However, for a repetitive process, where you need to rely on the quality of output, you need to control every step and KNOW, that it will deliver a result you can handle in future steps. The issue with LLMs is the uncertainty they introduce, eg. unwanted bias, wrong facts, broken reasoning.
    Use the LLM only where it shines (understanding and generating text) - you would nit rely on the LLM to be good at math and use other functions instead. This same principle applies for a lot of steps, if you decompose the job into tasks. But you need to understand coding to properly do it (or use an AI to do it for you once and then write the task sequence for you with minimal LLM).
    And this is not even considering the high costs agent systems produce compared to restricting LLM use where it is beneficial - or understandability, how the result was achieved…

  • @joesmoo9254
    @joesmoo9254 3 місяці тому

    Great contribution

  • @arkodeepchatterjee
    @arkodeepchatterjee Місяць тому

    how to build production level ai applications??
    is only function calling enough??

  • @blahfah521
    @blahfah521 10 днів тому

    Agents will be built into the models in the future. Just look at o1, and that's the first version of this approach. If and when AGI is achieved, all of this goes out the window.

  • @yasminelmahdi2003
    @yasminelmahdi2003 4 місяці тому

    Hey Dave, I'm working on my undergrad project research, and it's about AI agents, I have a couple of questions if there's a way could you share a way to contact

  • @SamuelTerra22
    @SamuelTerra22 3 місяці тому

    Can you share the project shown in the video?

  • @Steph-jazz
    @Steph-jazz 2 місяці тому

    Excellent !

  • @outworldlyoisin
    @outworldlyoisin Місяць тому

    Hey, can u share the template if possible?

  • @ylazerson
    @ylazerson 3 місяці тому

    very well said!

  • @d.g.567
    @d.g.567 2 місяці тому

    Isn’t this what LangChain is supporting? LangGraph was exactly created for this to have a somewhat stateful and to a certain extend deterministic process flow with LLMs.

  • @thepetewinn
    @thepetewinn 4 місяці тому

    I can’t agree with this more strongly

  • @bahaeddinelouchenne3463
    @bahaeddinelouchenne3463 Місяць тому

    One question : how to manage memory within the data pipeline system ?

  • @333SFx
    @333SFx 4 місяці тому +5

    Langgraph

  • @nuclearthrone2497
    @nuclearthrone2497 Місяць тому

    This is such a good video - I will dive deeper into this at a later point to learn about your findings

  • @CookTheBruce
    @CookTheBruce 4 місяці тому

    Have you looked at VRSEN’s Agent-Swarm? Sounds like he avoids many of the pitfalls you describe here…