Make AutoGen Consistent: CONTROL your LLM agents for ACCURATE Postgres AI Data Analytics

Поділитися
Вставка
  • Опубліковано 5 жов 2024

КОМЕНТАРІ • 109

  • @TheBlackClockOfTime
    @TheBlackClockOfTime 11 місяців тому +30

    This is low-key the most important channel on UA-cam.

  • @j.hanleysmith8333
    @j.hanleysmith8333 11 місяців тому +33

    This is the series that we were all hoping for. The other UA-camrs just go over the toy examples that the repost themselves advertised. I love your focus on building powerful, valuable pieces of software

    • @Jump-2-the-moon
      @Jump-2-the-moon 11 місяців тому +3

      The toy examples always frustrate me. Like, how the hell is creating a Snake game or a task manager going to give me any benefit? I want real world scenarios that take a lot more customization and ability.

    • @codescholar7345
      @codescholar7345 11 місяців тому

      This is the series I'm looking for! Thanks!!

  • @nhapham9502
    @nhapham9502 11 місяців тому +15

    Please share the source code.

  • @MichaelWoodrum
    @MichaelWoodrum 11 місяців тому +6

    Any chance on releasing your repo for analysis?

  • @agenticmark
    @agenticmark 11 місяців тому +21

    When your prompts get into superprompt territory, put your prompts in text files, one prompt per file, them just load the string into your source code. It makes the code a lot cleaner and makes it easier to edit your prompts.
    This is actually pretty unique for autogen info on youtube. Most people just recap the examples already given from the AG team. Your orchestrator reminds me of round-robin routing.
    Love the style of this video. Good editing, good pacing, good setup.

    • @JustMaier
      @JustMaier 11 місяців тому

      Agreed. It’s rare to run into real examples. They’ve gotta exist, but I’m guessing most of them are on GitHub, not UA-cam.

    • @mickelodiansurname9578
      @mickelodiansurname9578 11 місяців тому +1

      With the addition of fine tuning from OpenAI then keeping them in a text file is even more useful... cos they are fine tuning gold when they work. In fact it might be good to dump them all into json or create embeddings and put them in a store.

    • @agenticmark
      @agenticmark 11 місяців тому

      absolutey@@mickelodiansurname9578

  • @yiouyou
    @yiouyou 11 місяців тому +5

    May I ask how to get the code in the video? Thanks.

  • @ventureinozaustralia7619
    @ventureinozaustralia7619 11 місяців тому +1

    Not a coder (I'm a low code guy) so I'm following from a distance but this video is brilliantly inspiring, so well articulated, especially the summation at the end.

  • @stevehoff
    @stevehoff 11 місяців тому +2

    Nice presentation, great detail and a concern for your consumer's time. Well done.

  • @saziedhassan3976
    @saziedhassan3976 11 місяців тому +2

    This is just splendid! Thank you so much for taking the time to make these videos. If I could only explain in words how helpful these are.
    REQUEST HERE: Would love to see an example of agents that work together to retrieve information from both documents (using vector indexing for instance) as well as postgres db. Most business intelligence reside on both and bringing them together could be really powerful for driving key insights. Thanks again!

  • @CrypticConsole
    @CrypticConsole 11 місяців тому +1

    I like the tone set by the intro ngl

  • @everythingiscoolio
    @everythingiscoolio 11 місяців тому

    Everybody needs to be working on this. We have a chance here to massively change the world.

  • @koliom
    @koliom 11 місяців тому

    The most detailed and deep dive explanation of Autogen capabilities I found so far! Well done! Thank you!

  • @mareklewandowski7784
    @mareklewandowski7784 11 місяців тому

    Passion emanates from your videos. I just joined the ride. I feel like we'll have hundreds of thousands of views here really really soon .

  • @jtbrower
    @jtbrower 11 місяців тому

    Your introduction “raw engineering” is exactly what I have been looking for as a Software Engineer myself. Thank you for that intro, you have my follow now.

  • @SkyJensen
    @SkyJensen 11 місяців тому +1

    Thankful to come into this space and find immediate applicable functionality

  • @toruhiyo
    @toruhiyo 11 місяців тому +1

    Love stepping off the hype train into some real engineering wisdom. Your content is stunning! Awesome work! 👍🔧

  • @HostileRespite
    @HostileRespite 11 місяців тому +1

    Data fidelity is critical. Absolutely right.

  • @thomasgormanable
    @thomasgormanable 11 місяців тому +1

    Great video, I'm a very novice hobbiest programmer but the orchestrator reminds me of what ChatDev has implemented. It has a process of meetings where up to 2 agents of certain roles are in each meeting and they have a conversation until a condition is satisfied. Chatdevs limitation is that only 2 agents can be a part of a conversation, Autogen solved that with the chat manager but lacks the who should be a part of which conversation. What you have implementated is kind of a merger of the two. Again great video

    • @0201alex
      @0201alex 11 місяців тому +1

      Been using ChatDev for this reason but now the game changed thanks to this video I’m about to make my own agents!

  • @J3R3MI6
    @J3R3MI6 11 місяців тому +8

    More AutoGen 💎🙏🏽

  • @tubedewy11
    @tubedewy11 11 місяців тому +4

    Hi any chance you are going to share code. Fine if not.

  • @n0rrland
    @n0rrland 11 місяців тому +3

    Fantastic work and really exciting to see where this new "team building" is gonna take us! Thanks for the content, looking forward to the next session! 😊

  • @spputty2127
    @spputty2127 11 місяців тому +1

    I like where you're going with this Dan, I also see great possibilities multi agents. I haven't coded for 30+ years but I'm refreshing/updating my memory and it's like riding a bike really. I want/hope to incorporate low level local agents to speed conversations and save tokens.

  • @chrismachabee3128
    @chrismachabee3128 11 місяців тому

    Hi, fantastic video. Day 1 here, first timer. I have a joke. I have to work backwards to catch up.Really too new, but I am digging it.

  • @MidSeasonGroup
    @MidSeasonGroup 11 місяців тому +2

    Hi Dan, thanks for putting this out. I was having the same issues and I definitely love the route and pivot you took here. I’m curious if you’ve seriously considered a full custom solution yet.

  • @ba70816
    @ba70816 11 місяців тому +1

    I had to edit my original comment!
    This is exactly what I am doing at this minute! Or at least I was trying to figure how to do it!
    Nice!
    Are you on the AutoGen Discord?

  • @0201alex
    @0201alex 11 місяців тому

    That intro hooked me to comment. Love the way you set viewer expectations

  • @DOSputin
    @DOSputin 11 місяців тому +2

    Mad respect. Thanks for spreading the good word, and for sharing your adventure.

  • @Bobaleaux
    @Bobaleaux 11 місяців тому +1

    It would be phenom, it you PR this to the AutoGen repo as a new class of conversation. However, if not, any other options?

  • @belatorok5630
    @belatorok5630 10 місяців тому

    Excellent, LLM is like an Einstein, multi agent is a group of Einsteins but if there are no good orchestrator they are only play their fun games. :) The problem with these LLMs is that they operate too freely non-deterministically, so they need to be kept in check with a well-proven plain traditional algorithm. So they can make really wonderful things.

  • @wowzande
    @wowzande 11 місяців тому

    Hey bro,
    Thanks for the video. Cheering you on to build on the momentum..keep going, dont stop. From the heat and the fury. Make sure you dont forget to rest.

  • @w_chadly
    @w_chadly 11 місяців тому +2

    I'm going to be that guy. digging the glowing keywords. share the theme pls 😁

  • @MrAloha
    @MrAloha 8 місяців тому

    I keep trying not to learn Python, and it looks like I'm gonna just ask the LLM to teach me to code like I'm a 5th grader. 😁
    Last night, I created a conda env and installed Autogen Studio. Today I'll work on building my team.😳 Thanks for the info!🙏

  • @NenJiDaPassiv
    @NenJiDaPassiv 11 місяців тому +1

    So cool. I've been thinking along these lines also. I suspect that that this sort of strategy could open up opensource llms to operate with greater efficiency and accuracy. I would love it if you could show us an attempt, success or fail either way, that employs a small llm locally to accomplish some simple tasks. Of course we would like have gpt4 at the helm. Haha ive been chewing through tokens lately and really hope I can find a cheaper solution.

  • @Artholos
    @Artholos 11 місяців тому +2

    This stuff is great! I’m getting great things out of my autogen programs when using GPT 3.5 and 4… but dang is that expensive!
    I’ve been trying to use local LLMs but very poor results. Would you perhaps be able to make a tutorial on how to get good stuff from local LLM agents?
    Love you work 🎉 can’t wait for the next one!

    • @agenticmark
      @agenticmark 11 місяців тому

      Yeah, I run Vicuna locally for autogen, and compared to chatgpt, its just not as good. It will be a matter of time before these open source models catch up. Also the prompting techniques change depending on the model you are using. tricks that work for one, will not get good results on another.

    • @thomasgormanable
      @thomasgormanable 11 місяців тому

      I believe there is rumours that OpenAI is reducing it's API cost by a factor of 20 times. There is a developer conference in the next month or so with that being an expected output.

  • @mickelodiansurname9578
    @mickelodiansurname9578 11 місяців тому +2

    @IndyDevDan Your point about the overwhelming number of github projects and their actual utility after they are installed is well taken... like you I spent ages installing and testing and dumping most of them... my best guess is Aider, Autogen and CodeInterpreter are the ones's I'll focus on for my projects and forget the rest... And to be honest had you not started this channel with a pragmatic approach you did, then likely I'd have done so myself... cos there is no much utter shit out there that its unbelievable.
    I will disagree with you that your views and subscribers are not a focus... they should be Dan... cos this is the utility driven channel I've been waiting for man...

    • @0201alex
      @0201alex 11 місяців тому

      Aider is the future

  • @Luffy-ss8og
    @Luffy-ss8og 11 місяців тому +1

    Great job man. Really amazing work. Can you please share a link to the code? That would be really helpful :D

  • @jcd528
    @jcd528 11 місяців тому

    Keep doing it... I will keep viewing... Thanks

  • @vecyang
    @vecyang 11 місяців тому

    May have more videos on real world use case on autogen, for exaple, marketing research with back-and-forth auto critic.

  • @ironknight132
    @ironknight132 8 місяців тому

    Excellent video sir! Thank you!

  • @psykepro
    @psykepro 11 місяців тому

    Dude this session is golden! Thank you very much!

  • @kraketito8999
    @kraketito8999 11 місяців тому +2

    Can you code with us, so we can explore it further
    Thanks for the video

  • @tomski2671
    @tomski2671 11 місяців тому

    Thank You for the video, unfortunately I don't have the abilities or time to get into at this low a level.
    However have you considered creating a GPT agent using your ideas to generate code. That might have its own challenges and require maintenance, but might be worth a try.

  • @bonadio60
    @bonadio60 11 місяців тому

    Excellent content, I am playing with autogen too and I feel the same as to need of more control. For me the function_call should be executed by the agent it self not to return it to another agent to execute it.

  • @Jandodev
    @Jandodev 11 місяців тому

    The tooling for this is everything!

  • @Silkari
    @Silkari 11 місяців тому

    Looks like the type of thing I want to explore, especially the Broadcast Conversation you demonstrated, however, can't follow the video or learn about how you achieved it. Can you share code?

  • @dunguyen7395
    @dunguyen7395 11 місяців тому

    thank you for your video, it really helpful.

  • @faridullahkhan1
    @faridullahkhan1 11 місяців тому

    thank you, love the autogen videos you creating. 1 ask: is is possible to have a bit more complex interaction between agents, using interactions between groups? multiple groups with agents in each group. thank you

  • @ernesttan8090
    @ernesttan8090 11 місяців тому

    amazing! how do you figure out all that without any documentation?

  • @pioggiadifuoco7522
    @pioggiadifuoco7522 11 місяців тому

    well done mate! keep going!!!!

  • @eliasgvinp2141
    @eliasgvinp2141 11 місяців тому

    Have you considered using langchain instead of autogen? Langchain is much better suited for building predictable pipelines, processing data, imho

  • @ColinTimmins
    @ColinTimmins 11 місяців тому

    Hot damn, great video. Love hearing your thought process. Just found your channel, subbed for more! =]

  • @apereiracv
    @apereiracv 10 місяців тому

    I love this and I love you lol. Great content.

  • @VaibhavRokde-n7r
    @VaibhavRokde-n7r 11 місяців тому +1

    provide code link as well.... That help us

  • @vecyang
    @vecyang 11 місяців тому +1

    Could we share the source code by text? Really insightful structure!

  • @fierybore1223
    @fierybore1223 11 місяців тому

    Great work man thank you for these resources!

  • @faisalIqbal_AI
    @faisalIqbal_AI 11 місяців тому

    Thank for sharing knowlede

  • @moisesbessalle
    @moisesbessalle 11 місяців тому

    Amazing! Thank you for this!

  • @devhau5
    @devhau5 11 місяців тому

    Love this video! Thank you

  • @prasenjitgiri919
    @prasenjitgiri919 11 місяців тому

    can you have an orchestrator that has more than one tool, for eg. a chat, a sql agent and also a recommendation predictive algorithm - how does one orchestrate all of these? And in serverless, this is what im finding challenging

  • @cjbobby
    @cjbobby 8 місяців тому

    at 23:33 you said that you recommend something for logging. i couldnt really catch it, but i suppose it is some sort of library for logging? could you let me know pls?

  • @daddydiy9008
    @daddydiy9008 11 місяців тому

    I made something similar utilizing autogen but ran into the issue of having datasets that were too large to be summarized by a single agent. Ultimately this meant that I could never get a unified report. I’ve since figured out a way around it, but I’m curious how you’re doing it. Could you elaborate please?

  • @ph8787
    @ph8787 11 місяців тому

    Hey, do you have to run all the flow to debug? If not how are you debugging?

  • @李应健
    @李应健 11 місяців тому +1

    Can I have the source code to learn

  • @李应健
    @李应健 11 місяців тому

    nice work!

  • @HistorIAsImposibles776AC
    @HistorIAsImposibles776AC Місяць тому

    If I had a company I would hire anyone here 😅

  • @leosoulas5897
    @leosoulas5897 11 місяців тому

    is there a github somewhere so we can all contribute to this codebase?

  • @hidroman1993
    @hidroman1993 11 місяців тому

    Would be great if you showed how much it cost

  • @shaftymaze
    @shaftymaze 11 місяців тому

    Thank you

  • @paullopez_ai
    @paullopez_ai 11 місяців тому +4

    I like to content, I would watch more videos if you reduce all the hand motions. It makes viewers dizzy and it’s distracting. Just some input.

    • @n0rrland
      @n0rrland 11 місяців тому +3

      I kind of like the hands movement, makes you feel more present :D

  • @theDrewDag
    @theDrewDag 11 місяців тому +1

    No matter how precisely I follow this tutorial, the function is never run. I keep on getting "***** Response from calling function "run_sql" *****
    Error: Function run_sql not found."
    This did not happen before writing the orchestrator. I am 99.9% sure code is correct. Can you upload the github of this project?

    • @JoseMiguel_____
      @JoseMiguel_____ 11 місяців тому +1

      same issue :(, did you resolve it?

    • @jpit5992
      @jpit5992 11 місяців тому

      I also have the same issue - any solutions?
      PROMPT v1: display all the users who have a hotmail email address
      TABLE_DEFINITIONS: CREATE TABLE USERS_table (
      ID integer PRIMARY KEY AUTOINCREMENT,
      Created text NOT NULL,
      Updated text NOT NULL,
      Authed text NOT NULL,
      Plan text NOT NULL,
      Name text NOT NULL,
      Email text UNIQUE NOT NULL
      )
      CREATE TABLE sqlite_sequence(name,seq)
      CREATE TABLE JOBS_Table (
      ID integer PRIMARY KEY AUTOINCREMENT,
      Created text NOT NULL,
      Updated text NOT NULL,
      parentUserID integer NOT NULL,
      status text NOT NULL,
      totalDurations integer NOT NULL,
      FOREIGN KEY (parentUserID) REFERENCES USERS_table (ID)
      )
      PROMPT v2: display all the users who have a hotmail email address Use the TABLE_DEFINITIONS to satisfy the database query
      SQLite_TABLE_DEFINITIONS_CAP_REF
      CREATE TABLE USERS_table (
      ID integer PRIMARY KEY AUTOINCREMENT,
      Created text NOT NULL,
      Updated text NOT NULL,
      Authed text NOT NULL,
      Plan text NOT NULL,
      Name text NOT NULL,
      Email text UNIQUE NOT NULL
      )
      CREATE TABLE sqlite_sequence(name,seq)
      CREATE TABLE JOBS_Table (
      ID integer PRIMARY KEY AUTOINCREMENT,
      Created text NOT NULL,
      Updated text NOT NULL,
      parentUserID integer NOT NULL,
      status text NOT NULL,
      totalDurations integer NOT NULL,
      FOREIGN KEY (parentUserID) REFERENCES USERS_table (ID)
      )
      -------------- SQLitedata analysis multi-agents ::: Data Engineering team. Orchestrator Starting-------------
      --------- Running iteration 0 with (agent_a:Admin, agent_b: Data_Engineer)------------
      basic chat(): Admin -> Data_Engineer
      Admin (to Data_Engineer):
      display all the users who have a hotmail email address Use the TABLE_DEFINITIONS to satisfy the database query
      SQLite_TABLE_DEFINITIONS_CAP_REF
      CREATE TABLE USERS_table (
      ID integer PRIMARY KEY AUTOINCREMENT,
      Created text NOT NULL,
      Updated text NOT NULL,
      Authed text NOT NULL,
      Plan text NOT NULL,
      Name text NOT NULL,
      Email text UNIQUE NOT NULL
      )
      CREATE TABLE sqlite_sequence(name,seq)
      CREATE TABLE JOBS_Table (
      ID integer PRIMARY KEY AUTOINCREMENT,
      Created text NOT NULL,
      Updated text NOT NULL,
      parentUserID integer NOT NULL,
      status text NOT NULL,
      totalDurations integer NOT NULL,
      FOREIGN KEY (parentUserID) REFERENCES USERS_table (ID)
      )
      --------------------------------------------------------------------------------
      Basic chat() : reply with {
      "role": "assistant",
      "content": null,
      "function_call": {
      "name": "run_sql",
      "arguments": "{
      \"sql\": \"SELECT * FROM USERS_table WHERE Email LIKE '%@hotmail.com'\"
      }"
      }
      }
      function_call() Admin -> Data_Engineer
      basic chat(): Admin -> Admin
      Admin (to Admin):
      ***** Suggested function Call: run_sql *****
      Arguments:
      {
      "sql": "SELECT * FROM USERS_table WHERE Email LIKE '%@hotmail.com'"
      }
      ********************************************
      --------------------------------------------------------------------------------
      Basic chat() : reply with {'name': 'run_sql', 'role': 'function', 'content': 'Error: Function run_sql not found.'}
      basic chat(): Admin -> Data_Engineer
      Admin (to Data_Engineer):
      ***** Response from calling function "run_sql" *****
      Error: Function run_sql not found.
      ****************************************************
      --------------------------------------------------------------------------------
      Basic chat() : reply with Here is the SQL query to fetch all users who have a hotmail email address:
      ```sql
      SELECT * FROM USERS_table WHERE Email LIKE '%@hotmail.com'
      ```
      --------- Running iteration 1 with (agent_a:Data_Engineer, agent_b: Sr_Data_Analyst)------------
      basic chat(): Data_Engineer -> Sr_Data_Analyst
      Data_Engineer (to Sr_Data_Analyst):
      Here is the SQL query to fetch all users who have a hotmail email address:
      ```sql
      SELECT * FROM USERS_table WHERE Email LIKE '%@hotmail.com'
      ```
      --------------------------------------------------------------------------------
      Basic chat() : reply with {
      "role": "assistant",
      "content": null,
      "function_call": {
      "name": "run_sql",
      "arguments": "{
      \"sql\": \"SELECT * FROM USERS_table WHERE Email LIKE '%@hotmail.com'\"
      }"
      }
      }
      function_call() Data_Engineer -> Sr_Data_Analyst
      basic chat(): Data_Engineer -> Data_Engineer
      Data_Engineer (to Data_Engineer):
      ***** Suggested function Call: run_sql *****
      Arguments:
      {
      "sql": "SELECT * FROM USERS_table WHERE Email LIKE '%@hotmail.com'"
      }
      ********************************************
      --------------------------------------------------------------------------------
      Basic chat() : reply with {'name': 'run_sql', 'role': 'function', 'content': 'Error: Function run_sql not found.'}
      basic chat(): Data_Engineer -> Sr_Data_Analyst
      Data_Engineer (to Sr_Data_Analyst):
      ***** Response from calling function "run_sql" *****
      Error: Function run_sql not found.
      ****************************************************
      --------------------------------------------------------------------------------
      Basic chat() : reply with I'm sorry, but I'm unable to run the SQL query at the moment due to a technical issue. However, your SQL query seems correct. It will fetch all users from the USERS_table whose email ends with '@hotmail.com'. Please ensure that the table name and column names are correct and exist in your database.
      --------- Running iteration 2 with (agent_a:Sr_Data_Analyst, agent_b: Product_Manager)------------
      basic chat(): Sr_Data_Analyst -> Product_Manager
      Sr_Data_Analyst (to Product_Manager):
      I'm sorry, but I'm unable to run the SQL query at the moment due to a technical issue. However, your SQL query seems correct. It will fetch all users from the USERS_table whose email ends with '@hotmail.com'. Please ensure that the table name and column names are correct and exist in your database.
      --------------------------------------------------------------------------------
      Basic chat() : reply with APPROVED
      -----------Orchestrator complete-----------
      Ochestrator was successfull

    • @theDrewDag
      @theDrewDag 11 місяців тому

      @@JoseMiguel_____No man.

    • @jpit5992
      @jpit5992 11 місяців тому

      Its driving me crazy@@theDrewDag

    • @JoseMiguel_____
      @JoseMiguel_____ 11 місяців тому

      I just found that you need to add function_map=function_map to your engineer assistant too@@theDrewDag (Im not sure why)

  • @navneetchoudhary808
    @navneetchoudhary808 11 місяців тому

    Can anybody tell me how to use the output from the autogen as everything is going into the terminal. How to reference those output variables?

  • @Jonathan-ih9sm
    @Jonathan-ih9sm 11 місяців тому +3

    The channel exploded because a lotta people made surface level videos about autogen and your video really stood apart.

  • @rastinder
    @rastinder 11 місяців тому

    how to config a agent that can execute code?

  • @picklenickil
    @picklenickil 11 місяців тому

    How do you integrate into so many single thread app framework.. streamlit.

  • @zyxwvutsrqponmlkh
    @zyxwvutsrqponmlkh 11 місяців тому

    Get on with it.

  • @MegaGutemusik
    @MegaGutemusik 11 місяців тому

    N1

  • @milleniumdawn
    @milleniumdawn 11 місяців тому

    You not sharing the code, is doing a lot less sharing that you think you do.

  • @alfonsopayra
    @alfonsopayra 11 місяців тому

    what the heck is going on with those moving hands???

  • @alfonsopayra
    @alfonsopayra 11 місяців тому

    MY GOD STOP MOVING YOUR HANDS MAN

  • @contractorwolf
    @contractorwolf 11 місяців тому +1

    bring it @IndyDevDan, there is too much hype. I came to build

  • @WiseWeeabo
    @WiseWeeabo 11 місяців тому

    stop waving your hands around

  • @Seaileanu
    @Seaileanu 11 місяців тому +1

    The "jazz hands" bro...