For some reason some people are saying this is an undisclosed sponsorship video. I clear say at 0:36 that it's sponsored, plus I marked the video as sponsored. I will NEVER make an undisclosed sponsored video.
I mean why some folks would talk about your pointing finger itself while you are pointing to something in the sky?!?! Why it bothers people that much?! You like the video, good! You don't like it then just move on!!! Do they want some margin of the profit or what's the problem here!!! Sound so immature and childish to me!!! Guys, stop acting like jealous girls and do your work and spent time and effort to earn money!!! STOP envying others!
Mathew, have you had any luck getting a local model to use tools? If so, what is the setup? If not, why not? Been pulling my hair out for weeks, and even attempted my own wrapper api. I’ve had some success with the wrapper but it’s not very consistent.
Please make a video about building llm applications from architecture perspective. What are the most popular designs/ architecture. What are the most used tools like langchain, Llamaindex, crew ai, groq, llms
Thanks. Please make a vid doing this 100% local without Lightning, as this means that you don't need anything additional and can be altered in the future without Lightning if needed (most likely will do). I don't think ppl want to be tied to Lightning or other similar platforms, despite the "ease of use".
Just an observation, but if your mind isn't automatically translating what he is doing into how you'd do it fully on your own computer with what you already have on it then it won't help and what you'd actually want is to ask him to make you a specific video for every project you want to do; I'm a real estate broker--not a developer--and just watching for the first time I have the same thought as every video--how I would do this on my own GPUs at home without being tied into to any vendor lock -in, but so far there's nothing he's relying on in the Lightning platform that you likely don't already have set up on your home setup that I can see--is there? Are you interested in developing with A.I. tools or are you just interested in having the leading edge of finished products and don't want to concern yourself with any part of the development process, because there's a much bigger ask of you if you plan to take it later to production, not to mention your particular CI/CD needs that he doesn't even get into but will demand much more critical thinking on your part to make it work in any commercially-viable way. That said, my own complaint to contribute while we're weeping and gnashing our teeth, would be that I wish they didn't use the mark "Lightning," with such an important role btcln has in increasing BTC adoption, diluting the association in another cutting edge field
the code is all the same. lightning is just a fancy notepad essentially just like vs code is. Run your backend whatever it is you choose to use then set the api points. That's really all you have to do. Some backends are more of a pain than others but so far they all work. koboldcpp is the only one you would end up having issues with.
If you go to his link, you can copy/paste most of his code. The only major difference is the ollama url 11434 which needs to be set to your local machine instead of lighting's version.
This is alot of overhead that I seemingly can achieve by using the right prompt. Task and agent definitions also seem redundant if it's always 1 for 1. I'd appreciate some examples that clearly show the advantage of agent crews. Can be more abstract to be quicker.
Please start revealing your prompt than can have your llm turn into multiple agents talking to each other and completing a project. Must have a expensive pc or you dont mind waiting hours for a response. His vids show a easy example not what you can really do with agent frameworks.
I think this is always the case, with proper engineering (prompt and code) you can reach the same results and even be much much more cost effective. IMHO agents will be really the Thing when it will be part of the LLM architecture internally, same as we start to have LLM's with online browsing, so you don't need to use that as a tool and do all the parsing / searching etc, as this is already implemented internally.
This is how you automate LLM queries within an application. All the Python work will be undertaken on a remote or web server which returns the results of a parameterised request back to the web page, to be parsed by JS, XSLT etc. This is the basis of Agentic Reasoning or Processing.
how about you actually go read some fundamental papers on neural networks and how they work, and then go google what you're looking for. Because it's pretty obvious to everybody who has tried to understand this and actually taken the time to look up the performance differences that they are much superior to standalone
I see a lot of complaints on this thread for a variety of reasons, I dont know why people complained. But I really liked this video. I've not seen CrewAI before and it was intresting to see how it worked. I was pleantly surprised to see how quickly a demo app could be built using more than one agent / AI. I plan to try some of the demos on this site. Paid or not, I enjoyed this video and found it intresting to look further into. Thankyou for posting it! 👍
I work in big tech for one of three hyperscalers. I have to say I love your content. I watch it daily. I’ve added your channel to a shared folder with “Content to watch” on our internal colab tool. I go back to your videos constantly. I want to make a digital twin of your videos and code lol😂 (and with your tutorials it’s actually very easy!)
do you use it with tools ? what is the consistency of Agent able to using tool ? to me with ALL local llm it's like to random to be used as a production tool.
00:02 Setting up CrewAI team using Lightning AI 02:03 Setting up AI agents in CrewAI for efficient task management. 03:58 Preparing information for stock performance analysis and financial analysis 06:01 Setting up AI agents for specific tasks 07:59 Creating AI agents with CrewAI and Grock 10:05 Defining agents, tasks, and crew for building AI agents with CrewAI 12:17 Setting up necessary tools for financial analysis with CrewAI 14:09 Setting up a financial analyst crew with CrewAI using Poetry. 16:17 Building AI agents with CrewAI using fine-tuning 18:03 Setting up environment and authentication for AI agents 19:46 Focusing on building AI agents with CrewAI while keeping it 100% local Crafted by Merlin AI.00:02 Setting up CrewAI team using Lightning AI 02:03 Setting up AI agents in CrewAI for efficient task management. 03:58 Preparing information for stock performance analysis and financial analysis 06:01 Setting up AI agents for specific tasks 07:59 Creating AI agents with CrewAI and Grock 10:05 Defining agents, tasks, and crew for building AI agents with CrewAI 12:17 Setting up necessary tools for financial analysis with CrewAI 14:09 Setting up a financial analyst crew with CrewAI using Poetry. 16:17 Building AI agents with CrewAI using fine-tuning 18:03 Setting up environment and authentication for AI agents 19:46 Focusing on building AI agents with CrewAI while keeping it 100% local
I just had a play with lightning AI from this videos recommendation, I do like the lack of dependency problems, I spent an entire evening messing about with python dependencies for a similar project to crew ai on my local pc, I didn't get anywhere lol. This was straight forward, I also appreciate the pacing and calm approach to these videos. I would love to see more informative content on lightning AI and crew ai, maybe using a larger crew, using a variety of tools, and a different subject for some variety, writing a code perhaps. Keep up the great work!
I can't believe people are whining that this is a sponsored video. It's great content. No one is forcing you to sign up for anything. Feel free to do the hours or research on how to use the product yourself if you want 😂
you meant to say feel free to google the very easy to find, very public very visible github for near 75% of his videos and follow the instructions he is following to do the tuts himself, and some tweaks and maybe a chk with someone sometime on something broke, but its following, I can link the links for near all of them, and most the other guys, and I love matt, but uh, research is a stretch for this tut and most, #facts most people didn't go do whatever because his title referred to doing it all local, something that is not so easily found, and not so easily have good instructions, and not so easily to tackle if they are new. #facts #notlocaltutorial
Great tutorial! I have been watching your AutoGen series too and now I'm super confused what to pick for my upcoming project. What's your personal favourite? :)
This video matched exactly what I was looking for. But I am blown away at how much boilerplate there is to get all this set up! It seems like CrewAI left a bunch of work for the end user to do even though they built in configs etc.
I wanted to jump back into the fray on this thread with an update; I've since been able to install and run crewAI with only local models, no barking from the code about a missing OpenAI key. Carry on! :D
I thought of myself as a code/programmer enthusiasts but I will have to watch this video like 10 times to be able to get it tu run :) Quick question, can you fine-tune a model inside this workflow?
Fantastic information in here. Thank you for the work you're putting into these videos! I'm trying to adapt your code to use the default TXTSearchTool, but I don't see how tools are passed to the agent/task. Does it automatically have access to anything in the tools folder?
To me this represents the absolute worst part of all these Agent projects. 99% this is just configuration information, yet it is spread across YAML files, toml files, Python code files, and env files. To top it off, tools are added to the system with copy/paste. There are at least 5 different configuration methods in just this one small example. The "how" of creating Agents the right way is a bunch of useless knowledge about configuration formats that should have by now been completely hidden from us either by a Crew building Crew or a better abstraction.
A great video as always Matt, I did try Lightning AI but it drove me nuts. I'm not keen on cloud IDEs because I travel a lot and they suck on planes and trains that go through lots of tunnels. I did give it a go though but found the UI rather awkward. In the end I just created a new project in PyCharm and it all worked just fine. Give me a GitHub repo any day. I run on a 96GB M2 Max Mac so rarely need external GPUs, your demo was a great update on CrewAI. I hope they're not going to get too embedded with poetry but I'm very comfortable with the rest of the structure.
Yes I could not get Lightning AI to work at all. It got caught in some login loop where it would not allow me to access the account. Also there were several instances where the UI buttons would not work. I tried both edge and chrome on PC and could not get either to work. Does not seem ready for prime time.
@johntdavies You seem like you are experienced in Python, I don't see where the SECTools were passed to the agents in this structure. Am I missing something?
@@UncleDougy Hi, actually my programming background is C/C++ and Java but I'm getting the hang of Python. Basically I got rid of the src directory, I use that in other languages but it doesn't seem to fit in with most of my Python code. From my base or root directory I have financial_analyst_crew and in there I have the two directories config and tools. It's exactly the same as in the video, I didn't change anything except removing src and moving everything up a level. Let me know how you get on.
Leave some time in the video AFTER you say, “like and subscribe” so we can do it, lol. Right now, you say, ‘like’, then immediately the video ends and another one starts. It’s a ton of trouble to get back to your vid. Great video, btw!
Javascript will receive the results passed to it from the web server which will have executed the Python code. Think of the agent call as being equivalent to a database query being made by the web server. Instead of calling out to a SQL source, you execute some Python.
@@japethstevens8473 that’s a great way of putting it. It’s an engine you can just call out to. Blockchain’s are kind of the same with polling a block and doing client side tx signing etc
Hello, Thank you for your great explainaitions. I cannot understand how is the sec tools defined ? Does crew ai automatically grabs it from tools folder ? It has not benn specified is angents has it ?
The sec_tools is not working in this code ;) as you mention, it has not been specified in agent. Also, the sec_tools require the sec api key (queryApi = QueryApi(api_key=os.environ['SEC_API_API_KEY'])) which is not provided in the environment.
@@samansaadzadeh1833 and tool calling doesn't even york with Groq or local AI xD... at least, from what i know... i'm using groq for my agent and just gpt4o-mini for function calling.....
Great video, and very valuable for a beginner as I am. I am not a coder, invested a lot of time in terminal, conda etc. to get crewAI templates run for use cases I have in mind. for me it would be beneficial to understand how to set a run time environment that will scale but help stay organized without the need to master terminal and python environments but to focus on crewaAI and Langchain's offerings. So anything you could share being involved a while either by yourself or by one of your network firends driving towards a 'product' would be intersteding to see. Wish you anyway all the best, I'll keep following your sharings.
This video is FANTASTIC! I was on the fence about Autogen or CrewAI, I've spent time with both but I have a feeling that Crew is just behind Autogen and it's a waist of time. Now I know, 100% for sure, for me crewAI is a complete waist of time. Stick with Autogen. Thank you for making this 20 minute video and saving HOURS of my life waisted on CrewAI. thank you , thank you.
@@EngineerAAJI know agent swarm specifies in their documentation exactly where CrewAI falls short, but I haven’t deployed anything beyond the demo for agent swarm. How much have you worked with it?
@@eIicit for my application for now it is early to tell which one will perform better, but I am experimenting with the three solutions to see which one performs better for my specific task, and once I get some more solid information I will let you know
crewai are going with the poetry and docker model for installs I think, hence Matt using poetry. yes I'm sure you can simply install crewai in a python venv and work from there, but that won't help later on when they start including other dependencies. Which I agree raises a whole nother can of worms
The trouble referenced wrt to dependencies and virtual environments is vastly overstated. I suspect it was more about supporting the sponsor than solving a legit concern.
Developing AI Agents with the CrewAI appears intriguing. Don't pass on SymthOS if you want to use AI to push the envelope. It's a real industry innovator.
great video and really like the 'golden path' way, but I am not sure from the code or the video how how tool is connected to the agent. Am I missing something? Trying to rebuild a Crew using lightning and this framework. Any help would be greatly appreciated. I tried to figure it out, but I am missing something and their I can't find documentation on crew AI for this
heres a video for you to make dude, i just put this video in gemini and asked it for the code and it did it, im on the free version of gemini, fk paying for ai :D
I have a 3090 and I can run Mixtral fine locally. However, I've had very bad results with CrewAI and tools like SerperDev and BraveSearch to name only those. It's like the model does not understand how to properly call the tools. It's like a roll of a dice. Sometimes it works, but most of the times it just times out without doing anything useful. I wish you would make a full demo of CrewAI with OS models + tool usage.
It's a bit of a crapshoot when running locally. sometimes it just works and other times the model hates you and wants to punish you for some unknown deed. Try rewording your agents and tasks and see if it helps.
If you look at the output (though you scrolled quickly through it) the models didn't use the tool provided. The analysis is around Q3 and Q4 of 2022. I followed along letter for letter and while it did work I did not get the expected outcome because of outdated data. I am thinking that the tools need to be added to the task maybe, but that's not clear how I would do that in the .yaml file config. Possibly by just adding the name of the tool in a tool section of the task... Just wanted to point that out.
How did the Crew know to use the tool? I don't see anywhere where we set that up, is it just based on the directory structure and nomenclature? Or is it all in Poetry ?
So, we use conda to set up an environment, and poetry to lock the environment? Another layer of abstraction brings code closer to incomprehensible. It's hard to figure out what directory levels various files are in. (getting frustrated with python's environment)
Great video and very informative! However once i successfully ran the program on lightningAI i noticed the stock information for TESLA was wrong (outdated), the agent told me the source of info (Yahoo). I changed the company from Tesla to Netflix to see if this data would be inaccurate as well, and sadly it was. However the data pulled on netflix did notify me that the data was from 2021. Is this an issue with GROQ? or is it to do with what tools we’ve included? Thanks once again for the awesome informative video! Thumbs up and a new subscriber here!
great, did some analysis on the stock from February 2023. are you sure this worked, much less using old info? I don't see TSLA ever getting much over $400 per share, briefly in 2021, and this says stock was $1,036, unless they did some splits but i wasn't gonna look that close. Why didn't the "crew" call that out if that is the case? point is, these agent frameworks (and LLMs) have a long ways to go before we stop questioning their output.
Matt what do you think is these opensource stuffs are just for fun playing, or it is feasible to make a product ready app based on? I am wondering how can we test such an LLM based module correctly...
Thanks. Was unable to get your earlier VScode tutorial working, but now on Lighning this is working. Good to be on the golden path. How might one output the result to a .txt or .doc (or any other such) file?
Hi Matthew! Great video! I am running into all sorts of issues trying to launch a Studio, though. It doesn't look to me like Lightning is that dependable?
I assumed this was the issue due to me looking at this vid and signing up for Lightning AI on 5-5-24. That, I don't get. Why include a tool in the process that a new person can't use. Sorry if I'm missing something, wouldn't be my first miss....
this and the beginner video is still way over my non techie head. also, i want to be able to automate my work at my corporate office job with these. i don't create content or work for myself. how would i run a department with agents?😏
Dude that’s awesome about Lightening. I’m always mobile using the 12.9 iPad Pro with keyboard and pencil. Working on my ERP is a b…. cause I can’t use vscode on this.
Thanks MB! Fantastic quick tutorial. More of these please. And don’t worry about those who are thinking you shouldn’t have sponsors, let them work free if they want to or create all their own content out of pocket, you just keep doing You.
I haven’t read the docs on this yet, but it feels like this is taking away from the charm of crew ai, it’s simplicity. What do you think, do you prefer it this way ?
Thanks a lot. But writing code has become very tedious since the appearance of llm. I guess a competitor would do the same without writing a single line of code 😀
In the AI wars... There are no competitors. Everyone's solo, and at anytime a unicorn can appear. Just the other day, I literally implemented an LLM from scratch, using a language that's not normally used for machine learning due to it's speed (Xojo)... And oddly, the new architecture I created, runs faster than any python code I've encountered... So, now to port the code to python 😂😂😂 The point - programmers will always be able to do things non-programmers cannot, with any technology. We literally invent the technology and still have to code, to get to a "no code" point... And even then the creator, still has to code. 🤫 Plus - it's easier to add new features to a full code platform vs a no- code platform, because with no code - the more abilities, the more room for bugs, clunkiness, and all out security issues. Botpress for example is over 500,000 lines of junk most people don't need if they're doing a basic conversational bot... All that overhead 😮 (=carbon). No code tools are really created just to get people on the coding bandwagon - do you see any reputable businesses creating apps or software with no-code solutions? No - because the code must be vetted for any reputable business, and no code cannot be vetted. 💯 So no code = hobbyist **Code is always tedious - it's either right, or it's wrong; there's no between. 🙏
@@mcombattias a non coder I agree. Im getting fed up of paying for multiple tools that only give you partial data so time to bite the bullet and learn python.
Is there any chance you could show us how to get crewai interrogating local documents. I write a lot of reports and have to find a local solution to compile private local data with data which is available online. I have crewai working with local llm’s but can’t for the life of me get their tools working for me. I can’t find any examples online and find your videos extremely easy to follow. Thanks.
I am looking at the documentation on github and website and I cannot find any information on how to run this - all I see is the previous version where all the definition is in python. I love the YML definition and the decorators taking care of a lot of the work. Is this not out yet? Any idea when it might be coming, am I missing something?
Like the how you are building agents in the yaml files, but all the crew AI examples and documentation do not show this. Do you have any documentation somewhere showing the use of yaml files?
how do you make a poetry.lock file, what happens durring you changing screens while youre still talking-giving directions, where exactly does one find the sec tools to copy and all the other things to copy???? Could you make this fir a newbue to get started up and running a basic or rather a semi basic to great chatbot for answering questions of the user. Note: i had plans on connecting this cloud Ai into MIT App Inventor so it could have comunicatuons.
I wish you did it locally and published the py files so that we don't have to start from scratch. I totally agree installing stuff locally is a pain, I spent 2 days trying to convince arch (well, Manjaro) to install llama-cpp, in the end, I copied the installation from conda, which was successful but langflow wouldn't find it. So cloud is nice, but also, you sacrifice your privacy and some money. So I like local much more.
Hi, do you give any personal pointers on how I can incorporate ai agents to my business, would be great to have some one like you to help people incorporate them
very interesting video. It went by a little fast but once I finished I realized I could just open the model you created in the description... I did everything in the video and tried changing parameters in yours. I can not seem to get it to work. just getting errors in the terminal. saying Ollamaa call failed with status code 502. Any ideas?
This seems like 80% local! I'm between jobs and want to play around with AI locally at this time I'm not interested in using any cloud service or anything that might cost money. I do have several a few gaming PC and an old R730 server w Nvidia P40 to play around with and don't mind waiting if it takes some time.
I just hope that this type of stuff grows out of just being implemented in python. I don’t hate python especially after they introduced data classes but boy are virtual environments messy. I remember in 2017 in college making a terrific django app only to get caught in one of those big version updates. I was a novice & migration docs weren’t that great then. I migrated anyway. Nothing worked anymore. After that i was like no more python for me 😂. Imagine building something like in the video in code & updating the framework you used to the latest version. Oh and have it running live in your business & poof broken! Really hope i can code up this stuff in like javascript or C#. In rust with a framework would be ideal.
That horror story should never happen in a business environment, which should be running with full backups of everything the business logic touches or depends on. This issue is about poor practices, not any failure of virtual environments.
@@jaymartinez311 Also, my point is, those dependency issues you mention are not unique to python. Virtual environments in python, properly employed, do not complicate the issue of dependencies. Venv is literally a tool to manage dependencies. As for your business crisis, you should learn the difference between production and development code, QA, and best practices with respect to backups.
this is helpful! do you happen to know how to use output_json with this method? i keep getting errors like "Input should be a subclass of BaseModel" no matter how i try to pass it to the task.yaml or inside the @task definitions
Tell me Matt, how is this project 100% local when the first thing you do is use some cloud collaboration tool that we will likely never see you use again? Or how about groq? is that API key you're going to revoke going to be used for a groq instance on your local hardware? I suspect not.
![Lp. Сердце Вселенной #60 РОЖДЕНИЕ ЛОЛОЛОШКИ [Финал] • Майнкрафт](http://i.ytimg.com/vi/YoR0pAV9FVQ/mqdefault.jpg)
For some reason some people are saying this is an undisclosed sponsorship video. I clear say at 0:36 that it's sponsored, plus I marked the video as sponsored. I will NEVER make an undisclosed sponsored video.
I mean why some folks would talk about your pointing finger itself while you are pointing to something in the sky?!?!
Why it bothers people that much?!
You like the video, good! You don't like it then just move on!!!
Do they want some margin of the profit or what's the problem here!!! Sound so immature and childish to me!!!
Guys, stop acting like jealous girls and do your work and spent time and effort to earn money!!! STOP envying others!
People❗❗❗ People say the Darnedest things ❗
Lol.. I could care less if it’s sponsored or not as long as it is informative, which it is, and doesn’t have 50 commercials.
Mathew, have you had any luck getting a local model to use tools? If so, what is the setup? If not, why not?
Been pulling my hair out for weeks, and even attempted my own wrapper api. I’ve had some success with the wrapper but it’s not very consistent.
Don't worry about the heaters, just keep bringing the good stuff
What part is 100% Local ?????? It's all in the cloud!
Ollama can work locally so if you are familiar with Python it is not an issue to do the whole thing on your machine.
@@tgzsolt
Is there an ollama tutorial ?
@@tgzsolt i work from home and you don't call me "office worker" just because i can work from office
If you remove lightning, everything works the same.
@@tgzsoltyou should be clear to explain performance is very dependent on your machine specs
Please make a video about building llm applications from architecture perspective. What are the most popular designs/ architecture. What are the most used tools like langchain, Llamaindex, crew ai, groq, llms
Thanks. Please make a vid doing this 100% local without Lightning, as this means that you don't need anything additional and can be altered in the future without Lightning if needed (most likely will do). I don't think ppl want to be tied to Lightning or other similar platforms, despite the "ease of use".
Just an observation, but if your mind isn't automatically translating what he is doing into how you'd do it fully on your own computer with what you already have on it then it won't help and what you'd actually want is to ask him to make you a specific video for every project you want to do; I'm a real estate broker--not a developer--and just watching for the first time I have the same thought as every video--how I would do this on my own GPUs at home without being tied into to any vendor lock -in, but so far there's nothing he's relying on in the Lightning platform that you likely don't already have set up on your home setup that I can see--is there?
Are you interested in developing with A.I. tools or are you just interested in having the leading edge of finished products and don't want to concern yourself with any part of the development process, because there's a much bigger ask of you if you plan to take it later to production, not to mention your particular CI/CD needs that he doesn't even get into but will demand much more critical thinking on your part to make it work in any commercially-viable way.
That said, my own complaint to contribute while we're weeping and gnashing our teeth, would be that I wish they didn't use the mark "Lightning," with such an important role btcln has in increasing BTC adoption, diluting the association in another cutting edge field
the code is all the same. lightning is just a fancy notepad essentially just like vs code is. Run your backend whatever it is you choose to use then set the api points. That's really all you have to do. Some backends are more of a pain than others but so far they all work. koboldcpp is the only one you would end up having issues with.
If you go to his link, you can copy/paste most of his code. The only major difference is the ollama url 11434 which needs to be set to your local machine instead of lighting's version.
@@chrisBruner Thanks, that was so simple!
Except he's shilling for langchain-groq. You'd still have to pay for that.
This is alot of overhead that I seemingly can achieve by using the right prompt. Task and agent definitions also seem redundant if it's always 1 for 1.
I'd appreciate some examples that clearly show the advantage of agent crews. Can be more abstract to be quicker.
Please start revealing your prompt than can have your llm turn into multiple agents talking to each other and completing a project. Must have a expensive pc or you dont mind waiting hours for a response. His vids show a easy example not what you can really do with agent frameworks.
I think this is always the case, with proper engineering (prompt and code) you can reach the same results and even be much much more cost effective.
IMHO agents will be really the Thing when it will be part of the LLM architecture internally, same as we start to have LLM's with online browsing,
so you don't need to use that as a tool and do all the parsing / searching etc, as this is already implemented internally.
This is how you automate LLM queries within an application. All the Python work will be undertaken on a remote or web server which returns the results of a parameterised request back to the web page, to be parsed by JS, XSLT etc. This is the basis of Agentic Reasoning or Processing.
how about you actually go read some fundamental papers on neural networks and how they work, and then go google what you're looking for. Because it's pretty obvious to everybody who has tried to understand this and actually taken the time to look up the performance differences that they are much superior to standalone
@@syberkitten1 Like the Three Magi, the Ai system in neon genesis
I see a lot of complaints on this thread for a variety of reasons, I dont know why people complained. But I really liked this video.
I've not seen CrewAI before and it was intresting to see how it worked.
I was pleantly surprised to see how quickly a demo app could be built using more than one agent / AI.
I plan to try some of the demos on this site.
Paid or not, I enjoyed this video and found it intresting to look further into. Thankyou for posting it!
👍
Just in 3 minutes and already posts :) greate work as always
I work in big tech for one of three hyperscalers. I have to say I love your content. I watch it daily. I’ve added your channel to a shared folder with “Content to watch” on our internal colab tool.
I go back to your videos constantly.
I want to make a digital twin of your videos and code lol😂 (and with your tutorials it’s actually very easy!)
Love the crew ai tutorial, i first saw crew ai on ypur channel and now we are using it at work!
do you use it with tools ? what is the consistency of Agent able to using tool ? to me with ALL local llm it's like to random to be used as a production tool.
You set this as local, then immediately try to pug and make us use a cloud based environment, I'm getting tired of this crap in the ai community
00:02 Setting up CrewAI team using Lightning AI
02:03 Setting up AI agents in CrewAI for efficient task management.
03:58 Preparing information for stock performance analysis and financial analysis
06:01 Setting up AI agents for specific tasks
07:59 Creating AI agents with CrewAI and Grock
10:05 Defining agents, tasks, and crew for building AI agents with CrewAI
12:17 Setting up necessary tools for financial analysis with CrewAI
14:09 Setting up a financial analyst crew with CrewAI using Poetry.
16:17 Building AI agents with CrewAI using fine-tuning
18:03 Setting up environment and authentication for AI agents
19:46 Focusing on building AI agents with CrewAI while keeping it 100% local
Crafted by Merlin AI.00:02 Setting up CrewAI team using Lightning AI
02:03 Setting up AI agents in CrewAI for efficient task management.
03:58 Preparing information for stock performance analysis and financial analysis
06:01 Setting up AI agents for specific tasks
07:59 Creating AI agents with CrewAI and Grock
10:05 Defining agents, tasks, and crew for building AI agents with CrewAI
12:17 Setting up necessary tools for financial analysis with CrewAI
14:09 Setting up a financial analyst crew with CrewAI using Poetry.
16:17 Building AI agents with CrewAI using fine-tuning
18:03 Setting up environment and authentication for AI agents
19:46 Focusing on building AI agents with CrewAI while keeping it 100% local
I just had a play with lightning AI from this videos recommendation, I do like the lack of dependency problems, I spent an entire evening messing about with python dependencies for a similar project to crew ai on my local pc, I didn't get anywhere lol.
This was straight forward, I also appreciate the pacing and calm approach to these videos.
I would love to see more informative content on lightning AI and crew ai, maybe using a larger crew, using a variety of tools, and a different subject for some variety, writing a code perhaps.
Keep up the great work!
I think it would be best for every cloud-based service; you include a self-hosted option as well.
#facts people want local
I can't believe people are whining that this is a sponsored video. It's great content. No one is forcing you to sign up for anything. Feel free to do the hours or research on how to use the product yourself if you want 😂
you meant to say feel free to google the very easy to find, very public very visible github for near 75% of his videos and follow the instructions he is following to do the tuts himself, and some tweaks and maybe a chk with someone sometime on something broke, but its following, I can link the links for near all of them, and most the other guys, and I love matt, but uh, research is a stretch for this tut and most, #facts most people didn't go do whatever because his title referred to doing it all local, something that is not so easily found, and not so easily have good instructions, and not so easily to tackle if they are new. #facts #notlocaltutorial
That is INSANELY POWERFUL
Great tutorial! I have been watching your AutoGen series too and now I'm super confused what to pick for my upcoming project. What's your personal favourite? :)
is there a way to get the code without using LIghtning?
This video matched exactly what I was looking for. But I am blown away at how much boilerplate there is to get all this set up! It seems like CrewAI left a bunch of work for the end user to do even though they built in configs etc.
You can chat with crew ai chat bot powered by gpt to have everything generated 😅
im gonna wait till its easier to setup to give it a go
I wanted to jump back into the fray on this thread with an update; I've since been able to install and run crewAI with only local models, no barking from the code about a missing OpenAI key. Carry on! :D
I thought of myself as a code/programmer enthusiasts but I will have to watch this video like 10 times to be able to get it tu run :)
Quick question, can you fine-tune a model inside this workflow?
Fantastic information in here. Thank you for the work you're putting into these videos!
I'm trying to adapt your code to use the default TXTSearchTool, but I don't see how tools are passed to the agent/task. Does it automatically have access to anything in the tools folder?
I ma looking for the same answer.
Me too
naa, tools doesn't work with groq or local with crewai... i dont even know how the fuck they agents used the tools XD... that seam... imposible....
Sponsored or not, I appreciate your content and how it is geared towards devs in the AI space! Thank you
Hello Matthew. Would you please do a video about Semantic Kernel?
To me this represents the absolute worst part of all these Agent projects. 99% this is just configuration information, yet it is spread across YAML files, toml files, Python code files, and env files. To top it off, tools are added to the system with copy/paste. There are at least 5 different configuration methods in just this one small example. The "how" of creating Agents the right way is a bunch of useless knowledge about configuration formats that should have by now been completely hidden from us either by a Crew building Crew or a better abstraction.
Right. I usually rate quality of code inversely proportional to the number of words with dropped vowels and random projects.
A great video as always Matt, I did try Lightning AI but it drove me nuts. I'm not keen on cloud IDEs because I travel a lot and they suck on planes and trains that go through lots of tunnels. I did give it a go though but found the UI rather awkward. In the end I just created a new project in PyCharm and it all worked just fine. Give me a GitHub repo any day.
I run on a 96GB M2 Max Mac so rarely need external GPUs, your demo was a great update on CrewAI. I hope they're not going to get too embedded with poetry but I'm very comfortable with the rest of the structure.
Yes I could not get Lightning AI to work at all. It got caught in some login loop where it would not allow me to access the account. Also there were several instances where the UI buttons would not work. I tried both edge and chrome on PC and could not get either to work. Does not seem ready for prime time.
@johntdavies You seem like you are experienced in Python, I don't see where the SECTools were passed to the agents in this structure. Am I missing something?
@@UncleDougy Hi, actually my programming background is C/C++ and Java but I'm getting the hang of Python. Basically I got rid of the src directory, I use that in other languages but it doesn't seem to fit in with most of my Python code. From my base or root directory I have financial_analyst_crew and in there I have the two directories config and tools. It's exactly the same as in the video, I didn't change anything except removing src and moving everything up a level.
Let me know how you get on.
Leave some time in the video AFTER you say, “like and subscribe” so we can do it, lol. Right now, you say, ‘like’, then immediately the video ends and another one starts. It’s a ton of trouble to get back to your vid. Great video, btw!
Can you do a comparison to AutoGen?
Also is there any framework like this but in JavaScript?
Javascript will receive the results passed to it from the web server which will have executed the Python code. Think of the agent call as being equivalent to a database query being made by the web server. Instead of calling out to a SQL source, you execute some Python.
@@japethstevens8473 that’s a great way of putting it. It’s an engine you can just call out to. Blockchain’s are kind of the same with polling a block and doing client side tx signing etc
Hello, Thank you for your great explainaitions. I cannot understand how is the sec tools defined ? Does crew ai automatically grabs it from tools folder ? It has not benn specified is angents has it ?
The sec_tools is not working in this code ;)
as you mention, it has not been specified in agent.
Also, the sec_tools require the sec api key (queryApi = QueryApi(api_key=os.environ['SEC_API_API_KEY'])) which is not provided in the environment.
@@samansaadzadeh1833 and tool calling doesn't even york with Groq or local AI xD... at least, from what i know... i'm using groq for my agent and just gpt4o-mini for function calling.....
how does the data search part work, Im assuming is not part of the model training, yet being pulled from the web?
Great video, and very valuable for a beginner as I am. I am not a coder, invested a lot of time in terminal, conda etc. to get crewAI templates run for use cases I have in mind. for me it would be beneficial to understand how to set a run time environment that will scale but help stay organized without the need to master terminal and python environments but to focus on crewaAI and Langchain's offerings. So anything you could share being involved a while either by yourself or by one of your network firends driving towards a 'product' would be intersteding to see. Wish you anyway all the best, I'll keep following your sharings.
This video is FANTASTIC! I was on the fence about Autogen or CrewAI, I've spent time with both but I have a feeling that Crew is just behind Autogen and it's a waist of time. Now I know, 100% for sure, for me crewAI is a complete waist of time. Stick with Autogen. Thank you for making this 20 minute video and saving HOURS of my life waisted on CrewAI. thank you , thank you.
Did you try agent swarm already?I think it is pretty undervalued agent solution.
@@EngineerAAJI know agent swarm specifies in their documentation exactly where CrewAI falls short, but I haven’t deployed anything beyond the demo for agent swarm. How much have you worked with it?
@@eIicit for my application for now it is early to tell which one will perform better, but I am experimenting with the three solutions to see which one performs better for my specific task, and once I get some more solid information I will let you know
Great video at right time, since the AI agent is a new, we need a simple and smooth start before we go advance and commercial use
Awesome content Matthew. Appreciate the tips on good practices, not a lot of UA-camrs articulate on best practices and standards. Thank you!
Do you not use venv? it's pretty straight forward so what kind of issues have you been having with your environments?
crewai are going with the poetry and docker model for installs I think, hence Matt using poetry. yes I'm sure you can simply install crewai in a python venv and work from there, but that won't help later on when they start including other dependencies. Which I agree raises a whole nother can of worms
The trouble referenced wrt to dependencies and virtual environments is vastly overstated. I suspect it was more about supporting the sponsor than solving a legit concern.
Developing AI Agents with the CrewAI appears intriguing. Don't pass on SymthOS if you want to use AI to push the envelope. It's a real industry innovator.
Ive worked with crew AI and ive found the tools to be the hardest part do you have any more content on how that works and how to make better tools
great video and really like the 'golden path' way, but I am not sure from the code or the video how how tool is connected to the agent. Am I missing something? Trying to rebuild a Crew using lightning and this framework. Any help would be greatly appreciated. I tried to figure it out, but I am missing something and their I can't find documentation on crew AI for this
He didn't implement the tool in the code
heres a video for you to make dude, i just put this video in gemini and asked it for the code and it did it, im on the free version of gemini, fk paying for ai :D
Impressive!
People are underestimating the degree to which this kind of synergy is going to change things.
How the agents know about the tools if you are not passing to them?
they not. this code can't work with tools. you know openai api to make tools and structured output work...
I have a 3090 and I can run Mixtral fine locally. However, I've had very bad results with CrewAI and tools like SerperDev and BraveSearch to name only those. It's like the model does not understand how to properly call the tools. It's like a roll of a dice. Sometimes it works, but most of the times it just times out without doing anything useful. I wish you would make a full demo of CrewAI with OS models + tool usage.
It's a bit of a crapshoot when running locally. sometimes it just works and other times the model hates you and wants to punish you for some unknown deed. Try rewording your agents and tasks and see if it helps.
He wishes he could too...and so do I... ;) #facts #morefacts
If you look at the output (though you scrolled quickly through it) the models didn't use the tool provided. The analysis is around Q3 and Q4 of 2022. I followed along letter for letter and while it did work I did not get the expected outcome because of outdated data. I am thinking that the tools need to be added to the task maybe, but that's not clear how I would do that in the .yaml file config. Possibly by just adding the name of the tool in a tool section of the task... Just wanted to point that out.
How did the Crew know to use the tool? I don't see anywhere where we set that up, is it just based on the directory structure and nomenclature? Or is it all in Poetry ?
So, we use conda to set up an environment, and poetry to lock the environment? Another layer of abstraction brings code closer to incomprehensible. It's hard to figure out what directory levels various files are in. (getting frustrated with python's environment)
Nice work!!
Thanks for the video. Where is the financial information coming from? Is it from the mixtral model? The dates seems to be from 2023.
Nice job! Next, please do an example of a CrewAI that builds new Crews. Then make that Crew builder available to everyone.
did you give the sec tool to any of the agents?
I take it crew AI is your favourite agent builder
He said he's an investor.
There's a disclaimer on his profile.
Thanks, ya'll I truly wasn't aware
Just to clarify, I meant the raw crewAI Builder not the LightningAI Studio
Great video and very informative! However once i successfully ran the program on lightningAI i noticed the stock information for TESLA was wrong (outdated), the agent told me the source of info (Yahoo). I changed the company from Tesla to Netflix to see if this data would be inaccurate as well, and sadly it was. However the data pulled on netflix did notify me that the data was from 2021. Is this an issue with GROQ? or is it to do with what tools we’ve included? Thanks once again for the awesome informative video! Thumbs up and a new subscriber here!
great, did some analysis on the stock from February 2023. are you sure this worked, much less using old info? I don't see TSLA ever getting much over $400 per share, briefly in 2021, and this says stock was $1,036, unless they did some splits but i wasn't gonna look that close. Why didn't the "crew" call that out if that is the case? point is, these agent frameworks (and LLMs) have a long ways to go before we stop questioning their output.
I also think the data was incorrect, looks like there was a lot of hallucination rather than actual data from a reliable source.
prompts instructions =primary issue with output results, not the model
Two words: Query engineering
Matt what do you think is these opensource stuffs are just for fun playing, or it is feasible to make a product ready app based on? I am wondering how can we test such an LLM based module correctly...
Good stuff! Do you happen to have these code files on Github?
No, but you could download them from the lightning studio, which I published.
Could you do something a bit more complicated? Like write a Snake game, but you have a back and forth as you want to add features or fix bugs?
Thanks. Was unable to get your earlier VScode tutorial working, but now on Lighning this is working. Good to be on the golden path. How might one output the result to a .txt or .doc (or any other such) file?
Even it paid video I really need something like this thank you so much you read my mind.
Hi Matthew! Great video! I am running into all sorts of issues trying to launch a Studio, though. It doesn't look to me like Lightning is that dependable?
I signed up for a Lightning Ai account and it told me to wait 2-3 business days for account verification :(
I assumed this was the issue due to me looking at this vid and signing up for Lightning AI on 5-5-24. That, I don't get. Why include a tool in the process that a new person can't use. Sorry if I'm missing something, wouldn't be my first miss....
this and the beginner video is still way over my non techie head. also, i want to be able to automate my work at my corporate office job with these. i don't create content or work for myself. how would i run a department with agents?😏
Dude that’s awesome about Lightening. I’m always mobile using the 12.9 iPad Pro with keyboard and pencil. Working on my ERP is a b…. cause I can’t use vscode on this.
Thanks MB! Fantastic quick tutorial. More of these please. And don’t worry about those who are thinking you shouldn’t have sponsors, let them work free if they want to or create all their own content out of pocket, you just keep doing You.
I haven’t read the docs on this yet, but it feels like this is taking away from the charm of crew ai, it’s simplicity. What do you think, do you prefer it this way ?
Thanks Matt, How you set temperature for each agent in CrewAI?
Thanks , its quite useful and structured.❤
Hey Matthew, can we run the image library for prompting images from. Text offline like the language model?
Thanks a lot. But writing code has become very tedious since the appearance of llm. I guess a competitor would do the same without writing a single line of code 😀
In the AI wars... There are no competitors. Everyone's solo, and at anytime a unicorn can appear. Just the other day, I literally implemented an LLM from scratch, using a language that's not normally used for machine learning due to it's speed (Xojo)... And oddly, the new architecture I created, runs faster than any python code I've encountered... So, now to port the code to python 😂😂😂
The point - programmers will always be able to do things non-programmers cannot, with any technology. We literally invent the technology and still have to code, to get to a "no code" point... And even then the creator, still has to code. 🤫
Plus - it's easier to add new features to a full code platform vs a no- code platform, because with no code - the more abilities, the more room for bugs, clunkiness, and all out security issues. Botpress for example is over 500,000 lines of junk most people don't need if they're doing a basic conversational bot... All that overhead 😮 (=carbon).
No code tools are really created just to get people on the coding bandwagon - do you see any reputable businesses creating apps or software with no-code solutions? No - because the code must be vetted for any reputable business, and no code cannot be vetted. 💯 So no code = hobbyist
**Code is always tedious - it's either right, or it's wrong; there's no between. 🙏
@@mcombattias a non coder I agree. Im getting fed up of paying for multiple tools that only give you partial data so time to bite the bullet and learn python.
@@mcombatti #99%rightloveit
100% local then proceeds to talk running on cloud sponsors?
he does both. most people cant run agents locally. Ollama and matching APIs make the difference between remote and local a lot less.
You can easily run this locally using this tutorial. Only difference is no lightning.
lol #facts #notlocaltutorial
@@matthew_berman But did you demo that process to them? #notalocaltutoial #facts
Awesome, thanks! I've playing with it to see what it can do. Is there a way to change the language of the output?
Great video! Thanks
absolutely valuable video, can't thank you enough Matt
Is this method more cost-effective than simply using an OpenAI API key? Thanks
Is there any chance you could show us how to get crewai interrogating local documents. I write a lot of reports and have to find a local solution to compile private local data with data which is available online. I have crewai working with local llm’s but can’t for the life of me get their tools working for me. I can’t find any examples online and find your videos extremely easy to follow. Thanks.
they don't.... at least with crewai....
I am looking at the documentation on github and website and I cannot find any information on how to run this - all I see is the previous version where all the definition is in python. I love the YML definition and the decorators taking care of a lot of the work. Is this not out yet? Any idea when it might be coming, am I missing something?
Like the how you are building agents in the yaml files, but all the crew AI examples and documentation do not show this. Do you have any documentation somewhere showing the use of yaml files?
how do you make a poetry.lock file, what happens durring you changing screens while youre still talking-giving directions, where exactly does one find the sec tools to copy and all the other things to copy???? Could you make this fir a newbue to get started up and running a basic or rather a semi basic to great chatbot for answering questions of the user. Note: i had plans on connecting this cloud Ai into MIT App Inventor so it could have comunicatuons.
I wish you did it locally and published the py files so that we don't have to start from scratch. I totally agree installing stuff locally is a pain, I spent 2 days trying to convince arch (well, Manjaro) to install llama-cpp, in the end, I copied the installation from conda, which was successful but langflow wouldn't find it. So cloud is nice, but also, you sacrifice your privacy and some money. So I like local much more.
Hey Matthew, what is the reason you use CREW AI and not Autogen Studio?
Hi, do you give any personal pointers on how I can incorporate ai agents to my business, would be great to have some one like you to help people incorporate them
very interesting video. It went by a little fast but once I finished I realized I could just open the model you created in the description... I did everything in the video and tried changing parameters in yours. I can not seem to get it to work. just getting errors in the terminal. saying Ollamaa call failed with status code 502. Any ideas?
Always interesting.
@matt can I contact you about an idea I have for government contracting? Thanks.
Share it
Does it means that for every company research , I have to create new AI agent?
Cool, thank you!
Hi Matthew, can i use llama 3 70b with crewai on lightning as well. Would the costs be high?
Does local just mean local host - or can it be in our private cloud, with no data leaving our VPC?
This code shouldn't work.
SEC_tools wasn't included in the agents...
make an example that does not require any search APIs, my understanding is that the sec_tools code you used requires an API to something like serper
This seems like 80% local! I'm between jobs and want to play around with AI locally at this time I'm not interested in using any cloud service or anything that might cost money. I do have several a few gaming PC and an old R730 server w Nvidia P40 to play around with and don't mind waiting if it takes some time.
I'm not quite clear, what unique thing does Lightning Studio do that can't be done in regular python or any free ide?
When will CrewAI be open for new acounts?😊
I just hope that this type of stuff grows out of just being implemented in python. I don’t hate python especially after they introduced data classes but boy are virtual environments messy. I remember in 2017 in college making a terrific django app only to get caught in one of those big version updates. I was a novice & migration docs weren’t that great then. I migrated anyway. Nothing worked anymore. After that i was like no more python for me 😂. Imagine building something like in the video in code & updating the framework you used to the latest version. Oh and have it running live in your business & poof broken! Really hope i can code up this stuff in like javascript or C#. In rust with a framework would be ideal.
That horror story should never happen in a business environment, which should be running with full backups of everything the business logic touches or depends on. This issue is about poor practices, not any failure of virtual environments.
@@VideoSafari7 My point is it’s to complicated and a hassle. I’m in dotnet now and never had an issue.
@@jaymartinez311 Also, my point is, those dependency issues you mention are not unique to python. Virtual environments in python, properly employed, do not complicate the issue of dependencies. Venv is literally a tool to manage dependencies. As for your business crisis, you should learn the difference between production and development code, QA, and best practices with respect to backups.
Is your project in this video on github or somewhere I can d/l it? ty
Hello, when running the command with poetry does anyone have the same error:
attribute error 'WrappedClass' object has no attribute 'crew'
Thanks
this is helpful! do you happen to know how to use output_json with this method? i keep getting errors like "Input should be a subclass of BaseModel" no matter how i try to pass it to the task.yaml or inside the @task definitions
You can have replit AI write all the code for you inside the same UI
Great stuff
Tell me Matt, how is this project 100% local when the first thing you do is use some cloud collaboration tool that we will likely never see you use again? Or how about groq? is that API key you're going to revoke going to be used for a groq instance on your local hardware? I suspect not.
what is the difference between an agent in this case and something like an openai assistant?
Is crewai stable now? I tried some examples from a month ago but there had been code changes so I have to re-check every time
Matthew, How can I load my own code into this type of environment?
Worthlwess!