Are you a real human? I have NEVER seen an author on youtube cover so much incredible knowledge in such a short video. This is absolutely AMAZING!!! Thank you
Incredible intro video for the semi technical about how chat gpt and similar models will be used in daily life to improve the mundane tasks, with a side of cautions about incorrect answers and computational limitations! Great balance, I’m already sharing it around our team 😊
This is great. We're in the process of integrating LLMs into our "what if" scenario modelling platform and this gave me a few ideas on next steps. Sharing this video with my dev team!
Great video! I used to have a personal finance app too, but watching this made me realize how much easier things would be with LLMs. They open up so many possibilities for automation and insights. I might just refresh my app idea in the future-thanks for the inspiration!
🎯 Key Takeaways for quick navigation: 00:00 💲 *Reviewing Income and Expense Breakdown* - Explained the process of analyzing financial transactions. - Talked about classification of expenses into categories. - Spoke about using low-tech ways and an AI assistant for classification. 02:16 💻 *Running a Large Language Model Locally* - Discussed different ways to run an open-source language model locally. - Listed various popular frameworks to run models on personal devices. - Explained why these frameworks are needed, emphasizing the size of the model and memory efficiency. 04:18 📚 *Installing and Understanding Language Models * - Demonstrated how to install a language model through the terminal. - Showed the interaction with the language model through queries in the terminal. - Assessed the model's math capabilities, showing a failed example. 06:48 🎯 *Evaluating Expense Classification of Language Models* - Checked if the language models can categorize expenses properly through the terminal. - Demonstrated how to switch models, correctly installing another model. - Showed the differences between the models and preferred one due to answer formatting. 08:24 🛠️ *Creating Custom Language Models* - Explained how to specify base models and set parameters for language models. - Demonstrated how to create a custom model through the terminal. - Discussed viewing the list of models available and building a custom blueprint to meet specific requirements. 11:46 🔄 *Creating For Loop to Classify Expenses * - Discussed forming a for loop to classify multiple expenses. - Detailed how to chunk long lists of transactions to avoid token limit in the language model. - Mentioned the unpredictability of language models and potential need for multiple queries. 14:32 🔍 *Analyzing and Categorizing Expenses* - Demonstrated how to analyze and categorize transactions. - Showed how to group transactions together, clean up the dataframe, and merge it with the main transaction dataframe. 15:14 📊 *Creating Personal Finance Dashboard * - Detailed the creation of a personal finance dashboard, that includes income and expenses breakdown for two years. - Introduced useful visualization tools such as Plotly Express and Panel, giving a short tutorial on how to use them. - Demonstrated the assembling of a data dashboard from charts and supplementing it with custom text. 17:02 📈 *Visualizing Financial Behavior Over Time* - Demonstrated the use of the finance dashboard, drawing observations. - Concluded with a note on importance of incorporating assets into financial management. - Highlighted the value of running large language models on personal devices for tasks like these. Made with HARPA AI
Thank you for sharing this dear! You covered the basics and shown the path to a great first goal with your own custom on premise and well licensed LLM. Huge!
Great video... My 2 cents: we can force LLMs to respond only in json format by stating it in system prompt, so you get consistent parsable response always (I've tried with gpt4), also you can provide list of possible expense categories to avoid grouping them together later (like 'Food & Beverage' and 'Food/Beverage')
@@martinmoder5900 llama2 and even gemma:2b does that too, but when I tried it still generated "new" categories, and the json answers would be "odd" like sometime it would modify the name of the expense.
Hi Thu! Last year I had referenced your panel dashboard video to build my personal finance dashboard. I like seeing how you built yours. Your content is very useful. Thank you!
This is great! I was recently experimenting on a personal finance tracker dashboard and connect it to a chatting apps, so the user could easily input their financial activity by only typing it. On the process, i try to use chat gpt to simplify and generalise the format so we can input the data faster, never have i thought that it could be done by a local LLM. Looking forward for your next video.
This is such a great video. Thank you for making it. I had no idea this sort of thing was possible and I'm finding all sorts of ways to take advantage of it now.
Excellent video, I used the concepts to enhance a project that I had already started in R and it worked fine, but so slow in my computer (like 5 min to analyse 10 registers). Now I know the concepts and I`ll keep experimenting with other LLM models. Thank you!
You just earned a new subscriber, Thu. I mean, wow. Very inspirational to see what you built on a friggin laptop, no less. Goes to show you don't need thousands of compute cores, either. Ver very cool. 🎉
Thanks so much ! Being investigating AI for just one month, having so much to learn again (and that's cool), your videos really help. Being not a natural english speaker, it was a bit fast to follow, but no issue : It was clear, precise, and... I will find time to listen to it up to be sure having got any lesson from it. Same apply to your other videos, but change nothing : ( It could even help me improve my English level ;-)... )
As a data scientist, I am blown away by your video's theme. You successfully managed to keep it simple to attract the interest of the majority and mention about technical details that is beneficial for more technical people watching this video. Best wishes!
"Although, as you can see I can't retire anytime soon" 😂😳 Thu, this was a pretty ingenious way to label data; one of the biggest part of our time is data cleanup and this helps speed it up
Haha, yeah I thought I'd saved much more.. 😂 Definitely, I hope to explore more analysis use cases for local LLMs. I heard about LM studio but somehow I just like the setup with Ollama better. I guess they are very much the same in the backend.
Thank you so much. 🥰It is so well explained and a very cool project. I think LLMs are a powerful tool and running them locally will make it safe to share critical information with them.
Outstanding video, especially for this beginner. Didn’t know you could run the models locally. Those ollama layers look like docker, fascinating how the context is setup. Time for me to spend some cycles on all your vids, not just the couple I’ve casually looked at. Thanks!
What an amazing video! This is definitely a personal project that I've wanted to tackle and while I'm familiar with other languages, I'll definitely use your video as a guideline.
Thank you so much for sharing this with us!! I’ve been looking to do this for years but just thinking about the task ahead, I would give up. I will definitely analyze my own financial statements. Thanks mucho gusto!!
Thanks Thu, great demo of Ollama, sorry your arent going to be retiring anytime soon😢 I really like the multimodal model support in Ollama, llava is a great model to try and runs on not much RAM.
Thank you Oliver! I would absolutely not mind making videos until I retire though 🤣. The multimodal support is interesting, I haven't tried it out yet but will look into those models a bit more 🙌🏽.
Cool project! I'd like to try it myself. One interesting idea is to have the LLM generate a memo field for each transaction (which can be controlled via prompting). Then by embedding these and doing hybrid retrieval, you can search in natural language as well as by metadata for transactions.
ayo, i'm just doing my first step that's logging every expenses i got since the start of this year i'm just thinking about doing some sort of software that help me manage my expenses and savings and this is exactly what i think of thank you for the high quality video
I just read about the latest Meta LLAMA model that is supposed to be better than GPT4 for s/w dev! I hope that we can run it as a LOCAL LLM ! Thank You for this timely vid. ...
If you want to give data as many as the number of tokens of the model. You don't need to calculate and know by hand. Instead, you can do this with "chunks" in Langchain. nice explanation thank you
Excellent video and practical application, you didn't get to cover pydantic much which solves a current challenge with LLMs. As for the dashboard, maybe another framework or approach with less or no code could be be more efficient :)
How to make LLM learn and be able to correctly identify new categories? For example, creating an income statement from the list of all journal entries, but LLM need to identify each entries and correctly categorized it. Say, there's an entry for a plane ticket and wages paid to XYZ. The LLM reads the entries and correctly map it to expense item "travel expense" and "salaries/wages" expense. This is similar concept to your video, but more broad with the ability to learn.
Thank you for the video, I will defintely try this out with my own budget data. I already got a budget template that I am running python automation to update weekly, I want to see if LLM could add some suggestion and simple analysis on my finance comparing to my financial goals. I am a little bit worry about the maths part since llm is not good at maths but I will see. Thx for the great video!
To be fair, this is a classical classification case and throwing LLMs on it might be overkill. LLMs are good for predicting the next word in a sequence while taking the context of the previous words into consideration. That's basically all LLMs do. LLMs might help in resolving ambiguity and find more appropriate classes or relation of classes, but it is thrown now on all kinds of problems regardless whether there are better tools available to do the same job. Like the saying goes: "If the only tool you have is a hammer, you tend to see every problem as a nail" 😄
@@Kessra I was really doing exactly the same thing and decided very early on that an LLM would not be the right thing for this task! I mean there is PandasAi and Langchain but using an LLM would be more a thing of trying it for the sake of fun and learning something, rather than trusting it with my finances! Thanks for the content! It was fun to watch! Looking forward to see more of it! 😊
Update: Ollama now works on Windows normally
Yayyy! Great news!
Are you a real human? I have NEVER seen an author on youtube cover so much incredible knowledge in such a short video. This is absolutely AMAZING!!! Thank you
Her being an AGI would make perfectly sense
@@martingrillo6956 Or she used her AI skills to generate the teleprompter output she's reading? ;)
Incredible intro video for the semi technical about how chat gpt and similar models will be used in daily life to improve the mundane tasks, with a side of cautions about incorrect answers and computational limitations! Great balance, I’m already sharing it around our team 😊
Thanks a lot for your comment and for sharing it around! Really appreciate it 🤩🙌
This is great. We're in the process of integrating LLMs into our "what if" scenario modelling platform and this gave me a few ideas on next steps. Sharing this video with my dev team!
Great video! I used to have a personal finance app too, but watching this made me realize how much easier things would be with LLMs. They open up so many possibilities for automation and insights. I might just refresh my app idea in the future-thanks for the inspiration!
Awesome structure to convey a "simple" idea, without getting down into the weeds with how truly complicated it is. Thanks!
OMG this is inspiring I always wanted a 3rd party view about my expenses without loosing control of my data and this video hits the nail on the head.
So glad to hear! Good luck with your project 🤗
🎯 Key Takeaways for quick navigation:
00:00 💲 *Reviewing Income and Expense Breakdown*
- Explained the process of analyzing financial transactions.
- Talked about classification of expenses into categories.
- Spoke about using low-tech ways and an AI assistant for classification.
02:16 💻 *Running a Large Language Model Locally*
- Discussed different ways to run an open-source language model locally.
- Listed various popular frameworks to run models on personal devices.
- Explained why these frameworks are needed, emphasizing the size of the model and memory efficiency.
04:18 📚 *Installing and Understanding Language Models *
- Demonstrated how to install a language model through the terminal.
- Showed the interaction with the language model through queries in the terminal.
- Assessed the model's math capabilities, showing a failed example.
06:48 🎯 *Evaluating Expense Classification of Language Models*
- Checked if the language models can categorize expenses properly through the terminal.
- Demonstrated how to switch models, correctly installing another model.
- Showed the differences between the models and preferred one due to answer formatting.
08:24 🛠️ *Creating Custom Language Models*
- Explained how to specify base models and set parameters for language models.
- Demonstrated how to create a custom model through the terminal.
- Discussed viewing the list of models available and building a custom blueprint to meet specific requirements.
11:46 🔄 *Creating For Loop to Classify Expenses *
- Discussed forming a for loop to classify multiple expenses.
- Detailed how to chunk long lists of transactions to avoid token limit in the language model.
- Mentioned the unpredictability of language models and potential need for multiple queries.
14:32 🔍 *Analyzing and Categorizing Expenses*
- Demonstrated how to analyze and categorize transactions.
- Showed how to group transactions together, clean up the dataframe, and merge it with the main transaction dataframe.
15:14 📊 *Creating Personal Finance Dashboard *
- Detailed the creation of a personal finance dashboard, that includes income and expenses breakdown for two years.
- Introduced useful visualization tools such as Plotly Express and Panel, giving a short tutorial on how to use them.
- Demonstrated the assembling of a data dashboard from charts and supplementing it with custom text.
17:02 📈 *Visualizing Financial Behavior Over Time*
- Demonstrated the use of the finance dashboard, drawing observations.
- Concluded with a note on importance of incorporating assets into financial management.
- Highlighted the value of running large language models on personal devices for tasks like these.
Made with HARPA AI
Thank you for sharing this dear! You covered the basics and shown the path to a great first goal with your own custom on premise and well licensed LLM. Huge!
You are so welcome! Glad it was helpful 🙌
Great video... My 2 cents: we can force LLMs to respond only in json format by stating it in system prompt, so you get consistent parsable response always (I've tried with gpt4), also you can provide list of possible expense categories to avoid grouping them together later (like 'Food & Beverage' and 'Food/Beverage')
Yeah, it is very powerful! However, is llama2 also providing this?
@@martinmoder5900 llama2 and even gemma:2b does that too, but when I tried it still generated "new" categories, and the json answers would be "odd" like sometime it would modify the name of the expense.
@@martinmoder5900 llama 3.1 (the new one) is pretty powerful so it should be able to do it for you. given enough compute power
Thanks!
Hi Thu! Last year I had referenced your panel dashboard video to build my personal finance dashboard. I like seeing how you built yours. Your content is very useful. Thank you!
This is great! I was recently experimenting on a personal finance tracker dashboard and connect it to a chatting apps, so the user could easily input their financial activity by only typing it. On the process, i try to use chat gpt to simplify and generalise the format so we can input the data faster, never have i thought that it could be done by a local LLM. Looking forward for your next video.
Thanks for the great overview of using aa local LLM Thuy! Very useful and informative.
This is such a great video. Thank you for making it. I had no idea this sort of thing was possible and I'm finding all sorts of ways to take advantage of it now.
Always good to see more people bringing data skills to understand personal finance.
I love the content. Also, I have not seen anyone can program so fast!!!
thank you for including the repo!! it makes the content 10x better!
Excellent video, I used the concepts to enhance a project that I had already started in R and it worked fine, but so slow in my computer (like 5 min to analyse 10 registers). Now I know the concepts and I`ll keep experimenting with other LLM models. Thank you!
Love the video! The beginning sets up the project perjectly and the tutorial is very easy to follow!
Xin chao Thu, thanks for your great video. That's so mind blowing to see beyond the usual usage of ollama local AI.
this is one of the best videos I watched about llms
You just earned a new subscriber, Thu. I mean, wow. Very inspirational to see what you built on a friggin laptop, no less. Goes to show you don't need thousands of compute cores, either. Ver very cool. 🎉
Wow, thanks you so much! Indeed, we definitely don't need to go broke buying super computer for this 🙌
I never ever ever comment on anything, but goddamn - what a great video/tutorial. Just finished playing with the notebook and I learned a ton!
That’s so awesome to hear! Thank you so much for commenting ❤️🤗
Incredible video, I love how you simplified all the process. Your content inspired me I will try it on my personal projects as well
Awesome, go for it!
You are a very good presenter, easy to follow. Nice content
Great video .. The one project which I wanted to take up during my holidays .. Learn in the same time have a view on my personal finance ..
As always, high-quality content from a highly competent woman!
That's so kind of you, I'm trying to be ;)
Thanks so much ! Being investigating AI for just one month, having so much to learn again (and that's cool), your videos really help.
Being not a natural english speaker, it was a bit fast to follow, but no issue : It was clear, precise, and... I will find time to listen to it up to be sure having got any lesson from it.
Same apply to your other videos, but change nothing :
( It could even help me improve my English level ;-)... )
Great to hear!
As a data scientist, I am blown away by your video's theme. You successfully managed to keep it simple to attract the interest of the majority and mention about technical details that is beneficial for more technical people watching this video. Best wishes!
"Although, as you can see I can't retire anytime soon" 😂😳
Thu, this was a pretty ingenious way to label data; one of the biggest part of our time is data cleanup and this helps speed it up
out of curiousity, why did you choose ollama? (vice something like LM studio)
Haha, yeah I thought I'd saved much more.. 😂 Definitely, I hope to explore more analysis use cases for local LLMs. I heard about LM studio but somehow I just like the setup with Ollama better. I guess they are very much the same in the backend.
Trust me, clicking the video and scrolling through the comments, I was anticipating your comment to be at the very top😅
Super cool! Great channel. Excited to watch more
Thank you so much. 🥰It is so well explained and a very cool project. I think LLMs are a powerful tool and running them locally will make it safe to share critical information with them.
Thank you, really appreciate it! ❤
Thank you! it's quite hard to follow up with this ollama thing, and you explain it so easily. thank you!!! please mae more of this!!!!
Outstanding video, especially for this beginner. Didn’t know you could run the models locally. Those ollama layers look like docker, fascinating how the context is setup. Time for me to spend some cycles on all your vids, not just the couple I’ve casually looked at. Thanks!
Glad to hear you found the videos helpful! Thanks for stopping by 🙌🏽
Me too. I thought you need to have some monstrous supercomputer and spend weeks on configuring everything to run one of these models locally
Amazing work you put in here. This is inspiring
What an amazing video! This is definitely a personal project that I've wanted to tackle and while I'm familiar with other languages, I'll definitely use your video as a guideline.
This was an excellent video - many thanks for sharing!
Went back to review this vid for Personal Finance for one of my Jan. 2025 "New Year's Resolutions" (under llama3.1) ! ! ! ! !
Haha that sounds awesome 😂🙌
Your videos are well thought out .. Keep them coming - Dont want you "retiring soon" 🙂
Haha thank you for this! Don’t worry, with UA-cam I don’t want to retire anytime soon 😉🤗
Thank you so much for sharing this with us!! I’ve been looking to do this for years but just thinking about the task ahead, I would give up. I will definitely analyze my own financial statements. Thanks mucho gusto!!
Thank you very much
Thanks for the great intro into how to get started with local LLMs. I'll give it a go after Tết 😄
Happy Tet holiday! 😀🎉
I am blown away by this video! If only I can get my CPA to do the same. I guess I’ll need to learn to code.
I've noticed that most LLM understand that you would like a CSV formatted output and you use that to get more consistent output.
Wow this is fantastic video. Thank you, Thu!
I learned so so much watching this. Thank you so much.
This is incredible, a bit far fetched from my skills and time in hands. But surely inspiring!
Thanks Thu, great demo of Ollama, sorry your arent going to be retiring anytime soon😢
I really like the multimodal model support in Ollama, llava is a great model to try and runs on not much RAM.
Thank you Oliver! I would absolutely not mind making videos until I retire though 🤣. The multimodal support is interesting, I haven't tried it out yet but will look into those models a bit more 🙌🏽.
Very well explained. Looking forward to you posting the github repo.
Thank you for watching! I've added the repo link in the description 🙌🏽
J'ai adoré, vidéo super clair allant droit au but et qui nous la joie d'aller découvrir le code
Wow absolutely wow, thank you for such a great project, so many ideas ringing in my head. Cheers
Thanks for the demo and info. So detailed and analytics are great. Have a great day
Awesome research as always!
I see how this is useful for being one's own accountant :) Super!
Thank you so much for making this video. Subscribed, this is exactly the content I look for
As a Javascript coder, this was a mindblowing video, I had no idea Python was this powerful.
this is great.. thank you for the breakdown of all these options
Cool project! I'd like to try it myself. One interesting idea is to have the LLM generate a memo field for each transaction (which can be controlled via prompting). Then by embedding these and doing hybrid retrieval, you can search in natural language as well as by metadata for transactions.
That’s an interesting idea! Would love to see how well the retrieval works 🤗
Thanks Thu, just heard about local LLMs from my boss today and look whose video is on the top to help me out! 😃
Hey Shivam! Thanks for watching! So happy to see your comment 😍🤗
Amazing job explaining this!
Thanks sis, you're awesome!
You earned a new subscriber today. Thanks for how intuitive this video is. I also love how you pronounce "O-lla_ma"😹..kidding
Haha, thank you for the subs! 🎉
Thanks for the video. Nicely done and presented, educational with an interesting use case
ayo, i'm just doing my first step that's logging every expenses i got since the start of this year
i'm just thinking about doing some sort of software that help me manage my expenses and savings
and this is exactly what i think of
thank you for the high quality video
Amazing.
Thank you for sharing this, I learned so much!
Thank you SOOOOOOO much for this !! this is an awesome tutorial
You are so welcome! Glad you like it!
Your content always useful! I like the Panel lots.
Thank you so much! So happy to hear 🤩
@@Thuvu5 💛
Great video. Very inspiring. Also...I used to live in Amstelveen (20+ years ago!). Funny to see that name in there.
Oh haha, the world is small! 😀
Thanks so much! It giving me inspiration for using this in a security analysis context.
I just read about the latest Meta LLAMA model that is supposed to be better than GPT4 for s/w dev!
I hope that we can run it as a LOCAL LLM ! Thank You for this timely vid.
...
Ooh that’s pretty cool! 🤩 So great to hear many models are approaching GPT4 capabilities 🤯
Really awesome explanation! I am going to use this. Thank you Thu!!
I loved this and hope to try this out for myself (though my programming skills are very rusty)
I have a great admiration for the younger generations who know how to do all this tech stuff. It looks very complicated to me.
Haha, that’s so kind of you. I’m sure it’s less complicated than it looks
Fantastic! Your videos are always good surprises at my feed.
Finally the text classification video that I was searching for
Great video to start using LLM! Thank you for sharing!
This is a life-changing video
Nice. Might give this a try over the weekend. Just need to figure out how to get my banks data.
Love it , i am subscribing instantly , i have a lot of questions.
Thanks for this great video.
Such a cool project!
Thanks, That was inspiring indeed :)
If you want to give data as many as the number of tokens of the model. You don't need to calculate and know by hand. Instead, you can do this with "chunks" in Langchain. nice explanation thank you
Very concise and informative video. I appreciate it.
Great insights and well explained!
thank you! this is a project i'd love to try, keep up the good work 😊
incredible, loved the content.
Excellent video and practical application, you didn't get to cover pydantic much which solves a current challenge with LLMs. As for the dashboard, maybe another framework or approach with less or no code could be be more efficient :)
Well done I'll try and re-create this. Thank you once again
I was looking for THIS! Thanks!!
That what I'm looking for !!! Thanks
How to make LLM learn and be able to correctly identify new categories? For example, creating an income statement from the list of all journal entries, but LLM need to identify each entries and correctly categorized it. Say, there's an entry for a plane ticket and wages paid to XYZ. The LLM reads the entries and correctly map it to expense item "travel expense" and "salaries/wages" expense.
This is similar concept to your video, but more broad with the ability to learn.
You are awesome! Thanks for making this video.
Thankyou so much for this video. I relly like the explanation. Thanks
Thank you for the video, I will defintely try this out with my own budget data. I already got a budget template that I am running python automation to update weekly, I want to see if LLM could add some suggestion and simple analysis on my finance comparing to my financial goals. I am a little bit worry about the maths part since llm is not good at maths but I will see. Thx for the great video!
That's awesome. I would also use Llama to write the code for generating plotly charts/dashboards haha!
I realized that it is easier to code the stuff myself, rather than having to mess with some LLM that is stubborn and very resilient to reasoning! 😅
To be fair, this is a classical classification case and throwing LLMs on it might be overkill. LLMs are good for predicting the next word in a sequence while taking the context of the previous words into consideration. That's basically all LLMs do. LLMs might help in resolving ambiguity and find more appropriate classes or relation of classes, but it is thrown now on all kinds of problems regardless whether there are better tools available to do the same job. Like the saying goes: "If the only tool you have is a hammer, you tend to see every problem as a nail" 😄
@@Kessra I was really doing exactly the same thing and decided very early on that an LLM would not be the right thing for this task! I mean there is PandasAi and Langchain but using an LLM would be more a thing of trying it for the sake of fun and learning something, rather than trusting it with my finances!
Thanks for the content! It was fun to watch! Looking forward to see more of it! 😊
Ma'am You are perfect!! Thanks, I searched the whole day and finally you saved me. Also, you are really pretty.☺☺
Glad to hear! thank you haha
very good! thank you for sharing!